The JJQ1 signal simulator, which has relative perfect functions in the provincial level laboratories, has been used for three years, but there is no reporting about using the signal simulator to calibrate collectors of automatic meteorological stations. There are complicated factors for this phenomenon; for example, the calibration software is not reasonable, and signal interference among channels (especially the analog channel) results in too long calibration time and low efficiency; as well as the analog signal drift with the environmental temperature; it is not compatible with all common data collectors. These problems are analyzed by the theoretical and empirical methods, and some suggestions and opinions are put forward for signal simulator users, as well as research and development personnel.