Data Quality Audit Method of Environmental Factors
  
View Full Text  View/Add Comment  Download reader
DOI:10.7643/issn.1672-9242.2022.05.020
KeyWord:meteorological data report  missing data  data exceeding boundary  quality audit  audit process  audit algorithm  multi-threaded
  
AuthorInstitution
WAN Jun Southwest Institute of Technology and Engineering, Chongqing , China
Hits:
Download times:
Abstract:
      In order to solve the problems of missing data, data exceeding boundary, internal inconsistency in data and inconsistent data time in meteorological data report of atmospheric environment test station, the data quality audit technology is used to identify the missing, suspicious or erroneous data, and to alert the scientific researchers so that they can trace the source and analyze the causes of the problems. The environmental factors data quality audit algorithm and audit process are established with reference to relevant regulations and standards, and the process and algorithm are solidified by using computer language programming, and the data were scanned by using multi-threaded algorithm to realize the parallel audit of large quantities of meteorological data. The environmental factors quality control software is designed by using Python language. The application of the software proves that the method is reasonable and effective to mark the data quickly and accurately with quality problems in meteorological data report. The software is used to count the number and accuracy of the problem data. Through the loading data test, it is proved that the environmental factors data quality audit method and audit process are reasonable and effective. By using the designed audit software, the rapid audit of meteorological data reports is realized, the audit efficiency is improved, the labor intensity of scientific researchers is reduced, and the foundation for further filling, correcting and using data is laid.
Close