| 摘要: |
| 摘 要：【目的】为完成省级电子档案归档及长期保存系统建设，保证气象数据的及时传输和存储，本文旨在解决压缩和打包较大文件时间过长的问题，提供一种压缩工具pigz的使用方法。【方法】对比多种压缩打包工具的特点，通过用不同工具对同一文件进行压缩打包，采取实验对比zip和pigz的处理时长，并结合开发实际分析pigz在应用中的常见问题。【结果】实验证明pigz的压缩打包时间远低于zip, 对于9.6G的实验文件，使用zip命令的时间是使用pigz的4.4倍。但压缩速度和文件大小的关系还需进一步研究。【结论】该文从电子气象档案数据打包的应用案例中，通过实验比较得出使用pigz工具能极大地缩短数据的压缩和打包时间，尤其对于大量的分钟级气象数据，能减少网络传输等待时间并提升存储空间的使用率。同时该文总结了在使用pigz工具和接入CTS系统中遇到的问题和解决方法，探讨压缩技术在气象数据中的应用，为电子气象档案归档与长期保存系统的相关技术人员提供参考。 |
| 关键词: 压缩；打包；pigz；电子气象档案 |
| DOI： |
| 投稿时间：2023-06-06修订日期：2024-03-21 |
| 基金项目: |
|
| Application of PIGZ Tool Software in the Archiving and Long-term Preservation System of Provincial Electronic meteorological archives |
| Li Jingyuan |
| (Yunan Meteorological Service) |
| Abstract: |
| Abstract: [Purpose] In order to complete the construction of provincial electronic archives and long-term preservation systems and ensure the timely transmission and storage of meteorological data, this article aims to solve the problem of too long time to compress and package large files and provide a method of using the compression tool pigz . [Method] Compared the characteristics of various compression and packaging tools, used different tools to compress and package the same file, conduct experiments to compare the processing time of zip and pigz, and analyzed common problems in the application of pigz based on actual development. [Results] The experiment proved that the compression and packaging time of pigz is much lower than that of zip. For the experimental file of 9.6G, the time of using the zip command is 4.4 times that of using pigz. However, the relationship between compression speed and file size requires further study. [Conclusion] From the application cases of electronic meteorological archive data packaging, this article concludes through experimental comparison that using the pigz tool can greatly shorten the data compression and packaging time, especially for a large amount of minute-level meteorological data, it can reduce the network transmission waiting time and improve storage space usage. At the same time, this article summarizes the problems and solutions encountered when using the pigz tool and accessing the CTS system, discusses the application of compression technology in meteorological data, and provides a reference for relevant technical personnel in electronic meteorological archive archiving and long-term preservation systems. |
| Key words: compression; pack; pigz; electronic weather archive |
