摘要: |
文章依托大数据云平台·天擎系统的共享NAS存储,通过省级气象通信系统的文件分发策略,将气象卫星广播数据迁移到共享NAS上进行统一存储。基于B/S系统构架搭建气象数据湖对大数据云平台·天擎系统的共享NAS存储上的数据进行统一管理。数据湖提供了前端图形界面对目录权限和账户权限统一管理,一方面规范了数据访问权限,保障了数据和账户的安全性。另一方面解决了因数据反复迁移、多处存储而造成的资源浪费,符合气象业务的发展需求。 |
关键词: 天擎;数据湖集群;CMACast;NAS存储;安全管理 |
DOI: |
投稿时间:2021-11-08修订日期:2022-02-18 |
基金项目:贵州省气象局科研登记制项目“基于数据湖实现CMACast共享资料统一管理的研究” |
|
The Application of Data Lake Technology in The Sharing of Meteorological Satellite Data Service |
Baitienan,tangweiyao,jinshisheng,tanhaibo |
(Guizhou Provincial Center of Meteorological Information Support;Guizhou Meteorological Information Center) |
Abstract: |
The article relies on the shared NAS storage of the big data cloud platform, Tianqing system, and through the file distribution strategy of the provincial meteorological communication system, the meteorological satellite broadcast data is migrated to the shared NAS for unified storage. Based on the B/S system architecture, a meteorological data lake is built to uniformly manage the data on the shared NAS storage of the big data cloud platform·Tianqing system. Data Lake provides a front-end graphical interface for unified management of directory permissions and account permissions. On the one hand, it regulates data access permissions and ensures the security of data and accounts. On the other hand, it solves the waste of resources caused by repeated data migration and multiple storage, which meets the development needs of meteorological services. |
Key words: TianQing;Data lake cluster;CMACast;NAS storage;Security management |