基于MapReduce的海洋异构数据集成与实时查询展示研究

信息技术的发展，海洋领域的多元化信息系统建设步伐不断加快。大数据背景下，海洋数据多源异构的特性使得海洋数据无法实现共享和统一管理，从而导致产生数据孤岛的情况。结合MapReduce计算模型对该问题进行深入研究分析，本文提出基于中间件体系结构的海洋异构数据集成框架。该框架采用中介者模式进行数据查询，在查询中使用图结构的方式查找节点。通过实际项目实验验证，该框架能够提供一种有效的实时数据查询解决方案且在一定程度上减少数据孤岛现象的发生。

MapReduce-based ocean heterogeneous data integration and real-time query display

With the development of information technology, the pace of diversified information systems construction in the marine sector has continued to accelerate.In the context of big data, the heterogeneous nature of ocean data makes it uneasy for ocean data to be shared and managed in a unified way, which leads to the phenomenon of data silos.Combining the MapReduce calculation model, and deeply studying in this issue, this paper proposes a heterogeneous data integration framework based on middleware architecture.The framework adopts the mediator mode for querying data, and uses the graph structure to search for nodes in the query process.Through the practical project experimental verification, the framework can provide an effective real-time data query solution and to a certain extent reduce the occurrence of data islanding.