张安民,侯泽北,李兆兴,张殿君

• 1:天津大学海洋科学与技术学院
• 2:天津市港口环境监测工程技术中心
• 3:北京遥感信息研究所

摘要(Abstract)：

针对现有海事时空数据处理模式中负载均衡算法的不足,该文提出一种基于时空频繁模式挖掘的负载均衡算法(STFPM)。该算法能够充分发挥各节点性能,避免在数据处理过程中由于负载重复迁移对资源的消耗,可提高负载迁移效率,改善数据处理性能。实验结果表明:该算法能够获得较其他3种主流方法更好的负载均衡效果,可进一步提升船舶自动识别系统(AIS)等数据的处理效率,为e-航海时空大数据的处理提供支撑。

关键词(KeyWords)： e-航海;海事数据中心;时空数据;负载均衡;AIS

Abstract:

Keywords:

基金项目(Foundation): 国家重点研发计划项目(2018YFC1407400)

作者(Author): 张安民,侯泽北,李兆兴,张殿君

DOI: 10.16251/j.cnki.1009-2307.2020.10.007

参考文献(References)：

• [1] 左雯.大数据背景下山东海事信息化建设研究[D].大连:大连海事大学,2015.(ZUO Wen.Study on the information construction of Shandong maritime safety service in the context of big data[D].Dalian:Dalian Maritime University,2015.)
• [2] 张安民,杜佳芸,王蕊,等.e-航海架构的高精度动态水深服务实现[J].测绘科学,2018,43(7):149-155.(ZHANG Anmin,DU Jiayun,WANG Rui,et al.High resolution dynamic depth service realization of e-Navigation architecture[J].Science of Surveying and Mapping,2018,43(7):149-155.)
• [3] WEINTRIT A.E-Navigation revolution-maritime cloud concept[C]//International Conference on Transport Systems Telematics.Berlin:Springer,2014.
• [4] 夏启兵,王玉林,于树海.天津港复式航道e-航海试点工程实践[J].航海,2019(2):55-58.(XIA Qibing,WANG Yulin,YU Shuhai.Tianjin port complex channel e-Navigation pilot project practice[J].Navigation,2019(2):55-58.)
• [5] 伊富春,邵进兴,任律珍,等.我国E航海工程建设经验总结与建议[J].世界海运,2019,42(3):33-38.(YI Fuchun,SHAO Jinxing,REN Lyuzhen,et al.Summary and suggestions on China’s e-Navigation engineering construction experience[J].World Shipping,2019,42(3):33-38.)
• [6] 杭德平,杨祥.专用固态数字雷达与AIS基站组合系统在洋山E航海示范工程中的应用[J].水运管理,2019,41(4):24-26.(HANG Deping,YANG Xiang.Integrated system application of special solid state digital radar and AIS base station in e-Navigation demonstration project of Yangshan port area[J].Shipping Management,2019,41(4):24-26.)
• [7] 尚斯年.基于云计算分布式技术的海量AIS数据挖掘系统设计与实现[D].大连:大连海事大学,2017.(SHANG Sinian.Design and implementation of massive AIS message data mining system based on cloud computing and distributed technology[D].Dalian:Dalian Maritime University,2017.)
• [8] 焦增连.胶州湾水质预报系统负载均衡策略研究[D].邯郸:河北工程大学,2018.(JIAO Zenglian.Study on load balancing strategy of water quality forecast system in Jiaozhou Bay[D].Handan:Hebei University of Engineering,2018.)
• [9] 李兆兴.面向批量处理的大数据中心检索关键技术研究[D].郑州:信息工程大学,2015.(LI Zhaoxing.Research on key technologies of retrieval for batch processing in big data center[D].Zhengzhou:Information Engineering University,2015.)
• [10] TAN J,KAVULYA S,GANDHI R,et al.Visual,log-based causal tracing for performance debugging of mapreduce systems[C]//IEEE International Conference on Distributed Computing Systems.Washington:IEEE Computer Society,2010.
• [11] 林伟伟,刘波.基于动态带宽分配的Hadoop数据负载均衡方法[J].华南理工大学学报(自然科学版),2012,40(9):42-47.(LIN Weiwei,LIU Bo.Hadoop data load balancing method based on dynamic bandwidth allocation[J].Journal of South China University of Technology(Natural Science Edition),2012,40(9):42-47.)
• [12] FEDAK G,HE H W,CAPPELLO F.BitDew:a data management and distribution service with multi-protocol file transfer and metadata abstraction[J].Journal of Network and Computer Applications,2009,32(5):961-975.
• [13] SHAFER J,RIXNER S,COX A L.The Hadoop distributed filesystem:balancing portability and performance[C]//IEEE International Symposium on Performance Analysis of Systems & Software.[S.l.]:IEEE,2010.
• [14]PIKE R,DORWARD S,GRIESEMER R,et al.Interpreting the data:parallel analysis with Sawzall[J].Scientific Programming,2005,13(4):277-298.
• [15]欧阳知雨，张安民，张永兵．基于AIS的船舶会遇局面紧迫度量化分析[J]．海洋通报，2019,38(2):225-232.(OUYANG Zhiyu,ZHANG Anmin,ZHANG Yongbing.Quantitative analysis of the degree of ship urgency based on AIS data[J].Marine Science Bulletin,2019,38(2):225-232.)
• [16]唐国磊，赵宇迪，于菁菁，等．基于AIS数据的集装箱船舶到港时间预测研究[J/OL]．重庆交通大学学报（自然科学版），2018[2019-06-05].http：∥kns.cnki.net/kcms/detail/50.1190.U.20181116.0958.008.html.(TANG Guolei,ZHAO Yudi,YU Jingjing,et al.Arrival time forecasting of container vessels based on AIS data[J/OL].Journal of Chongqing Jiaotong University(Natural Science),2018[2019-06-05].http：∥kns.cnki.net/kcms/detail/50.1190.U.20181116.0958.008.html.)
• [17]吕建．基于AIS数据库自动航线设计研究[D]．大连：大连海事大学，2017.(LYU Jian.Research on automatic route design based on AIS database[D].Dalian:Dalian Maritime University,2017.)
• [18]张永兵，张安民，杜佳芸．基于AIS和潮汐数据的航道水深利用状况研究：以天津港复式航道为例[J]．海洋通报，2018,37(2):209-218.(ZHANG Yongbing,ZHANG Anmin,DU Jiayun.Study on utilization status of channel water depth based on AIS and tide data:taking the compound channel of Tianjin port as an example[J].Marine Science Bulletin,2018,37(2):209-218.)
• [19]吴瑶瑶，杨庚．云环境下分布式文件系统负载均衡研究[J]．计算机工程与应用，2019,55(10):67-72.(WU Yaoyao,YANG Geng.Distributed file system load balancing in cloud environment[J].Computer Engineering and Applications,2019,55(10):67-72.)
• [20]周长俊，宗平．Hadoop备份数据存放策略的改进[J]．计算机技术与发展，2019,29(1):11-16.(ZHOU Changjun,ZONG Ping.Improvement of backup data placement policy of Hadoop[J].Computer Technology and Development,2019,29(1):11-16.)