期刊信息

  • 刊名: 河北师范大学学报(自然科学版)Journal of Hebei Normal University (Natural Science)
  • 主办: 河北师范大学
  • ISSN: 1000-5854
  • CN: 13-1061/N
  • 中国科技核心期刊
  • 中国期刊方阵入选期刊
  • 中国高校优秀科技期刊
  • 华北优秀期刊
  • 河北省优秀科技期刊

Hadoop性能优化研究

  • 河北师范大学数学与信息科学学院, 河北石家庄 050016
  • DOI:

Research on Performance Optimization of Hadoop

摘要/Abstract

摘要:

优化Hadoop的性能可大大提高Map Reduce的工作效率,缩短任务执行时间,增加分布式计算的吞吐量.Hadoop的执行性能受到多种配置属性的影响,不同配置属性间也存在相互制约关系.基于遗传算法,对配置方案不断选择、交叉、变异,多次迭代后产生近似最优配置方案.实验结果表明该配置方案能够有效提高系统性能,并且具有稳定性和适用性.

Abstract:

Optimizing the performance of Hadoop can greatly improve the efficiency of Map Reduce,reduce the execution time of tasks and increase the throughput of distributed computing.The implementation performance of Hadoop is impacted by a list of configuration properties which are interdependent.Based on genetic algorithm,the configuration schemes are updated by constantly selection,crossover,mutation,then approximate optimal configuration scheme is produced after several iterations.Experimental results show that this configuration scheme can effectively improve the overall performance of system and has stability and applicability.