东北大学学报:自然科学版 ›› 2015, Vol. 36 ›› Issue (6): 769-772.DOI: 10.12068/j.issn.1005-3026.2015.06.003

• 信息与控制 • 上一篇    下一篇

分布式环境中基于核函数的极限学习机

赵相国, 毕鑫, 张祯, 杨洪波   

  1. (东北大学 信息科学与工程学院, 辽宁 沈阳110819)
  • 收稿日期:2014-04-16 修回日期:2014-04-16 出版日期:2015-06-15 发布日期:2015-06-11
  • 通讯作者: 赵相国
  • 作者简介:赵相国(1973-),男,吉林通化人,东北大学副教授.
  • 基金资助:
    国家自然科学基金资助项目(61272181,61202087); 武汉大学开放基金资助项目(SKLSE2012-09-40) .

Kernelized Extreme Learning Machine in Distributed Environment

ZHAO Xiang-guo, BI Xin, ZHANG Zhen, YANG Hong-bo   

  1. School of Information Science & Engineering, Northeastern University, Shenyang 110819, China.
  • Received:2014-04-16 Revised:2014-04-16 Online:2015-06-15 Published:2015-06-11
  • Contact: ZHAO Xiang-guo
  • About author:-
  • Supported by:
    -

摘要: 针对海量数据规模下的集中式核函数极限学习机的性能问题,将基于核函数的极限学习机扩展到云计算技术框架下,提出了基于MapReduce的分布式核函数极限学习机MR-KELM.该算法将分布式径向基核函数计算出的核函数矩阵进行分布式矩阵分解,并通过分布式矩阵向量乘法得到分类器输出权重,减小了网络通讯和数据交换代价.实验结果表明,MR-KELM算法能够在不影响基于核函数的极限学习机的计算理论的前提下,具有较好的可扩展性和分类训练性能.

关键词: 极限学习机, 核函数, 分类, 分布式, MapReduce

Abstract: With the exponentially increasing volume of training data, the performance of centralized ELM with kernels suffers due to large matrix operations. A distributed algorithm named MapReduce based kernelized ELM (MR-KELM) was proposed, which realized an implementation of ELM with kernels on MapReduce in the cloud. The kernel matrix generated by distributed radial basis function was decomposed and then the output weights by distributed multiplication of matrix and vector were calculated by the proposed algorithm. Communications and data exchanges in distributed matrix operations were reduced and good scalability was achieved by MR-KELM. Extensive experiments on synthetic datasets were conducted to verify the training performance and scalability of MR-KELM. Experimental results showed that MR-KELM was effective and efficient for massive learning applications.

Key words: ELM(extreme learning machine), ELM with kernels, classification, distributed, MapReduce

中图分类号: