基于熵权法的过滤式特征选择算法

doi:10.12068/j.issn.1005-3026.2022.07.002

东北大学学报（自然科学版） ›› 2022, Vol. 43 ›› Issue (7): 921-929.DOI: 10.12068/j.issn.1005-3026.2022.07.002

基于熵权法的过滤式特征选择算法

李占山，杨云凯，张家晨

(吉林大学软件学院，吉林长春130012)

发布日期:2022-08-02
通讯作者: 李占山
作者简介:李占山(1966-)，男，吉林公主岭人，吉林大学教授，博士生导师；张家晨(1969-)，男，吉林德惠人，吉林大学教授.
基金资助:
吉林省自然科学基金资助项目(20180101043JC)；吉林省发展和改革委员会基金资助项目(2019C053-9).

Filtering Feature Selection Algorithm Based on Entropy Weight Method

LI Zhan-shan， YANG Yun-kai，ZHANG Jia-chen

College of Software， Jilin University， Changchun 130012，China.

Published:2022-08-02
Contact: ZHANG Jia-chen
About author:-
Supported by:
-

摘要/Abstract

摘要： 互信息过滤式特征选择算法往往仅局限于互信息这一度量标准.为规避采取单一的互信息标准的局限性，在互信息的基础上引入基于距离度量的算法RReliefF，从而得出更好的过滤式准则.将RReliefF用于分类任务，度量特征与标签的相关性；应用最大互信息系数(maximal information coefficient，MIC)度量特征与特征之间的冗余性、特征与标签的相关性；最后，应用熵权法为MIC和RReliefF进行客观赋权，提出了基于熵权法的过滤式特征选择算法(filtering feature selection algorithm based on entropy weight method， FFSBEWM).在13个数据集上进行对比实验，结果表明，FFSBEWM所选择的特征子集的平均分类准确率和最高分类准确率均优于其他对比算法.

关键词: 特征选择；熵权法；互信息；过滤式准则；信息理论

Abstract: Mutual information-based filtering feature selection algorithms are often limited to the metric of mutual information. In order to circumvent the limitations of adopting only mutual information， a distance metric-based algorithm RReliefF is introduced on the basis of mutual information to obtain better filtering criteria. RReliefF is used for the classification tasks to measure the relevance between features and labels. In addition， maximal information coefficient(MIC) is used to measure the redundancy between features and the relevance between features and labels. Finally， entropy weight method is applied to objectively weigh the MIC and RReliefF. On this basis， a filtering feature selection algorithm based on entropy weight method(FFSBEWM) is proposed. Comparing experiments carried out on 13 data sets show that the average classification accuracy and highest classification accuracy of the feature subsets selected by the proposed algorithm are higher than those of the comparison algorithms.

Key words: feature selection; entropy weight method; mutual information; filtering criteria; information theory

中图分类号:

TP391.4

李占山，杨云凯，张家晨. 基于熵权法的过滤式特征选择算法[J]. 东北大学学报（自然科学版）, 2022, 43(7): 921-929.

LI Zhan-shan， YANG Yun-kai，ZHANG Jia-chen. Filtering Feature Selection Algorithm Based on Entropy Weight Method[J]. Journal of Northeastern University(Natural Science), 2022, 43(7): 921-929.

参考文献

[1]Zhou H F，Zhang Y，Zhang Y J，et al.Feature selection based on conditional mutual information:minimum conditional relevance and minimum conditional redundancy［J］.Applied Intelligence，2019，49(3) :883-896.
[2]Senawi A，Wei H L，Billings S A.A new maximum relevance-minimum multicollinearity(MRmMC) method for feature selection and ranking［J］.Pattern Recognition，2017，67:47-61.
[3]Wu B，Zhou M Z，Shen X P，et al.Simple profile rectifications go a long way［C］//European Conference on Object-Oriented Programming.Berlin: Springer，2013:654-678.
[4]Qiu C Y.A novel multi-swarm particle swarm optimization for feature selection［J］.Genetic Programming and Evolvable Machines，2019，20(4):503-529.
[5]Djellali H，Ghoualmi N.Improved chaotic initialization of particle swarm applied to feature selection［C］//2019 International Conference on Networking and Advanced Systems(ICNAS).Matsue:IEEE，2019:1-5.
[6]Baranauskas J A，Netto O P，Nozawa S R，et al.A tree-based algorithm for attribute selection［J］.Applied Intelligence，2018，48(4):821-833.
[7]Apolloni J，Leguizamón G，Alba E.Two hybrid wrapper-filter feature selection algorithms applied to high-dimensional microarray experiments［J］.Applied Soft Computing，2016，38:922-932.
[8]Robnik-ikonja M，Kononenko I.An adaptation of Relief for attribute estimation in regression［EB/OL］.(1997-07-08)［2021-08-10］.http://www.clopinet.com/isabelle/Projects/reading/robnik97-icml.pdf.
[9]Das A，Das S.Feature weighting and selection with a Pareto-optimal trade-off between relevancy and redundancy［J］.Pattern Recognition Letters，2017，88:12-19.
[10]Kwak N，Choi C H.Input feature selection for classification problems［J］.IEEE Transactions on Neural Networks，2002，13(1):143-159.
[11]Peng H C，Long F H，Ding C.Feature selection based on mutual information criteria of max-dependency，max-relevance，and min-redundancy［J］.IEEE Transactions on Pattern Analysis and Machine Intelligence，2005，27(8):1226-1238.
[12]Estévez P A，Tesmer M，Perez C A，et al.Normalized mutual information feature selection［J］.IEEE Transactions on Neural Networks，2009，20(2):189-201.
[13]Li Y，Ma X F，Yang M X，et al.Improved feature selection based on normalized mutual information［C］//2015 14th International Symposium on Distributed Computing and Applications for Business Engineering and Science(DCABES).Guiyang:IEEE，2015:518-522.
[14]Zhang P B，Wang X，Li X P，et al.EEG feature selection based on weighted-normalized mutual information for mental fatigue classification［C］//2016 IEEE International Instrumentation and Measurement Technology Conference Proceedings.Taipei:IEEE，2016:1-6.
[15]Gao W F，Hu L，Zhang P，et al.Feature selection considering the composition of feature relevancy［J］.Pattern Recognition Letters，2018，112:70-74.
[16]Zhou H F，Wang X Q，Zhang Y.Feature selection based on weighted conditional mutual information［J/OL］.Applied Computing and Informatics，2020［2021-08-10］.https://www.emerald.com/insight/content/doi/10.1016/j.aci.2019.12.003/full/pdf?title=feature-selection-based-on-weighted-conditional-mutual-information.
[17]Reshef D N，Reshef Y A，Finucane H K，et al.Detecting novel associations in large data sets［J］.Science，2011，334(6062):1518-1524.
[18]Zhu Y X，Tian D Z，Yan F.Effectiveness of entropy weight method in decision-making［J/OL］.Mathematical Problems in Engineering，2020［2021-08-10］.https://downloads.hindawi.com/journals/mpe/2020/3564835.pdf.

基于熵权法的过滤式特征选择算法

Filtering Feature Selection Algorithm Based on Entropy Weight Method

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	丁其川，王力，刘成. 融合长距离信道注意力与病理特征的肺结节分类[J]. 东北大学学报（自然科学版）, 2023, 44(4): 476-485.
[2]	杨丹，刘国如，任梦成，裴宏杨. 多尺度卷积核U-Net模型的视网膜血管分割方法[J]. 东北大学学报（自然科学版）, 2021, 42(1): 7-14.
[3]	原培新，陈鼎夫. 双能X射线高动态范围安检图像压缩算法[J]. 东北大学学报（自然科学版）, 2021, 42(1): 96-101.
[4]	张田，田勇，王子，王昭东. 基于清晰度评价的自适应阈值图像分割法[J]. 东北大学学报:自然科学版, 2020, 41(9): 1231-1238.
[5]	徐久强，张金鹏，贾玉其，邵建新. 基于集成学习的束支传导阻滞识别方法[J]. 东北大学学报:自然科学版, 2020, 41(3): 321-326.
[6]	徐礼胜，宋代远，刘文彦，王瑜璠. 用不同外周动脉波形重建主动脉波形的对比研究[J]. 东北大学学报:自然科学版, 2020, 41(2): 188-192.
[7]	冯宝，李昌林，李智，刘壮盛. 基于活动轮廓模型和影像组学的乳腺癌LVI状态预测[J]. 东北大学学报:自然科学版, 2020, 41(2): 193-199.
[8]	石春鹤，吴成东. 基于加权稀疏非负矩阵分解的车脸识别算法[J]. 东北大学学报:自然科学版, 2019, 40(10): 1376-1381.
[9]	张云洲，郑瑞，暴吉宁，朱尚栋. 基于多个相关滤波器的行人跟踪尺度算法[J]. 东北大学学报:自然科学版, 2019, 40(9): 1228-1234.
[10]	陈红，于晓升，吴成东，孙鹏. 参数化水平集活动轮廓模型的快速图像分割算法[J]. 东北大学学报:自然科学版, 2019, 40(1): 6-10.
[11]	张良钰，边天元，徐礼胜. 冠脉狭窄对外周与中心动脉间传递函数的影响[J]. 东北大学学报:自然科学版, 2018, 39(12): 1702-1707.
[12]	赵海，李雄峰，朱宏博，王彬. 基于分形维数特征的肺结节形状建模[J]. 东北大学学报:自然科学版, 2018, 39(11): 1545-1551.
[13]	窦圣昶，赵海，朱宏博，王彬. 修正与融合的肺部分割算法[J]. 东北大学学报:自然科学版, 2018, 39(11): 1562-1566.
[14]	徐礼胜，张书琪，牛潇，徐阳. 基于全卷积网络的左心室射血分数自动检测[J]. 东北大学学报:自然科学版, 2018, 39(11): 1572-1576.
[15]	齐林，吕旭阳，杨本强，徐礼胜. 基于全卷积网络迁移学习的左心室内膜分割[J]. 东北大学学报:自然科学版, 2018, 39(11): 1577-1582.