改进的K-近邻算法及其在学习预警中的应用

  • 宗晓萍 ,
  • 陶泽泽
展开
宗晓萍(1964—),女,河北蔚县人,河北大学教授,博士,主要从事模式识别、机器人视觉伺服控制方向研究. E-mail:769085906@qq.com

收稿日期: 2019-05-07

  网络出版日期: 2020-03-25

基金资助

河北省高等教育教学改革研究与实践项目(2016GJJG016)

Improved K-nearest neighbor algorithm and its application in learning and warning

  • ZONG Xiaoping ,
  • TAO Zeze
Expand
  • College of Electronic Information Engineering, Hebei University, Baoding 071002, China

Received date: 2019-05-07

  Online published: 2020-03-25

摘要

随着大数据在教育中的作用日益凸显,大量的数据被应用到教学研究、教学评估和行为预测.学生的成绩、行为记录、与老师的互动记录等教育数据,都已经开始发挥价值.为了解决课程的低通过率问题,将改进的K-近邻算法应用到学习预警中,首先利用网格搜索和交叉验证相结合的方法对模型参数进行优选,其次在构建决策树过程中,利用基尼增益确定特征的权重系数并且根据权重系数进行特征选择,在计算距离时引入权重系数,使每个特征收到权重系数的约束.实验表明,在一个公开的数据集和一个真实的数据集上,改进后的K-近邻算法显著优于传统的K-NN.

本文引用格式

宗晓萍 , 陶泽泽 . 改进的K-近邻算法及其在学习预警中的应用[J]. 河北大学学报(自然科学版), 2020 , 40(2) : 193 -199 . DOI: 10.3969/j.issn.1000-1565.2020.02.012

Abstract

With the increasing role of big data in education,a large amount of data is applied to teaching research,teaching evaluation and behavior prediction.Education data,such as students grades,behavioral records,and interaction with teachers,have begun to show their value.In order to solve the problem of low pass rate in the course,improved K-nearest neighbor algorithm is applied to study the early warning.The grid search and cross validation method of combining the parameter optimization of the model was used first.Second in the process of constructing a decision tree,the Gini gain is used to determine the characteristics of the weight coefficient and according to the weight coefficient of feature selection,weight coefficient was introduced when calculating the distance,enables each feature received weight coefficient constraint.Experiments show that the improved K-nearest neighbor algorithm is significantly better than the traditional K-NN algorithm in both a public data set and a real data set.

参考文献

[1] PEÑA-AYALA A.Educational data mining: A survey and a data mining-based analysis of recent works[J].Expert Systems With Applications,2014,41(4): 1432-1462.DOI:10.1016/j.eswa.2013.08.042.
[2] BAKER R S.Educational data mining: an advance for intelligent systems in education[J].IEEE Intelligent Systems,2014,29(3): 78-82.DOI:10.1109/mis.2014.42.
[3] FOK W W T,HE Y S,YEUNG H H A,et al.Prediction model for students future development by deep learning and tensorflow artificial intelligence engine[C] //2018 4th International Conference on Information Management(ICIM),Oxford, IEEE,2018.DOI:10.1109/infoman.2018.8392818.
[4] 何楚,宋健,卓桐.基于频繁模式谱聚类的课程关联分类模型和学生成绩预测算法研究[J].计算机应用研究,2015,32(10):2930-2933.DOI:10.3969/j.issn.1001-3695.2015.10.011.
[5] 黄建明.贝叶斯网络在学生成绩预测中的应用[J].计算机科学,2012,39(s3):280-282.DOI:10.3969/j.issn.1002-137X.2012.z3.075.
[6] SCHULTZ D,DUFFIELD S,RASMUSSEN S C,et al.Effects of the flipped classroom model on student performance for advanced placement high school chemistry students[J].Journal of Chemical Education,2014,91(9): 1334-1339.DOI:10.1021/ed400868x.
[7] 代明竹,高嵩峰.基于考试过程和知识结构的数据挖掘算法研究[J].计算机科学,2018,45(s1):450-454.DOI:CNKI:SUN:JSJA.0.2018-S1-096.
[8] HOWARD E,MEEHAN M,PARNELL A.Contrasting prediction methods for early warning systems at undergraduate level[J].The Internet and Higher Education,2018,37: 66-75.DOI:10.1016/j.iheduc.2018.02.001.
[9] MAYILVAGANAN M,KALPANADEVI D.Comparison of classification techniques for predicting the performance of students academic environment[C] //2014 International Conference on Communication and Network Technologies,Sivakasi,India,2014,IEEE,2014.DOI:10.1109/cnt.2014.7062736.
[10] LIN Y,WANG J.Research on text classification based on SVM-KNN[C] //Software Engineering and Service Science(ICSESS),2014 5th IEEE International Conference on,IEEE,2014: 842-844.DOI:10.1109/ICSESS.2014.6933697.
[11] 纪昌明,周婷,向腾飞,等.基于网格搜索和交叉验证的支持向量机在梯级水电系统隐随机调度中的应用[J].电力自动化设备,2014,34(3):125-131.DOI:10.3969/j.issn.1006-6047.2014.03.021.
[12] CARDONE G,GRÜNEWALD K,STEVEN A C.A resolution criterion for electron tomography based on cross-validation[J].Journal of Structural Biology,2005,151(2): 117-129.DOI:10.1016/j.jsb.2005.04.006.
[13] 何宇健.Python与机器学习实战[M].北京: 电子工业出版社,2017.
[14] 周志华.机器学习[M].北京: 清华大学出版社,2016.
[15] JAIN V,PHOPHALIA A,BHATT J S.Investigation of a joint splitting criteria for decision tree classifier use of information gain and gini index[Z].TENCON 2018 - 2018 IEEE Region 10 Conference,Jeju,Korea,2018.DOI:10.1109/tencon.2018.8650485.
[16] 郇宁,谢俏,叶红霞,等.基于改进KNN算法的城轨进站客流实时预测[J].交通运输系统工程与信息,2018,18(5):121-128.DOI:CNKI:SUN:YSXT.0.2018-05-018.
[17] LAI C,WANG Q,LEI J.What factors predict undergraduate students use of technology for learning?A case from Hong Kong[J].Computers & Education,2012,59(2): 569-579.DOI:10.1016/j.compedu.2012.03.006.
文章导航

/

〈 〉