东北大学学报(自然科学版) ›› 2022, Vol. 43 ›› Issue (3): 335-343.DOI: 10.12068/j.issn.1005-3026.2022.03.005

• 信息与控制 • 上一篇    下一篇

基于双目立体视觉的列车目标识别和测距技术

原培新, 蔡炟, 曹文伟, 陈超   

  1. (东北大学 机械工程与自动化学院, 辽宁 沈阳110819)
  • 修回日期:2021-03-08 接受日期:2021-03-08 发布日期:2022-05-18
  • 通讯作者: 原培新
  • 作者简介:原培新(1953-),男,辽宁营口人,东北大学教授.
  • 基金资助:
    国家重大科技攻关项目(JB2016GD034).

Train Target Recognition and Ranging Technology Based on Binocular Stereoscopic Vision

YUAN Pei-xin, CAI Da, CAO Wen-wei, CHEN Chao   

  1. School of Mechanical Engineering & Automation, Northeastern University, Shenyang 110819, China.
  • Revised:2021-03-08 Accepted:2021-03-08 Published:2022-05-18
  • Contact: CAI Da
  • About author:-
  • Supported by:
    -

摘要: 随着近几年铁路运输量的大幅度提升,铁路运输自动化被提上了日程,现如今火车的调车与编组的效率都有了大幅度提高,但是,火车的摘钩分解操作依旧是需要人工完成.针对摘钩作业时间短,需要在机器人和车厢同步时准确识别目标把手和测距的问题,提出使用双目立体视觉技术配合机械臂自动摘取车钩的方法并对视觉部分进行深入研究:通过图像预处理和模板匹配技术识别目标把手,在利用特征检测和匹配算法恢复双目摄像机间的位姿信息,并对双目摄像机的位姿信息进行校正.为了克服立体匹配时光照不均的影响,提出了基于局部融合的立体匹配算法获取视差图,最后使用三角测量计算列车分解区域中目标把手的深度信息,实现三维重建.此方法可以在识别把手位置后,测量把手距双目视觉系统的物理距离,为机器人自动摘钩提供数据基础.

关键词: 自动摘钩机器人;双目立体视觉;图像预处理;立体匹配;双目测距

Abstract: With the substantial increase of railway transportation volume in recent years, railway transportation automation has been scheduled. Nowadays, the efficiency of train shunting and marshalling has been greatly improved. However, the unhooking and decomposition operation of trains still need to be completed manually. In view of short time unhooking operation and the need to accurately identify the target handle and ranging when the robot is synchronized with the carriage, a method of automatic unhooking using binocular stereoscopic vision technology combined with the manipulator is proposed, and the vision part is deeply studied: identifying the target handle through image preprocessing and template matching technology, recovering the pose information between binocular cameras by feature detection and matching algorithm, and correcting the pose information of binocular cameras. In order to overcome the influence of uneven illumination in stereoscopic matching, a stereoscopic matching algorithm based on local fusion is proposed to obtain the disparity map. Finally, triangulation is used to calculate the depth information of the target handle in the train decomposition area to realize three-dimensional reconstruction. This method can measure the physical distance between the handles and the binocular vision system after identifying the position of the handles, so as to provide data basis for the automatic unhooking of the robot.

Key words: automatic unhooking robot; binocular stereoscopic vision; image preprocessing; stereoscopic matching; binocular ranging

中图分类号: