0 引 言
1 多模态避障与点云定位
1.1 总体流程
1.2 多模态局部避障算法
1.3 障碍检测算法
1.4 点云全局快速定位算法
2 仿真实验
2.1 多模态局部避障算法
2.2 点云全局快速定位算法
表 1 点云定位算法测试结果Table 1 Test results of the point-cloud localization algorithm |
|
(1988-), 男,讲师,主要研究方向:遥感,AIGC,计算机视觉等。通信地址:浙江省杭州市钱塘区学源街258号中国计量大学(310018)电子邮箱:sunlong@cjlu.edu.cn |
网络出版日期: 2024-11-25
基金资助
国家自然科学基金项目(52372423)
版权
Multimodal Perception and Obstacle Avoidance Method for Lunar South Pole Rover
Online published: 2024-11-25
Copyright
月球南极地区地形复杂,太阳高度角极低导致阴影区域变化大,为巡视器的自主导航提出了巨大的挑战。本工作提出一种面向月球南极的巡视器多模态感知与避障路径规划方案。一方面通过RGB相机获得全局的场景影像,进行初步的障碍物检测;另一方面利用深度相机获取实时的环境深度,通过简化的SLAM算法构建局部地图,即实时生成点云图;根据点云信息,计算路面粗糙度、坡度、阶跃信息等物理环境信息。利用上述多模态数据结合地图数据实时更新巡视器位姿和周围环境,结合使用多模态局部算法和障碍检测算法进行障碍物感知和避障决策,使巡视器能够动态调整路径。仿真结果表明该自主导航系统显著提高巡视器在复杂未知环境中的自主导航能力。
孙龙 , 曹子健 , 施克恒 , 杨力 . 月球南极巡视器多模态感知与避障方法[J]. 空间科学与试验学报, 2024 , 1(2) : 55 -60 . DOI: 10.19963/j.cnki.2097-4302.2024.02.006
The terrain of the lunar south pole is complex, and the extremely low solar altitude angle causes large changes in the shadow area, which poses a huge challenge to the autonomous navigation of the rover. This work proposes a multi-modal sensing and obstacle avoidance path planning scheme for the rover facing the lunar south pole. On the one hand, the RGB camera is used to obtain the global scene image for preliminary obstacle detection; on the other hand, the depth camera is used to obtain the real-time environment depth, and a local map is constructed through a simplified SLAM algorithm, that is, a point cloud map is generated in real time; and based on the point cloud information, to calculate physical environment information such as road surface roughness, slope, step information, etc. The above-mentioned multi-modal data combined with map data are used to update the posture and surrounding environment of the patrol vehicle in real time, and a combination of multi-modal local algorithms and obstacle detection algorithms are used for obstacle perception and obstacle avoidance decision-making, so that the patrol unit can dynamically adjust its path. The simulation results show that the autonomous navigation system significantly improves the autonomous navigation capability of the patrol unit in complex and unknown environments.
表 1 点云定位算法测试结果Table 1 Test results of the point-cloud localization algorithm |
| 1 |
ZHANG Z,WAN Y,WANG Y,et al. Improved hybrid A* path planning method for spherical mobile robot based on pendulum[J]. International Journal of Advanced Robotic Systems,2021,18(1):1729881421992958.
|
| 2 |
ERKE S,BIN D,YIMING N,et al. An improved A-Star based path planning algorithm for autonomous land vehicles[J]. International Journal of Advanced Robotic Systems,2020,17(5):1729881420962263.
|
| 3 |
HONG Z, SUN P, TONG X, et al. Improved A-Star algorithm for long-distance off-road path planning using terrain data map[J]. ISPRS International Journal of Geo-Information, 2021, 10 (11): 785.
|
| 4 |
WANG J, LI B, MENG M Q H. Kinematic Constrained Bi-directional RRT with Efficient Branch Pruning for robot path planning[J]. Expert Systems with Applications, 2021, 170, 114541.
|
| 5 |
宋海荦. 基于多模态深度强化学习的移动机器人避障方法研究[D]. 安徽:中国科学技术大学,2021.
|
| 6 |
桂林, 颉潭成, 徐彦伟, 等. 基于多模态信息融合的四足机器人避障研究[J]. 传感器与微系统, 2023, 42 (9): 65- 67+76.
|
| 7 |
ZHOU J,OLOFSSON B,FRISK E. Interaction-aware motion planning for autonomous vehicles with multi-modal obstacle uncertainty predictions[J]. IEEE Transactions on Intelligent Vehicles,2023,9(1):1305-1319.
|
| 8 |
YOUNES G ,ASMAR D ,SHAMMAS E. A survey on non-filter-based monocular Visual SLAM systems[J]. Robotics & Autonomous Systems,2016,(98):67-88.
|
| 9 |
CANNY J. A computational approach to edge detection[J]. IEEE Trans. Pattern Anal. Mach. Intell. 1986,8(6):679-698.
|
| 10 |
XIE S,TU Z. Holistically-nested edge detection[C]. Proceedings of the IEEE international conference on computer vision. 2015.
|
| 11 |
LIN T Y,DOLLÁR P,GIRSHICK R et al. Feature pyramid networks for object detection[C]. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; Honolulu,HI,USA. 2017.
|
| 12 |
VISWANATHAN D G. Features from accelerated segment test (fast)[C]. Proceedings of the 10th workshop on image analysis for multimedia interactive services,London,UK. 2009.
|
| 13 |
LOWE D G. Object recognition from local scale-invariant features[C]. Proceedings of the seventh IEEE international conference on computer vision. Ieee,1999.
|
| 14 |
BESL P J,MCKAY N D. Method for registration of 3-D shapes[C]. Sensor fusion IV:control paradigms and data structures. Spie,1992.
|
| 15 |
FISHLER M A. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography[J]. Communication of the ACM, 1981, 24 (6): 381- 395.
|
| 16 |
CHOY C,DONG W,KOLTUN V,Deep global registration[C]. Proc. Proceeding of the IEEE/CVF conference on Computer Vision and Pattern Recognition. 2020.
|
| 17 |
BESL P,MCKAY N D,A method for registration of 3-D shapes[J]. IEEE Trans. Pattern Anal. Mach. Intell. 1992,14(2):239-256.
|
| 18 |
SEGAL A,HAEHNEL D,THRUN S. Generalized-ICP[C]. washington. Robotics:science and systems,2009.
|
/
| 〈 |
|
〉 |