论文标题
利用从运动到本地化的无法访问的公交车站的结构
Leveraging Structure from Motion to Localize Inaccessible Bus Stops
论文作者
论文摘要
对于确保公共交通的安全性和可访问性是必要的。智能城市基础设施旨在通过使用计算机视觉来促进许多其他任务。但是,大多数最先进的计算机视觉模型都需要数千个图像才能执行准确的检测,并且由于通常很少有危险条件的图像。在本文中,我们检查了沿公交路线的雪覆盖人行道的检测。先前的工作集中在大雪中发现其他车辆或只是发现雪的存在。但是,我们的应用程序还有一个额外的并发症,即确定积雪是否覆盖了重要性区域,并可能导致跌倒或其他事故(例如,雪覆盖人行道)或仅覆盖某些背景区域(例如,在附近的田野上的雪)。这个问题涉及将不一定可见的重要性领域的位置定位。 我们介绍了一种利用运动(SFM)结构的方法,而不是其他注释数据来解决此问题。具体而言,我们的方法通过在晴朗的天气中将分割模型和SFM应用于总线摄像机的图像,从而在给定场景中学习人行道的位置。然后,我们使用博学的位置来检测人行道是否以及在何处被雪遮盖。在跨各种阈值参数进行评估之后,我们确定了一个最佳范围,在该范围内,我们的方法始终正确地对人行道图像的不同类别进行分类。尽管我们证明了沿公交路线覆盖雪的应用,但此方法也可以扩展到其他危险条件。该项目的代码可从https://github.com/ind1010/sfm_for_busedge获得。
The detection of hazardous conditions near public transit stations is necessary for ensuring the safety and accessibility of public transit. Smart city infrastructures aim to facilitate this task among many others through the use of computer vision. However, most state-of-the-art computer vision models require thousands of images in order to perform accurate detection, and there exist few images of hazardous conditions as they are generally rare. In this paper, we examine the detection of snow-covered sidewalks along bus routes. Previous work has focused on detecting other vehicles in heavy snowfall or simply detecting the presence of snow. However, our application has an added complication of determining if the snow covers areas of importance and can cause falls or other accidents (e.g. snow covering a sidewalk) or simply covers some background area (e.g. snow on a neighboring field). This problem involves localizing the positions of the areas of importance when they are not necessarily visible. We introduce a method that utilizes Structure from Motion (SfM) rather than additional annotated data to address this issue. Specifically, our method learns the locations of sidewalks in a given scene by applying a segmentation model and SfM to images from bus cameras during clear weather. Then, we use the learned locations to detect if and where the sidewalks become obscured with snow. After evaluating across various threshold parameters, we identify an optimal range at which our method consistently classifies different categories of sidewalk images correctly. Although we demonstrate an application for snow coverage along bus routes, this method can extend to other hazardous conditions as well. Code for this project is available at https://github.com/ind1010/SfM_for_BusEdge.