论文标题

dotie-通过使用尖峰结构的事件的时间隔离来检测对象

DOTIE - Detecting Objects through Temporal Isolation of Events using a Spiking Architecture

论文作者

Nagaraj, Manish, Liyanagedera, Chamika Mihiranga, Roy, Kaushik

论文摘要

基于视觉的自主导航系统依靠快速准确的对象检测算法来避免障碍。由于用于部署的硬件的能量有限,因此为此类系统设计的算法和传感器需要在计算上有效。具有生物学启发的事件摄像机是该系统的视觉传感器的良好候选者,因为它们的速度,能源效率和对不同照明条件的稳健性。但是,传统的计算机视觉算法无法处理基于事件的输出,因为它们缺乏光度特征,例如光强度和纹理。在这项工作中,我们提出了一种新型技术,该技术利用事件中固有的时间信息来有效地检测移动对象。我们的技术由一种轻巧的尖峰神经体系结构组成,能够根据相应对象的速度分离事件。然后将这些分离的事件在空间上进一步分组以确定对象边界。这种对象检测方法既是异步又具有鲁棒性的相机噪声。此外,它在场景中显示出良好的性能,其后台在后台产生的事件,其中现有基于事件的算法失败。我们表明,通过利用我们的体系结构,自主导航系统可以具有最小的延迟和能量开销来执行对象检测。

Vision-based autonomous navigation systems rely on fast and accurate object detection algorithms to avoid obstacles. Algorithms and sensors designed for such systems need to be computationally efficient, due to the limited energy of the hardware used for deployment. Biologically inspired event cameras are a good candidate as a vision sensor for such systems due to their speed, energy efficiency, and robustness to varying lighting conditions. However, traditional computer vision algorithms fail to work on event-based outputs, as they lack photometric features such as light intensity and texture. In this work, we propose a novel technique that utilizes the temporal information inherently present in the events to efficiently detect moving objects. Our technique consists of a lightweight spiking neural architecture that is able to separate events based on the speed of the corresponding objects. These separated events are then further grouped spatially to determine object boundaries. This method of object detection is both asynchronous and robust to camera noise. In addition, it shows good performance in scenarios with events generated by static objects in the background, where existing event-based algorithms fail. We show that by utilizing our architecture, autonomous navigation systems can have minimal latency and energy overheads for performing object detection.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源