Improving Pedestrian Safety in Cities Using Intelligent Wearable Systems

With the prevalence of smartphones, pedestrians and joggers today often walk or run while listening to music. Since they are deprived of their auditory senses that would have provided important cues to dangers, they are at a much greater risk of being hit by cars or other vehicles. In this paper, we build a wearable system that uses multichannel audio sensors embedded in a headset to help detect and locate cars from their honks, engine, and tire noises, and warn pedestrians of imminent dangers of approaching cars. We demonstrate that using a segmented architecture consisting of headset-mounted audio sensors, a front-end hardware platform that performs signal processing and feature extraction, and machine learning-based classification on a smartphone, we are able to provide early danger detection in real time, from up to 60 m away, and alert the user with low latency and high accuracy. To further reduce power consumption of the battery-powered wearable headset, we implement a custom-designed integrated circuit that is able to compute delays between multiple channels of audio with nW power consumption. A regression-based method for sound source localization, angle via polygonal regression, is proposed and used in combination with the IC to improve the granularity and robustness of localization.