First spiking Neural Network-based chip for radar signal processing

2 mins read

Imec, the research and innovation hub, has unveiled the world’s first chip that processes radar signals using a spiking recurrent neural network.

By mimicking the way groups of biological neurons operate to recognise temporal patterns, imec’s chip consumes 100 times less power than traditional implementations while featuring a tenfold reduction in latency – enabling almost instantaneous decision-making. For example, micro-Doppler radar signatures can be classified using only 30 mW of power.

While the chip’s architecture and algorithms can be tuned to process a variety of sensor data (including electrocardiogram, speech, sonar, radar and lidar streams), its first use-case will encompass the creation of a low-power, highly intelligent anti-collision radar system for drones that can react much more effectively to approaching objects.

Artificial neural networks (ANNs) have already proved to be useful across a wide range of application domains and are, for example, being used in radar-based anti-collision systems commonly used in the automotive industry. However, ANNs come with their share of limitations - they consume too much power to be integrated into increasingly constrained (sensor) devices. In addition, ANNs’ underlying
architecture and data formatting requires data to undertake a time-consuming journey from the sensor device to the AI inference algorithm before a decision can be made. Hence the decision to use spiking neural networks (SNNs).

“This is the world’s first chip that processes radar signals using a recurrent spiking neural network,” said Ilja Ocket, program manager of neuromorphic sensing at imec. “SNNs operate very similarly to
biological neural networks, in which neurons fire electrical pulses sparsely over time, and only when the sensory input changes. As such, energy consumption can significantly be reduced. What’s more, the spiking neurons on our chip can be connected recurrently – turning the SNN into a dynamic system that learns and remembers temporal patterns. The technology is a major leap forward in the development of truly self-learning systems.”

The chip was initially designed to support electrocardiogram (ECG) and speech processing in power-constrained devices. Due to its generic architecture that features a completely new digital hardware

design, it can also easily be reconfigured to process a variety of other sensory inputs like sonar, radar and lidar data.
Contrary to analogue SNN implementations, imec’s event-driven digital design makes the chip behave exactly and repeatedly as predicted by the neural network simulation tools.
imec have described one use case involving the drone industry, which even more than the automotive sector – works with constrained devices (e.g. limited battery capacity) that need to react quickly to changes in their environment in order to appropriately react to approaching obstacles.

“A flagship use-case for our new chip includes the creation of a low-latency, low-power anti-collision system for drones. Doing its processing close to the radar sensor, our chip should enable the radar sensing system to distinguish much more quickly – and accurately – between approaching objects. In turn, this will allow drones to nearly instantaneously react to potentially dangerous situations,” explained Ocket. “One scenario we are currently exploring features autonomous drones that depend on their on-board camera and radar sensor systems for in-warehouse navigation, keeping a safe distance from walls and shelves while performing complex tasks. This technology could be used in plenty of other use-cases as well – from robotics scenarios to the deployment of automatic guided vehicles (AGVs) and even health monitoring.”

“This chip meets the industry’s demand for extremely low-power neural networks that truly learn from data and enable personalised AI. For its creation, we rallied experts from various disciplines within imec – from the development of training algorithms and spiking neural network architectures that take neuroscience as a basis, to biomedical and radar signal processing and ultra-low power digital chip design. That is where imec really makes a difference,” Kathleen Philips, program director of
IoT cognitive sensing at imec, concluded.