BrainChip and NVISO partner on human behavioural analytics in AI devices

1 min read

BrainChip and nViso, a specialist in human behavioural analytics, have announced a collaboration targeting battery-powered applications in robotics and mobility/automotive to address the need for high levels of AI performance with ultra-low power technologies.

The initial effort will include implementing NVISO’s AI solutions for Social Robots and In-cabin Monitoring Systems on BrainChip’s Akida processors.

With developers of automotive and consumer technologies looking to develop devices that better respond to human behaviour, they require tools and applications that are capable of interpreting human behaviour that can be captured from cameras and sensors on devices.

These environments can be constrained, however, by limited compute performance, power consumption, and cloud connectivity lapses. Akida looks to address these weaknesses with high performance and ultra-low power (micro- to milliwatts) as well as by performing AI/ML processing of vision/image, motion, and sound data directly on devices, instead of in the cloud and since information is not sent off-device, user privacy and security are also protected.

NVISO’s technology analyses signals of human behaviour such as facial expressions, emotions, identity, head poses, gaze, gestures, activities, and objects with which users interact. In robotics and in-vehicle applications, human behaviour analytics detect the user’s emotional state to provide personalised, adaptive, interactive, safe devices and systems.

The result of the collaboration between NVISO and BrainChip is expected to enable more advanced, more capable, and more accurate AI on consumer products.

“Our work with BrainChip will support AI’s demanding power/cost/performance needs for OEMs, even at mass production and scale, so they can benefit from faster and more efficient development cycles,” said Tim Llewellynn, CEO of NVISO. “Ultra-low power edge-based consumer processing is expected to deliver a more intelligent and individualized user experience, and we believe running our AI solutions for Social Robots and In-cabin Monitoring Systems on Akida will provide a competitive edge for joint customers demanding always-on features on low power budgets.”

“NVISO’s human behavioural analytics AI systems offer fascinating possibilities in homes, cars, buildings, hospitals, and more, and we’re enthusiastic about supporting these functions with BrainChip’s processing performance and energy efficiency,” said Sean Hehir, BrainChip CEO. “This is not only a collaboration between two companies, it’s advancing the state of the art in AI with platforms for edge AI devices to interpret human behaviour, improving product performance and user experience.”

BrainChip’s neuromorphic processor, Akida, is able to mimic the human brain to analyse only essential sensor inputs at the point of acquisition, processing data with unparalleled efficiency, precision, and economy of energy. Keeping AI/ML local to the chip, independent of the cloud, also dramatically reduces latency while improving privacy and data security.