Prophesee launches event-based vision sensor for consumer Edge-AI devices

2 mins read

Prophesee, a developer of advanced neuromorphic vision systems, is making available the GenX320 Event-based Metavision sensor, said to be the industry’s first event-based vision sensor developed specifically for integration into ultra-low-power Edge AI vision devices.

The fifth generation Metavision sensor, available in a 3x4mm die size, expands the reach of the company’s technology platform into a vast range of fast-growing intelligent Edge market segments, including AR/VR headsets, security and monitoring/detection systems, touchless displays, eye tracking features, and always-on smart IoT devices.

The 320x320 6.3μm pixel BSI stacked event-based vision sensor offers a 1/5” optical format and has been developed with a specific focus on the requirements of efficient integration of event sensing in energy-, compute- and size-constrained embedded at-the-edge vision systems.

The GenX320 enables robust, high-speed vision at ultra-low power and is suitable for a number of challenging operating and lighting conditions.

Among the GenX320 benefits are:

  • Low latency µsec resolution timestamping of events with flexible data formatting.
  • On-chip intelligent power management modes that reduce power consumption to as low as 36uW and enable smart wake-on-events. Deep sleep and standby modes are also featured.
  • Easy integrability/interfacing with standard SoCs with multiple integrated event data pre-processing, filtering, and formatting functions to minimise external processing overhead.
  • MIPI or CPI data output interfaces offer low-latency connectivity to embedded processing platforms, including low-power microcontrollers and modern neuromorphic processor architectures.
  • AI-ready: on-chip histogram output compatible with multiple AI accelerators;
  • Sensor-level privacy-enabled thanks to event sensor’s inherent sparse frameless event data with inherent static scene removal.
  • Native compatibility with Prophesee Metavision Intelligence, the most comprehensive, free, event-based vision software suite, used by a fast-growing community of 10,000+ users.

“The low-power Edge-AI market offers a diverse range of applications where the power efficiency and performance characteristics of event sensors are ideally suited. We have built on our foundation of commercial success in other application areas and developed this new event-based Metavision sensor to address the needs of Edge system developers with a sensor that is easy to integrate, configure and optimise for multiple compelling use cases in motion and object detection, presence awareness, gesture recognition, eye tracking, and other high growth areas,” said Luca Verre, CEO and co-founder of Prophesee.

Among specific use cases are high speed eye-tracking for foveated rendering for seamless interaction in AR/VR/XR headsets; low latency touch-free human machine interface in consumer devices; smart presence detection and people counting in IoT cameras and other devices and fall detection cameras in homes and health facilities.

The GenX320 is supported by a complete range of development tools, including a comprehensive Evaluation Kit housing a chip on board (COB) GenX320 module, or a compact optical flex module.

In addition, Prophesee is offering a range of adapter kits covering a range of embedded platforms, such as a STM32 MCU, enabling faster time-to-market.