国产97成人亚洲综合在线观看,天堂中文最新版在线中文 http://m.rfnf.cn/en/ METAVISION FOR MACHINES Wed, 23 Oct 2024 03:28:46 +0000 en-US hourly 1 https://wordpress.org/?v=6.8.1 http://m.rfnf.cn/wp-content/uploads/2023/01/cropped-Icon_NoMargin-32x32.png PROPHESEE http://m.rfnf.cn/en/ 32 32 Prophesee Introduces Metavision SDK5 Pro http://m.rfnf.cn/en/2024/10/07/prophesee-introduces-metavision-sdk5-pro/ Mon, 07 Oct 2024 03:19:26 +0000 http://m.rfnf.cn/?p=83802

Prophesee Introduces Metavision SDK5 PRO

Now included with USB EVK purchases

PARIS – October 7, 2024Since its launch in 2020, Metavision SDK has been an incredible success, establishing itself as the most comprehensive event-based software suite on the market. With 64 algorithms, 105 code samples, and 17 tutorials, it’s become the go-to toolkit for over 15,000 users worldwide and has earned 5 prestigious international awards.

Building on this momentum, we are excited to take the next step in empowering the community to achieve their vision with even greater ease.

Starting today, Metavision SDK5 PRO:

  • Is included at no additional cost in both binaries and source form with every Prophesee USB EVK purchase.
  • Is available for standalone purchase and more accessible than ever, allowing even more developers to turn their ideas into reality.

Join a rapidly growing global community and unlock your next breakthrough with Metavision SDK Pro: http://m.rfnf.cn/en/metavision-sdk-pro/

Contents:

NEW in Metavision SDK5.0 Pro:

  • Demo stereo matching
  • Stereo / N-Camera calibration app
  • Active markers demo optimized for embedded platforms
  • New simplified classes to iterate over events from synchronized cameras in Python and C++
  • New machine learning C++ inference pipeline, enabling easy integration with LibTorch and ONNX Runtime and with examples for object detection, gesture classification and optical flow
  • New fully integrated RAW EVT2 encoder
  • Support of Ubuntu 24

Existing SDKPro features:

  • License allowing commercial use
  • Access to all advanced add-ons source code
  • Access to online documentation, including a Knowledge Center filled with application notes, technical briefs, user guides, and other valuable resources
  • Access to advanced add-ons: High-Speed Counting, Spatter Monitoring, Vibration Monitoring, Object Tracking, Optical Flow, Ultra-Slow Motion, Visualization tools, Machine Learning, Active Markers, Object 3D Pose Tracking, 3D Estimation
  • Access to advanced tools: Metavision Studio, Event Simulator, format converters, file manipulators
  • 2H Premium support
  • Will include future updates

ABOUT PROPHESEE

Prophesee is the inventor of the world’s most advanced neuromorphic vision systems.

The company developed a breakthrough Event-based Vision approach to machine vision. This new vision category allows for significant reductions of power, latency and data processing requirements to reveal what was invisible to traditional frame-based sensors until now. Prophesee’s patented Metavision? sensors and algorithms mimic how the human eye and brain work to dramatically improve efficiency in areas such as autonomous vehicles, industrial automation, IoT, mobile and AR/VR. Prophesee is based in Paris, with local offices in Grenoble, Shanghai, Tokyo and Silicon Valley.

The company is driven by a team of more than 100 visionary engineers, holds more than 50 international patents and is backed by leading international equity and corporate investors including 360 Capital Partners, European Investment Bank, iBionext, Intel Capital, Omnivision, Prosperity7 Ventures, Renault Group, Robert Bosch Venture Capital, Sinovation, Sony, Supernova Invest, Xiaomi.

Learn More: http://m.rfnf.cn/en

]]>
Ultraleap, Prophesee and TCL RayNeo Partner to Develop Innovative Technology for AR Glasses http://m.rfnf.cn/en/2024/06/13/ultraleap-prophesee-tcl-rayneo-ar-glasses/ Thu, 13 Jun 2024 00:09:48 +0000 http://m.rfnf.cn/?p=83073

Ultraleap, Prophesee and TCL RayNeo Partner to Develop Innovative Technology for AR Glasses

PARIS, June 13, 2024 – Ultraleap has announced a strategic partnership with Prophesee SA, inventor of the world’s most advanced neuromorphic vision systems, and TCL RayNeo to develop low power tracking technology that can be used in AR glasses, pushing the boundaries of augmented reality (AR) experiences. This collaboration brings together Ultraleap’s advanced hand tracking technology, Prophesee’s event-based vision sensing technology and TCL RayNeo’s AR expertise in comprehensive AR hardware and software development, to create AR glasses that offer leading-edge interactivity and immersion.

Leveraging Ultraleap’s cutting-edge computer vision and machine learning models along with Prophesee’s breakthrough event-based Metavision? sensors and TCL RayNeo’s state-of-the-art glasses technology that feature unparalleled image quality and AI+AR features in an ergonomic form factor, the work from this collaboration aims at addressing key challenges in the AR industry such as size, power and usability. Future AR glasses need to deliver a seamless and natural user experience, enabling precise hand tracking in high-quality products that address users concerns.

Ultraleap’s technology together with Prophesee’s event-based Metavision offers unrivalled low power consumption and speed, ensuring accurate tracking and natural interactions that replace buttons and capacitors. Instead of constantly touching the glasses to interact, drawing attention to the user, hand tracking provides a natural interaction with swipes and double taps in a similar way to what phones and smartwatches have already established. TCL RayNeo’s revolutionary tech features crystal-clear image quality, real-time multi language dialog translation, navigation and AI-powered smart-assistant features. The merge of these technologies and interactions allows the creation of outstanding AR product experiences.

Tom Carter, CEO and co-founder at Ultraleap, said:

“We’re excited to work with TCL RayNeo and Prophesee to bring a new level of interactivity to AR glasses. Our goal is to make AR glasses that are as intuitive and immersive as possible. By combining our hand tracking technology with TCL RayNeo’s AR expertise and Prophesee’s event sensors, we will be creating products that not only enhance user experience but also set a new standard for the industry.”

Howie Li, Founder and CEO at RayNeo, commented:

“This partnership with Ultraleap and Prophesee is an exciting step forward in the AR space. Ultraleap’s hand tracking technology complements our industry-leading glasses design, enabling us to develop AR glasses that are not only functional but also transformative. We believe this collaboration will drive the future of AR, offering users an unparalleled blend of the virtual and physical worlds.”

Luca Verre, CEO and co-founder at Prophesee, said:

“Our established relationship with Ultraleap in integrating Prophesee’s GenX320 event-based vision sensors with Ultraleap’s advanced computer vision and machine learning tracking models has demonstrated benefits for more intuitive, immersive and user-friendly XR devices. By combining this with TCL RayNeo’s expertise, we can together unlock significant performance and usability improvements to the current state of AR systems which will expand the market potential and capabilities of these applications.”

ABOUT ULTRALEAP

Ultraleap’s world-leading hand tracking and mid-air haptic technologies have been developed over 10 years using artificial intelligence, machine learning and computer vision to allow you to engage with the digital world naturally – without touching surfaces. No touchscreens. No controllers. No keypads. From enhancing 2D screens to developing fully immersive 3D experiences, Ultraleap powers natural, safe and effortless digital interaction in the increasingly connected world. Ultraleap employs more than 150 people across Europe, North America, and Asia. It offers the full vertical stack of software and hardware to enable spatial computing for the automotive, out of-home, industrial, XR, entertainment and medical sectors.

ABOUT TCL RAYNEO

RayNeoTM, incubated by TCL Electronics, is an industry leader in consumer-grade AR innovation, developing some of the world’s most revolutionary AR consumer hardware, software and applications. RayNeoTM specializes in the research and development of AR technologies with industry-leading optics, display, algorithm and device manufacturing.

ABOUT PROPHESEE

Prophesee is the inventor of the world’s most advanced neuromorphic vision systems having developed a breakthrough Event-based approach to computer vision. Prophesee’s patented Metavision? sensors and AI algorithms mimic how the human eye and brain work to dramatically improve speed and energy efficiency in areas such as autonomous vehicles, industrial automation, IoT, mobile and AR/VR.?

Learn more: m.rfnf.cn/en

]]>
Prophesee collaborates with AMD to deliver industry-first Event-based Vision solution running on leading, FPGA-based AMD Kria? KV260 Vision AI Starter Kit http://m.rfnf.cn/en/2024/05/30/event-based-metavision-amd-starter-kit-imx636/ Thu, 30 May 2024 02:43:42 +0000 http://m.rfnf.cn/?p=82883

Prophesee collaborates with AMD to deliver industry-first Event-based Vision solution running on leading, FPGA-based AMD Kria? KV260 Vision AI Starter Kit

Developers can now take full advantage of Prophesee Event-based Metavision? sensor and AI performance, power, and speed to create the next generation of Edge AI machine vision applications running on AMD platforms.

PARIS, May 6, 2024 – Prophesee SA, inventor of the world’s most advanced neuromorphic vision systems, today announced that its Event-based Metavision HD sensor and AI are now available for use with the AMD Kria ? KV260 Vision AI Starter Kit, creating a powerful and efficient combination to accelerate the development of advanced Edge machine vision applications. It marks the industry’s first Event-based Vision development kit compatible with an AMD platform, providing customers a platform to both evaluate and go to production with an industrial-grade solution for target applications such as smart city and machine vision, security cameras, retail analytics, and many others.

The development platform for the AMD Kria? K26 System-on-Module (SOM), the KV260 Vision AI starter kit is built for advanced vision application development without requiring complex hardware design knowledge or FPGA programming skills. AMD Kria SOMs for edge AI applications provide a production-ready, energy-efficient FPGA-based device with enough I/O to speed up vision and robotics tasks at an affordable price point. Combined with the Prophesee breakthrough Event-based vision technology, machine vision system developers can leverage the lower latency and lower power capabilities of the Metavision platform to experiment and create more efficient, and in many cases not previously possible, applications compared to traditional frame-based vision sensing approaches.

 

A breakthrough plug-and-play Active Markers Tracking application is included in this kit. It allows for >1,000Hz 3D pose estimation, with complete background rejection at pixel level while providing extreme robustness to challenging lighting conditions.
This application highlights unique features of Prophesee’s Event-based Metavision technologies, enabling a new range of ultra high-speed tracking use cases such as game controller tracking, construction site safety, heavy load anti-sway systems and many more.

Multiple additional ready-to-use application algorithms will be made available over the coming months.

The Prophesee Starter Kit provides an ‘out of the box’ development solution to quickly get up and running with the Prophesee Metavision SDK and IMX636 HD Event-based sensor realized in collaboration between Prophesee and Sony, allowing easy porting of algorithms to the AMD commercial and industrial-grade system-on-module (SOMs) powered by the custom-built Zynq? UltraScale+? multiprocessing SoC.

The new, Prophesee-enabled Kria KV260 AI Starter Kit will be on display at Automate 2024 in Prophesee’s booth 3452

 

“The ever-expanding Kria ecosystem helps make motion capture, connectivity, and edge AI applications more accessible to roboticists and developers,” said Chetan Khona, senior director of Industrial, Vision, Healthcare and Sciences Markets, AMD. “Prophesee Event-based Vision offers unique advantages for machine vision applications. Its low data consumption translates into efficient energy consumption, less compute and memory needed, and fast response times.”

“It’s never been easier to develop Event-based Edge applications with this combination of development aids from AMD and Prophesee,” said Luca Verre, co-founder and CEO of Prophesee. “We are providing everything needed to take complete advantage of the lower power processing and low latency performance inherent in Event-based Vision, as well as provide an environment to optimize machine vision system based on specific KPIs for customer-defined applications and use cases. This will further accelerate the adoption of Event-based Vision in key market segments that can benefit from Metavision’s unique advantages.”

Pricing & Availability

The Prophesee-enabled AMD Kria KV260 Starter Kit is available now.

ABOUT PROPHESEE

 

Prophesee is the inventor of the world’s most advanced neuromorphic vision systems.

The company developed a breakthrough Event-based Vision approach to machine vision. This new vision category allows for significant reductions of power, latency and data processing requirements to reveal what was invisible to traditional frame-based sensors until now. Prophesee’s patented Metavision? sensors and algorithms mimic how the human eye and brain work to dramatically improve efficiency in areas such as autonomous vehicles, industrial automation, IoT, mobile and AR/VR. Prophesee is based in Paris, with local offices in Grenoble, Shanghai, Tokyo and Silicon Valley.

The company is driven by a team of more than 100 visionary engineers, holds more than 50 international patents and is backed by leading international equity and corporate investors including 360 Capital Partners, European Investment Bank, iBionext, Intel Capital, Omnivision, Prosperity7 Ventures, Renault Group, Robert Bosch Venture Capital, Sinovation, Sony, Supernova Invest, Xiaomi.

 

Learn more: m.rfnf.cn/en

AMD, the AMD arrow, Kria, UltraScale+, Zynq, and combinations thereof are trademarks of Advanced Micro Devices, Inc.

]]>
Prophesee’s Metavision? Image Deblur Solution for Smartphones now production-ready http://m.rfnf.cn/en/2024/02/27/metavision-image-deblur-production-ready/ Tue, 27 Feb 2024 13:22:46 +0000 http://m.rfnf.cn/?p=82413

Prophesee’s Metavision? Image Deblur Solution for Smartphones is now production-ready, seamlessly optimized for the Snapdragon 8 Gen 3 Mobile Platform

MWC reveal showcases the multi-year collaboration between Prophesee and Qualcomm resulting in next generation blur-free mobile photography, now ready for customer integration into Snapdragon 8 Gen 3 enabled devices.

PARIS, February 27, 2024 – Prophesee SA, inventor of the most advanced neuromorphic vision systems, today announced that the progress achieved through its collaboration with Qualcomm Technologies, Inc. has now reached production stage. A live demo during Mobile World Congress Barcelona is showcasing Prophesee’s native compatibility with premium Snapdragon? mobile platforms, bringing the speed, efficiency, and quality of neuromorphic-enabled vision to cameras in mobile devices.

Fig 1: Prophesee Metavision solution introduced on main stage at Qualcomm’s Snapdragon Summit

Prophesee’s event-based Metavision sensors and AI, optimized for use with Snapdragon platforms now bring motion blur cancellation and overall image quality to unprecedented levels, especially in the most challenging scenarios faced by conventional frame-based RGB sensors, fast-moving and low-light scenes.

“We have made significant progress since we announced this collaboration in February 2023, achieving the technical milestones that demonstrate the impressive impact on image quality our event-based technology has in mobile devices containing Snapdragon mobile platforms. As a result, our Metavision Deblur solution has now reached production readiness,” said Luca Verre, CEO and co-founder of Prophesee. “We look forward to unleashing the next generation of Smartphone’s photography and video with Prophesee’s Metavision.”

“Qualcomm Technologies is thrilled to continue our strong collaboration with Prophesee, joining efforts to efficiently optimize Prophesee’s event-based Metavision technology for use with our flagship Snapdragon 8 Gen 3 Mobile Platform. This will deliver significant enhancements to image quality and bring new features enabled by event cameras’ shutter-free capability to devices powered by Snapdragon mobile platforms,” said Judd Heape, VP of Product Management at Qualcomm Technologies, Inc.

HOW IT WORKS

Prophesee’s breakthrough sensors add a new sensing dimension to mobile photography. They change the paradigm in traditional image capture by focusing only on changes in a scene, pixel by pixel, continuously, at extreme speeds.

Each pixel in the Metavision sensor embeds a logic core, enabling it to act as a neuron. They each activate themselves intelligently and asynchronously depending on the number of photons they sense. A pixel activating itself is called an event. In essence, events are driven by the scene’s dynamics, not an arbitrary clock anymore, so the acquisition speed always matches the actual scene dynamics.

High-performance event-based deblurring is achieved by synchronizing a frame-based and Prophesee’s event-based sensor. The system then fills the gaps between and inside the frames with microsecond events to algorithmically extract pure motion information and repair motion blur.

ABOUT PROPHESEE

Prophesee is the inventor of the world’s most advanced neuromorphic vision systems.

The company developed a breakthrough Event-Based Vision approach to computer vision. This new vision category allows for significant reductions of power, latency and data processing requirements to reveal what was invisible to traditional frame-based sensors until now. Prophesee’s patented Metavision? sensors and AI mimic how the human eye and brain work to dramatically improve efficiency in areas such as industrial automation, mobile, IoT, and AR/VR.

Prophesee is based in Paris, with local offices in Grenoble, Shanghai, Tokyo and Silicon Valley. The company is driven by a team of more than 120 visionary engineers, holds more than 50 international patents and is backed by leading international equity and corporate investors including 360 Capital Partners, European Investment Bank, iBionext, Intel Capital, Prosperity7 Ventures, Robert Bosch Venture Capital, Sinovation, Supernova Invest, Will Semiconductor, Xiaomi.

Learn more: m.rfnf.cn/en

Snapdragon is a trademark or registered trademark of Qualcomm Incorporated. Snapdragon is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.

]]>
Prophesee’s partner Zinn Labs announces event-based gaze-tracking system http://m.rfnf.cn/en/2024/01/30/prophesee-partner-zinnlabs-gaze-tracking/ Tue, 30 Jan 2024 06:53:00 +0000 http://m.rfnf.cn/?p=82588

Prophesee’s partner Zinn Labs announces event-based eye-tracking system for AI-enabled smart frames and VR/MR systems

Breakthrough event based eye tracking system leverages ultra-low-power, low-latency of event-based vision sensors from Prophesee enables new levels of intuitive, seamless user experiences

MENLO PARK, California – January 30, 2024 – Today, Zinn Labs is introducing the industry’s first event-based eye-tracking system for VR/MR headsets and smart frames. The core enabling feature of event-based sensing is the faster and more efficient capture of the relevant signals for eye tracking.

Kevin Boyle, CEO of Zinn Labs, explains, “Zinn Labs’ event-based gaze-tracking reduces bandwidth by two orders of magnitude compared to video-based solutions, allowing it to scale to previously impractical applications and form factors.”

The low compute footprint of Zinn Labs’ 3D gaze estimation gives it the flexibility to support low-power modes for use in smart wearables that look like normal eyewear. In other configurations, the gaze tracker can enable low-latency, slippage-robust tracking at speeds above 120 Hz for high-performance applications.

Gaze-tracking Applications

Smart eyewear is a rapidly emerging category that can serve as an always-there portal to access generative AI. The attention signal provided by gaze seamlessly connects AI output to the user’s intentions in a variety of application demos provided by Zinn Labs.

As AR and MR computing devices move toward increasingly more intuitive user interfaces, gaze tracking is a prerequisite for several component technologies. For example, gaze is the most natural method of interacting with the digital environment. Zinn Labs leverages the Prophesee GenX320 sensor to offer a high-refresh-rate and low-latency gaze-tracking solution that makes an attractive solution for those looking to push the boundaries of responsiveness and realism of head-worn display devices.

Zinn Labs DK1 available soon

The Zinn Labs DK1 Gaze-enabled Eyewear Platform is a development kit equipped with a binocular event-based gaze-tracking system and outward-facing world camera and is powered by Zinn Labs’ 3D gaze estimation algorithms. The DK1 is equipped with Prophesee GenX320 event-based Metavision? sensors, the smallest event-based sensors on the market.

“Frame-based acquisition techniques don’t meet the speed, low latency, size and power requirements of AR/MR wearables and headsets that are practical to use and provide a realistic user experience. Our GenX320 was developed specifically with these real-time and processing efficiency needs in mind, delivering the advantages of event-based vision to a wide range of products, such as those that will be enabled by Zinn Labs’ breakthrough AR/MR platform,” said Luca Verre, CEO and co-founder of Prophesee.

The DK1 supports sub-1°, slippage-robust gaze tracking accuracy and runs at 120 Hz with 10 ms end-to-end latency. The development kit comes with demo applications, such as the wearable AI assistant featured here, and can be used for performance evaluation or customer proof-of-concept integration projects.

Learn more at SPIE AR | VR | MR 2024

Zinn Labs will be presenting the technology and demonstrating the DK1 at SPIE AR | VR | MR 2024 on January 30th and 31st in San Francisco, CA. Check out www.zinnlabs.com for more information or contact info@zinnlabs.com to inquire about development kits and licensing.

ABOUT ZINN LABS

Zinn Labs, Inc. designs pupil and gaze tracking systems for head-worn devices, as well as novel user interfaces that only gaze can enable. Zinn Labs’ technologies combine cutting-edge computer vision research with a deep understanding of the human visual system and how user attention, captured through gaze, can bring a vision-first neural interface to a new generation of consumer devices.

ABOUT PROPHESEE

Prophesee is the inventor of the world’s most advanced neuromorphic vision systems.

The company developed a breakthrough Event-Based Vision approach to machine vision. This new vision category allows for significant reductions of power, latency and data processing requirements to reveal what was invisible to traditional frame-based sensors until now. Prophesee’s patented Metavision? sensors and algorithms mimic how the human eye and brain work to dramatically improve efficiency in areas such as autonomous vehicles, industrial automation, IoT, mobile and AR/VR.

Prophesee is based in Paris, with local offices in Grenoble, Shanghai, Tokyo and Silicon Valley. The company is driven by a team of more than 100 visionary engineers, holds more than 50 international patents and is backed by leading international equity and corporate investors including 360 Capital Partners, European Investment Bank, iBionext, Inno-Chip, Intel Capital, Renault Group, Robert Bosch Venture Capital, Sinovation, Supernova Invest, Xiaomi.

Learn more: http://m.rfnf.cn/en

]]>
Prophesee sets up a regional HQ in Hong Kong http://m.rfnf.cn/en/2023/12/12/regional-hq-hk/ Tue, 12 Dec 2023 02:47:07 +0000 http://m.rfnf.cn/?p=81971

PROPHESEE establishes regional headquarters in Hong Kong to accelerate global business expansion

Further promoting the application of neuromorphic artificial intelligence technology in Asia

HONG KONG? – December 12, 2023 – With the assistance of InvestHK of the Hong Kong SAR Government, PROPHESEE today announced the establishment of a regional headquarters in Hong Kong to further promote the application of neuromorphic artificial intelligence technology across Asia.

Dr Jimmy Chiang, Associate Director-General of Investment Promotion, said:

“Invest Hong Kong welcomes Prophesee’s ‘settlement’ in Hong Kong. We are happy to see that the company capitalises on the city’s advantages in research and development (R&D) capabilities, advanced technology infrastructure, legal system and deep pool of local talent to set up its regional headquarter in Hong Kong. With opportunities brought by the National 14th Five-Year Plan and the Guangdong-Hong Kong-Macao Greater Bay Area, Hong Konghas become a strategic hub to help innovative companies like Prophesee expand their markets. “

Mr. Luca Verre, co-founder and CEO of Prophesee, said:

“Prophesee is committed to promoting the adoption of the neuromorphic AI technology in mass market segments such as mobile phones, augmented reality or virtual reality headsets, internet of things (IoT) cameras, as well as industrial automation and automotive sectors. The Greater China and the broader Asia markets represent the largest and fastest growing markets for many of these segments. As we are accelerating our commercial expansion and are already achieving wins with major mobile manufacturers and IoT solution providers in the Greater China region, we think it’s an optimal time to come to Hong Kong and make it a regional centre for our further expansion in Asia.”

Luca Verre added that the new Hong Kong office is not only Prophesee’s regional headquarters in the Asia Pacific region, but also a Customer Innovation Centre, responsible for coordinating business operations in Greater China, Japan and South Korea, while developing innovative neuromorphic solutions for customers around the world. The company will be transferring and also hiring senior executive team members in Hong Kong to facilitate the process.
Prophesee develops a breakthrough Event-Based Vision approach to machine vision. This new vision category allows for significant reduction of power, latency and data processing requirements to reveal what was invisible to traditional frame-based sensors until now.

For more information about Prophesee, please visit m.rfnf.cn.

INVEST HONG KONG 投資推廣署

24/F, Fairmont House, 8 Cotton Tree Drive, Central, Hong Kong
Tel: (852) 3107 1000
Fax: (852) 3107 9140
Website: www.investhk.gov.hk

]]>
Prophesee Launches GenX320 Metavision? Sensor http://m.rfnf.cn/en/2023/10/13/prophesee-launches-genx320/ Fri, 13 Oct 2023 15:10:22 +0000 http://m.rfnf.cn/?p=81017

Prophesee launches the world’s smallest and most power-efficient event-based vision sensor, bringing more intelligence, privacy and safety than ever to consumer Edge-AI devices

Prophesee’s latest event-based Metavision? sensor – GenX320 – delivers new levels of performance including ultra-low power, low latency, high flexibility for efficient integration in AR/VR, wearables, security and monitoring systems touch-free interfaces, always-on IoT and many more

PARIS – October 16, 2023 – Prophesee SA, inventor of the world’s most advanced neuromorphic vision systems, today announced the availability of the GenX320 Event-based Metavision sensor, the industry’s first event-based vision sensor developed specifically for integration into ultra-low-power Edge AI vision devices. The fifth generation Metavision sensor, available in a tiny 3x4mm die size, expands the reach of the company’s pioneering technology platform into a vast range of fast-growing intelligent Edge market segments, including AR/VR headsets, security and monitoring/detection systems, touchless displays, eye tracking features, always-on smart IoT devices and many more.

The GenX320 event-based vision sensor builds on Prophesee’s track record of proven success and expertise in delivering the speed, low latency, dynamic range and power efficiency and privacy benefits of event-based?vision to a diverse array of applications.

The 320×320 6.3μm pixel BSI stacked event-based vision sensor offers a tiny 1/5” optical format. It has been developed with a specific focus on the unique requirements of efficient integration of innovative event sensing in energy-, compute and size-constrained embedded at-the-edge vision systems. The GenX320 enables robust, high-speed vision at ultra-low power and in challenging operating and lighting conditions.

GenX320 benefits include:

 

 

  • Low latency μsec resolution timestamping of events with flexible data formatting.
  • On-chip intelligent power management modes reduce power consumption to as low as 36uW and enable smart wake-on-events. Deep sleep and standby modes are also featured.
  • Easy integrability/interfacing with standard SoCs with multiple integrated event data preprocessing, filtering, and formatting functions to minimize external processing overhead.
  • MIPI or CPI data output interfaces offer low-latency connectivity to embedded processing platforms, including low-power microcontrollers and modern neuromorphic processor architectures.
  • AI-ready: on-chip histogram output compatible with multiple AI accelerators;
  • Sensor-level privacy-enabled thanks to event sensor’s inherent sparse frameless event data with inherent static scene removal.
  • Native compatibility with Prophesee Metavision Intelligence, the most comprehensive, free, event-based vision software suite, used by a fast-growing community of 10,000+ users.

“The low-power Edge-AI market offers a diverse range of applications where the power efficiency and performance characteristics of event sensors are ideally suited. We have built on our foundation of commercial success in other application areas and developed this new eventbased Metavision sensor to address the needs of Edge system developers with a sensor that is easy to integrate, configure and optimize for multiple compelling use cases in motion and object detection, presence awareness, gesture recognition, eye tracking, and other high growth areas,” said Luca Verre, CEO and co-founder of Prophesee.

Specific use case potential

 

 

  • High-speed eye-tracking for foveated rendering for seamless interaction in AR/VR/XR headsets
  • Low latency touch-free human-machine interface in consumer devices (TVs, laptops, game consoles, smart home appliances and devices, smart displays and more)
  • Smart presence detection and people counting in IoT cameras and other devices
  • Ultra-low power always-on area monitoring systems
  • Fall detection cameras in homes and health facilities

Availability

 

The GenX320 is available for purchase from Prophesee and its sales partners. It is supported by a complete range of development tools for easy exploration and optimization, including a comprehensive Evaluation Kit housing a chip on board (COB) GenX320 module, or a compact optical flex module. In addition, Prophesee is offering assembly kits that enable seamless connectivity to a large range of embedded platforms, such as an STM32 MCU, enabling faster time-to-market.

Early adopters

“Zinn Labs is developing the next generation of gaze tracking systems built on the unique capabilities of Prophesee’s Metavision event sensors. The new GenX320 sensor meets the demands of eye and gaze movements that change on millisecond timescales. Unlike traditional video-based gaze tracking pipelines, Zinn Labs is able to leverage the GenX320 sensor to track features of the eye with a fraction of the power and compute required for full-blown computer vision algorithms, bringing the footprint of the gaze tracking system below 20 mW. The small package size of the new sensor makes this the first time an event-based vision sensor can be applied to space-constrained head-mounted applications in AR/VR products. Zinn Labs is happy to be working with Prophesee and the GenX320 sensor as we move towards integrating this new sensor into upcoming customer projects.”

 

Kevin Boyle
CEO & Founder

Video 1 – Zinn Labs?Eye-tracking application powered by GenX320 Metavision sensor

“Privacy continues to be one of the biggest consumer concerns when vision-based technology is used in our products such as DMS and TV services. Prophesee’s event-based Metavision technology enables us to take our ‘privacy by design’ principle to an even more secure level by allowing scene understanding without the need to have explicit visual representation of the scene.?By capturing only?changes in every pixel, rather than the entire scene as with traditional frame-based imaging sensors, our algorithms can derive knowledge to sense what is in the scene, without a detailed representation of it. We have developed a proof-of-concept demo that demonstrates DMS is fully possible using neuromorphic sensors. Using a 1MP neuromorphic sensor we can infer similar performance as an active NIR illumination 2MP vision sensor-based solution. Going forward, we focus on the GenX320 neuromorphic sensor that can be used in privacy sensitive smart devices to improve user experience.

 

Petronel Bigioi
Chief Technology Officer

Video 2 – Xperi Driver Monitoring Systems (DMS) powered by GenX320 Metavision sensor

“We have seen the benefits of Prophesee’s event-based sensors in enabling hands-free interaction via highly accurate gesture recognition and hand tracking capabilities in Ultraleap’s TouchFree application. Their ability to operate in challenging environmental conditions, at very efficient power levels, and with low system latency enhances the overall user experience and intuitiveness of our touch free UIs. With the new Genx320 sensor, these benefits of robustness, low power consumption, latency and high dynamic range can be extended to more types of applications and devices, including battery-operated and small form factors systems, proliferating hands-free use cases for increased convenience and ease of use in interacting with all sorts of digital content.”


Tom Carter
CEO & Co-founder

Video 3 – Ultraleap touch-free solution powered by GenX320 Metavision sensor

ABOUT PROPHESEE

Prophesee is the inventor of the world’s most advanced neuromorphic vision systems.

The company developed a breakthrough Event-Based Vision approach to machine vision. This new vision category allows for significant reductions of power, latency and data processing requirements to reveal what was invisible to traditional frame-based sensors until now. Prophesee’s patented Metavision? sensors and algorithms mimic how the human eye and brain work to dramatically improve efficiency in areas such as autonomous vehicles, industrial automation, IoT, mobile and AR/VR. Prophesee is based in Paris, with local offices in Grenoble, Shanghai, Tokyo and Silicon Valley.

The company is driven by a team of more than 100 visionary engineers, holds more than 50 international patents and is backed by leading international equity and corporate investors including 360 Capital Partners, European Investment Bank, iBionext, Inno-Chip, Intel Capital, Renault Group, Robert Bosch Venture Capital, Sinovation, Supernova Invest, Xiaomi.

Learn more:?m.rfnf.cn/en

]]>
Prophesee launches event-based vision evaluation kit based on the IMX646 HD sensor which is realized in collaboration between Sony and Prophesee http://m.rfnf.cn/en/2023/09/23/prophesee-launches-event-based-vision-evaluation-kit-based-on-the-imx646-hd-sensor-which-is-realized-in-collaboration-between-sony-and-prophesee/ Fri, 22 Sep 2023 16:55:06 +0000 http://m.rfnf.cn/?p=80548

Prophesee launches event-based vision evaluation kit based on the IMX646 HD sensor which is realized in collaboration between Sony and Prophesee

Metavision? EVK5 is a high-speed, cost-efficient and compact evaluation kit optimized for the Chinese computer vision market.

Prophesee EVK5 HD

SHANGHAI, China – September 25, 2023 Prophesee today announced the availability of a high-speed, cost-efficient and compact evaluation kit (EVK) for computer vision developers who would like to develop applications based on the breakthrough IMX646 HD stacked Event-Based Vision sensor.

The full-featured EVK, designed and built in China, is optimized for the requirements of the local market and provides computer vision engineers with an extensively tested solution for efficient technology onboarding and rapid applications prototyping and development. The kit is natively compatible with free 5x award-winning software from Prophesee, Metavision Intelligence. It also includes technical support,?access to a knowledge center, application notes, advanced documentation and a fast-growing community of 10k+ users globally.

“This new EVK will enable computer vision engineers, integrators, and camera manufacturers to get a complete and accurate understanding of how to leverage the performance advantages offered by this innovative architecture. The EVK is tailored for the needs of the Chinese market and is the best way to start evaluating how the sensor performs for multiple use cases and market-specific machine visions systems” said Xuefei Yang, Vice President and General Manager China.

Prophesee EVK5 HD

Image 1 – Prophesee EVK5 HD

This IMX646 event-based vision sensor combines Sony’s CMOS image sensor technology with Prophesee’s unique event-based Metavision? sensing technologies. The sensor delivers under 800μs delay output at 1K lux, a high dynamic range greater than 110dB and can operate in low light conditions, down to 0.08 lux. It features the industry’s smallest*1 4.86μm pixel size in a 1/2.5-type with approx. 0.92 megapixels. The industry leading pixel pitch and 1280 x720 pixel resolution make it ideal for a wide range of vision-enabled use cases in high volume applications such as IoT, Surveillance camera, consumer application and more.

The EVK5 is provided with the award-winning Metavision? Intelligence Suite, the most comprehensive set of event-based software tools that facilitate efficient application development. It features 95 algorithms, 79 code samples and 24 tutorials and is augmented by a global Open-Source community of developers. This breadth of technology allows developers to quickly perform a variety of design exploration steps and efficiently incorporate customized software applications to meet specific market requirements.

ABOUT THE EVK

Built from high-quality aluminum alloy, the EVK combines a lightweight 95g design with compact dimension of just 35x35x35.27mm, it can fit in the most space-constrained systems.

Provided with the USB-powered kits are a CS-mount lens, a CS to M12 adapter, a USB-A to USB-A cable, a transformer bracket with tripod screw hole, an EVS Trigger Cable and a Quickstart guide

The EVK is available from Prophesee immediately.

EVK5 Box Contents

Image 2 – Prophesee EVK5 HD Box Contents

*1: Among stacked event-based vision sensors. According to Sony research (as of announcement on September 9, 2021).

ABOUT PROPHESEE

Prophesee is the inventor of the world’s most advanced neuromorphic vision systems.

The company developed a breakthrough Event-Based Vision approach to computer vision. This new vision category allows for significant reductions of power, latency and data processing requirements to reveal what was invisible to traditional frame-based sensors until now. Prophesee’s patented Metavision? sensors and algorithms mimic how the human eye and brain work to dramatically improve efficiency in areas such as industrial automation, mobile, IoT, and AR/VR.

Prophesee is based in Paris, with local offices in Grenoble, Shanghai, Tokyo and Silicon Valley. The company is driven by a team of more than 100 visionary engineers, holds more than 50 international patents and is backed by leading international equity and corporate investors including 360 Capital Partners, European Investment Bank, iBionext, Intel Capital, Prosperity7 Ventures, Robert Bosch Venture Capital, Sinovation, Supernova Invest, Will Semiconductor, Xiaomi.

Learn more: www.prophesee.ai

]]>
Ultraleap Hand-Tracking with Metavision http://m.rfnf.cn/en/2023/06/13/ultraleap-hand-tracking-prophesee-metavision/ Tue, 13 Jun 2023 15:42:23 +0000 http://m.rfnf.cn/?p=81717

Ultraleap reveals new TouchFree hand-tracking demo at CVPR, using Prophesee Metavision technologies

Digital signage?and displays?are becoming increasingly more prevalent and engaging.?One?new development in this space is?the ability to?interact with digital content?without touching a screen – completely touch-free.

Ultraleap’s?TouchFree?solution?enables users to interact with digital screens through natural hand interactions and offers a higher level of engagement without sacrificing productivity and throughput.

To achieve broad applicability in interactive digital signage, it’s crucial to address challenges related to robustness in diverse lighting environments, including nighttime and brightly lit spaces. In addition, interactivity through glass windows, a high-value use case, can present complex issues that require attention.

Prophesee’s?Event-Based Metavision? technology,?with?its high dynamic range, low power and high-speed asynchronous readout?unlocks?consistent experiences in all environments.

Video 1 – Ultraleap’s Touch-Free Application:
Menu Ordering

Video 2 – Ultraleap’s Touch-Free Application:
Ball pit game

Ultraleap?has developed a technology demonstrator featuring a stereo setup with?two event-based?IMX636 sensors,?realized?in?collaboration between?Sony?and Prophesee. This is used with Ultraleap’s world’s class hand tracking and?the TouchFree solution to deliver the world’s first touchless experience featuring?Prophesee Metavision? technologies.

We are excited to share that?Ultraleap?will be?demonstrating?this new?development at?CVPR 2023. The demo will be shown at the workshop on Event-based Vision on the 19th of June at 10:30 AM. Secure your meeting with us to learn more about what Metavision can do for your application.

]]>
Prophesee named in Best of MWC 2023 Awards by Android Authority http://m.rfnf.cn/en/2023/03/01/android-authority-named-prophesee-best-of-mwc-2023-awards/ Wed, 01 Mar 2023 15:56:01 +0000 http://m.rfnf.cn/?p=81741

?Prophesee named in Best of MWC 2023 Awards by Android Authority

PARIS – February 28, 2023 – Prophesee announced a collaboration with Qualcomm Snapdragon to unlock a new image quality paradigm for smartphone cameras at Mobile World Congress in Barcelona.

Following a successful and busy show, Android Authority named Prophesee in their Best of MWC 2023 Awards among top brands and mobile technology providers.

“Blurry pictures are the curse of every smartphone photographer, but not for long. Prophesee has partnered with Qualcomm to bring its “event-based”?Metavision technology to future smartphones.”

Video 1 – Sports scene: Preliminary deblurring results on high-speed scene, obtained combining Prophesee Metavision sensor and algorithms with Snapdragon platform.

The technical and business partnership will enable native compatibility between Prophesee’s Event-Based #Metavision? Sensors & Software and premium Snapdragon? mobile platforms.

This work will lead to dramatically improved camera performance, removing motion blur even in ultra-fast moving scenes and in low light, through Prophesee’s breakthrough shutter-free, continuous and asynchronous pixel sensing approach.

?
Thousands of companies and many more visitors attend Mobile World Congress every year. The Android Authority team announces the awards, among other coverage, to help their readers “separate the noise from the signal” with the best announcements made at the show.

>”Say sayonara to blurry photos thanks to this sharp camera tech.”

– Robert Triggs, Feb 2023, Android Authority

Event-Based vision will offer exciting advancements for mobile phone cameras, probably the most important differentiator feature in new phones. Collaborating with Qualcomm Technologies, Inc., a leading provider of premium mobile technologies, will help to accelerate mobile industry adoption of Prophesee’s solutions.?

Prophesee mobile technology

Early coverage

]]>