New Neural Network Based ISP Enhances Low-Light and HDR Processing by Up to 100X Compared to State-of-the-Art Traditional ISPs
Ambarella, Inc., an AI vision silicon company, announced its new Artificial Intelligence Image Signal Processor (AISP). The company is showcasing this technology at its invitation-only event during CES 2022 in Las Vegas this week, running on its CV2 edge AI perception systems on chip (SoCs).
Drawing on its 17 years of experience in ISP processing and best-in-class CVflow AI engine, Ambarella’s new AI based ISP architecture uses neural networks to augment the image processing done by the hardware ISP integrated into its SoCs. This approach enables color imaging with low light at very low lux levels and minimal noise, a 10 to 100X improvement over state-of-the-art traditional ISPs, and new levels of high dynamic range (HDR) processing with more natural color reproduction and higher dynamic range.
Top iTechnology Networking News: Parks Associates Ten Percent of US Broadband Households own a Smart Sleep Product, Such as Smart Mattresses
Initially demonstrated on the CV2 SoCs during CES this week, the new AISP will become available across Ambarella’s entire CVflow SoC portfolio at resolutions up to 4K. The applications of this technology encompass all of the company’s target markets, where low-light and HDR processing are critical. This includes security and automotive cameras, where full-color night vision is a key operating point, and where better low-light and HDR enable reductions in external illumination, the use of lower cost sensors, and cleaner video for both human viewing and analytics processing.
“Being able to see clearly in low-light or high-contrast conditions is key to robust camera systems,” said Les Kohn, Ambarella’s CTO and co-founder. “Traditional camera systems have had to live with noisy or dark black and white video in low-light conditions, and dark shadows or blown-out highlights in high contrast conditions. Both of these cases result in the loss of details that are detrimental to both human viewing and AI applications. With our new AISP technology, we increase the useful range of camera systems while reducing the total system cost to build high quality cameras.”
Top iTechnology Automation News: Xinhua Silk Road Shanghai’s Jiading Concentrates on Hydrogen Fuel Cells and ICVs, Boosts Automobile Industry
A good example of this new technology in action, which will be demonstrated during CES running on the CV2, is a typical security camera trying to identify a license plate at night. With noisy video, the text on the license plate would be unreadable, even to the best AI algorithm. And with black and white video, all color information on the car would be lost. By using Ambarella’s AISP technology and restoring colors at the source before AI processing, the license plate can be clearly read and the color of the car identified.
The AISP processing happens in parallel on the silicon with other higher-level AI applications running on Ambarella’s CVflow AI engine. This enables customers to build their next generation of cameras with both higher visual quality and more accurate AI algorithms, while staying within the low power budgets required by small embedded systems.
Other Key features of the AISP include:
- Support for mainstream sensors
- Seamless switching between different lighting conditions, including day, night, and HDR scenes
- A set of tuning tools for sharpening, CE, AE, AWB, etc.
- Ability to run in parallel with other AI algorithms on the CVflow engine
- Advanced operational modes to fit application-specific use cases
Top iTechnology AIOps News: Quectel Launches New Generation of Flagship Android Smart Module
[To share your insights with us, please write to sghosh@martechseries.com]
