Deep learning features soon to integrate smartphones, say partners CEVA and Rockchip

August 11, 2016 // By Julien Happich
China’s leading fabless semiconductor company Rockchip has licensed CEVA's XM4 imaging and vision DSP to enhance the imaging and computer vision capabilities of its’ SoC product lines.

Rockchip will leverage the CEVA-XM4 for a range of advanced imaging and vision features at low power consumption among which include low-light enhancement, digital video stabilization, object detection and tracking, and 3D depth sensing. In addition, the CEVA-XM4 will enable Rockchip to use the latest deep learning technologies, utilizing CEVA’s comprehensive Deep Neural Network (CDNN2) software framework.

"Rockchip is determined to deliver ever-more compelling solutions for mobile and consumer devices, using the best-of-breed technologies available,” said Feng Chen, Chief Marketing Officer of Rockchip in a company statement. “The CEVA-XM4 imaging and vision processor and comprehensive software offering allows us to truly embrace the potential of computational photography, computer vision and machine learning in our product designs, seamlessly handling even the most complex use cases and algorithms.”

Rockchip has previously licensed multiple generations of CEVA DSPs and connectivity IPs, including RivieraWaves Bluetooth and Wi-Fi products. CEVA’s latest generation imaging and vision DSP, the CEVA-XM4, addresses the extreme processing requirements of the most sophisticated computational photography and computer vision applications such as video analytics, augmented reality and advanced driver assistance systems (ADAS).

By offloading these performance-intensive tasks from the CPUs and GPUs, the highly-efficient DSP dramatically reduces the power consumption of the overall system, while providing complete flexibility.

The platform includes a vector processor developed specifically to deal with the complexities of such applications and an extensive Application Development Kit (ADK) to enable easy development environment. The CEVA ADK includes an Android Multimedia Framework (AMF) that streamlines software development and integration effort, a set of advanced software development tools and a range of software products and libraries optimized for the DSP.

Visit Rockchip at www.rock-chips.com

Visit CEVA at www.ceva-dsp.com

 

Related articles:

Embedding deep neural networks at the push of a button

Neurons firing at the interim stage

Google's deep learning comes to Movidius