Enabling OEMs to use GPU compute to differentiate their camera applications
International CES, Las Vegas – 6th January, 2015 – Imagination Technologies (IMG.L) announces a new PowerVR imaging framework for Android: a set of software components that allow OEMs to integrate the latest computational photography and computer vision features into their camera applications, leveraging the inherent low-power parallelism of the PowerVR Rogue GPU.
Advanced vision and computational photography features such as HDR (high dynamic range), panoramic stitching, gesture recognition and augmented reality all require large amounts of processing power. Today, most OEMs continue to rely on CPU/DSP cores to meet the requisite performance requirements, but these processors struggle to deliver sustained video-rate processing of HD content, largely due to thermal limits of the devices.
Many image processing algorithms are well suited to the massively parallel architecture of the GPU. The PowerVR imaging framework tightly integrates the GPU with other system components such as a camera sensor, ISP (Image Signal Processor), CPU and other SoC-specific hardware to create a programmable image processing pipeline that can be easily incorporated into an OEM’s camera application. With the power and performance efficiency of PowerVR GPUs, Imagination’s OEM partners can now deploy cutting-edge vision features into their camera applications, ahead of dedicated hardware implementation in future SoCs – all within the constrained power budget of smartphones, tablets and other consumer devices.
Peter McGuinness, director of multimedia technology marketing, Imagination, says: “With the imaging framework for PowerVR, we are making it easy for our customers and their OEMs to differentiate their camera applications using their existing SoCs, all without adding to the hardware cost.”
Says Kai Pang, senior product manager, ASUS: “Imagination’s PowerVR imaging delivers better features to mass-market products that now can be accessed by a wider audience.”
Inside the PowerVR imaging framework for Android
The PowerVR imaging framework for Android comprises a set of extensions to the OpenCL and EGL application programming interfaces (APIs) that enable efficient zero-copy sampling of YUV and RGB camera data. The extensions enable direct manipulation of YUV data formats for example, which can be used to accelerate algorithms that operate only on luminance data. Another extension allows hardware to be configured to dynamically convert YUV data to RGB when sampled.
The framework also includes low-level functions for integrating these zero-copy extensions within the camera HAL (Hardware Abstraction Layer). Once integrated, these extensions can be used to overcome any limitations of camera lenses, the ISP (Image Signal Processor) hardware feature set, or the stock Android camera application. Customers have already used the zero-copy features in the framework to implement accelerated vision applications, with no need for any additional coherency hardware.
Imagination is working with several software partners to enable them to showcase new computational photography and vision solutions today, some of which will be shown at CES. Imagination is uniquely positioned to help its partners build innovative vision systems, with its in-depth knowledge of imaging processors, GPUs, video encoders and embedded CPUs, as well as its expertise in heterogeneous processing and with compute APIs such as OpenCL, RenderScript and OpenGL ES 3.0 and emerging APIs for vision applications such as OpenVX.
Continues McGuinness: “We are making our imaging platform available to lead partners under an early access program. I am excited to see the excellent progress of our software partners in building up the vision ecosystem around this foundational PowerVR computing technology.”
Says Michael Minkevich, vice president of technology services, Luxoft: “Imagination’s imaging framework has allowed us to efficiently implement many computational photography algorithms on the GPU such as denoising, structure and detail enhancement and HDR that help maximize the value for PowerVR users. The reference camera demonstration app included as part of the imaging framework has allowed us to demonstrate near-productized solutions to end OEMs.”
Demonstration at CES
Imagination will demonstrate the PowerVR imaging framework for Android at CES. Contact email@example.com to arrange an in-person demonstration.
About Imagination Technologies
Imagination is a global technology leader whose products touch the lives of billions of people across the globe. The company’s broad range of silicon IP (intellectual property) includes the key processing blocks needed to create the SoCs (Systems on Chips) that power all mobile, consumer and embedded electronics. Its unique software IP, infrastructure technologies and system solutions enable its customers get to market quickly with complete and highly differentiated SoC platforms. Imagination’s licensees include many of the world’s leading semiconductor manufacturers, network operators and OEMs/ODMs who are creating some of the world’s most iconic products. See: www.imgtec.com.