Latest NPU Adds to Arm’s AI Platform Performance, Applicability, and Efficiency
By Dennis Laudick, vice president of Marketing, Machine Learning Group, Arm
News Highlights:
- Adding to the success of Arm’s microNPU product line, Arm Ethos-U65 maintains the power efficiency of the Ethos-U55, while extending its applicability to Arm Cortex-A- and Arm Neoverse-based systems
- Continued support for existing software and toolchains to provide a single, unified developer experience
- Expanded technology partnership with NXP to deliver energy-efficient, cost-effective AI solutions for the fast-growing Industrial and IoT markets
With an ever-increasing range of devices adding artificial intelligence (AI) functionality, Arm today announced the latest member of its Ethos product line, the Arm Ethos-U65 microNPU (Neural Processing Unit). Focused on AI/machine learning (ML) processing, and providing a new performance point and new capabilities, the Ethos-U65 maintains the power efficiency of the Arm Ethos-U55 while extending its applicability from Arm Cortex-M to Arm Cortex-A and Arm Neoverse-based systems, and at the same time delivering twice the on-device ML performance.
The rapid adoption of AI and ML into edge and endpoint devices is driving not only increased functionality but also increased device and system requirements. This in turn means providers must deliver systems with more performance and on-device ML capabilities, while maintaining or improving power efficiency.
Enabling AI everywhere: No device left behind
Arm’s unparalleled AI platform is designed to deliver flexible, scalable technologies to the broadest range of devices. Earlier this year we announced new ML IP, the Arm Cortex-M55 processor and Arm Ethos-U55, the world’s first microNPU, a combined solution delivering a 480x leap in ML performance for microcontrollers. This solution is enabling ML compute to happen everywhere, from the tiniest endpoint devices to smart home solutions and beyond.
We’re already seeing great success with the Ethos-U55, as licensees including NXP Semiconductors deliver solutions that address the increasing demand for on-device ML processing for billions of small, power-constrained IoT and embedded devices. NXP will now also add the Ethos-U65 to its SoC offerings, providing their customers with more on-device intelligence for smarter, more powerful devices that benefit from high efficiency, greater privacy, and reliability.
Ethos-U65: Powering a new wave of edge AI
5G network rollouts are enabling and enhancing connectivity for billions of diverse devices, which is why we added another performance point with the Ethos-U65. This will enable an additional range of solutions for complex AI workloads across the Cortex-M, Cortex-A, and Neoverse processor families, while increasing throughput and efficiency on a consistent software stack and with familiar tools. By enabling greater system-level performance in rich embedded devices, as well as subsystems in applications like data and control planes of Neoverse-based systems, developers can unlock better throughput and power efficiency, more intelligence, and more natural ways to interact with our connected world.
For more technical details, read this blog from my colleague Tanuj Arora.
Solving the ML software challenge: Common toolchains so it just works
Critical to enabling the AI revolution is the need to support the millions of developers working to make this technology innovative and accessible to the masses. The Ethos-U65 leverages the extensive Arm AI ecosystem that is creating and optimizing algorithms to broadly enable on-device AI. The Arm AI Platform delivers a unified software and tools interface for implementing the most popular neural networks across the heterogenous Arm-based processors typically found in modern integrated circuits (ICs). In addition, there is rich support for open source software to bring the flexibility required in implementing these complex use cases.
We recognize that one of the greatest benefits for our developer ecosystem is alignment around common platforms in order to protect the scale of investments through portability, standards, and common APIs. Our guiding principle is to enable developers to write code once and deploy it anywhere by providing an extensible platform, using common software and toolchains with a simple goal that it should just work.
An unprecedented opportunity
AI and ML represent a once-in-a-generation paradigm shift in capability using data, compute, and software. Arm continues to support this transformation with an unparalleled roadmap of dedicated ML processors and technologies, enabling everyone from cloud providers to tiny IoT device manufacturers.
Through the momentum of our Ethos architecture, and the massive success we’ve already seen for AI devices, we’re helping the ecosystem unlock significant value by delivering the foundations for many new possibilities, maybe even ones we’ve yet to imagine.
Any re-use permitted for informational and non-commercial or personal use only.
Media Contacts
Latest on Twitter
Congratulations to Tamika Curry Smith, our Chief DEI Officer who has been chosen as one of @SavoyNetwork's Most Influential Executives in Corporate America for 2024. 👏
The honor recognizes Tamika's commitment to community, leadership, and success: https://okt.to/2NvDOZ
This #EarthDay, we're celebrating our collaboration with @UNICEF, to unlock the life-changing potential of technology in Malawi.💧
Our investment has helped UNICEF install two water supply systems, helping provide 11,000 people with access to safe water and sanitation services.
ISA parity is accelerating silicon and software deployment in automotive! 🚗💨
👇 At #ew24 we showcased what this looks like in practice via virtual platforms with our Neoverse-based cloud instances and new Arm AE IP, which brings almost 100% ISA parity. https://okt.to/cjVaFN
The future of automotive is here. 🚀
Hear from Dipti Vachani on @IBDinvestors as she shares details on the game-changing performance and functional safety features of our new Armv9-based AE processors and server-class Neoverse technology: https://okt.to/WVtw58
AI is expected to increase data center power consumption 3️⃣x by 2030.
To offset this, hyperscalers like Amazon and Google turn to Arm Neoverse to reduce power without compromising performance.
That's why the future of AI is built #onArm. https://okt.to/LPVFWd
We're working with our partners @Simprints, @Gavi and @_GHSofficial to enable healthcare equity in Ghana.
Built #onArm, Simprints technology is enabling vaccine equity by making it easier to verify vaccine delivery by individual: https://okt.to/MIcgxu
If Arm technology is in there, then the future will be too.
Our energy-efficient compute platforms are foundational to the world's technology and AI computing, shaping how we work, play and connect.
That's why the future is built #onArm. https://okt.to/M9wqc8
Here's to a fantastic week at Embedded World! 🎉
From lightning talks and speaker sessions to demos of our latest automotive and IoT technologies, we brought our vast ecosystem together to showcase what's possible when you build #onArm.
Thank you to everyone that joined us. 👏
🚗 Software-defined vehicles (SDVs) are the future of automotive and they're being built #onArm.
Robert Day joins @Sonatus and @MotorTrend on the latest podcast to talk all things SDVs and where the industry is headed.
🔊👇 Listen below.
🏆 And the winner of the Embedded Awards 2024 goes to… @Ambiq_AI's Apollo510 MCU!
This winning tech opens the door to new local AI opportunities on billions of devices.
Listen in as the team talk us through their exceptionally efficient Arm-based SoCs at #EmbeddedWorld.
David Maidment recently shared his thoughts on the future of edge computing at #EmbeddedWorld!
Missed the talk? Catch up on his insights into the evolution of edge computing across billions of diverse connected devices to build a secure AI-enabled future: https://okt.to/EtfSRN
AI is everywhere at this year's #EmbeddedWorld.
🚘 With the demand for more autonomy, increasingly advanced user experiences and the trend toward electrification Dennis Laudick shares why AI will remain crucial to drive innovation in the software-defined vehicle.
#ew24
Two identical demos. One different NPU.
Our new Ethos-U85 NPU is optimized for transformer networks to deliver the performance needed for edge AI use cases - including high performance voice and vision experiences.
This makes it perfect for AI applications like Gen AI. #ew24
We're ready for the final day of #EmbeddedWorld! 🚀
It's been a fantastic show so far showcasing our power-efficient compute platforms that are fueling the future of edge AI.
Reply with an emoji to let us know if you'll be visiting us on the show floor. 👋
#ew24
What's trending at #EmbeddedWorld?
AI, AI and more AI. 🔥
@pnwilliamson shares where you might find edge AI in action from our ecosystem partners building the future #onArm. #ew24
At the Arm booth at #EmbeddedWorld you'll find:
✅ Partner demos from the likes of @NXP, @Ambiq_AI and @_Elektrobit
✅ Partner Lightning Talks from @Microsoft, @EdgeImpulse and more
✅ Our latest IoT and Automotive tech
#ew24
🚀 We're taking edge AI innovation to the next level with the new Arm Ethos-U85 NPU and Corstone-320 IoT Reference Design Platform.
@pnwilliamson shares how these new technologies are transforming future voice, audio and vision applications live from #EmbeddedWorld. #ew24
Get to know LaunchX from NetsPresso by @nota_ai, on show at #EmbeddedWorld. 👇
Designed to help you easily convert and benchmark AI models, it supports a ton of Arm-based devices from our partners including Arduino, NXP, Renesas, Raspberry Pi and NVIDIA. #ew24
🇺🇸🇯🇵 We're proud to support new AI research partnerships between universities in the US and Japan.
Through close collaboration between business, academia and government we can continue to advance AI innovation to transform industries and improve lives. https://okt.to/9JbahF
📢 Custom Arm-based silicon from @GoogleCloud is here!
Axion, built on Armv9 Neoverse V2, will bring performance & energy efficiency gains to AI inferencing & general-purpose workloads, like web and app servers.
Congrats to the team! 👏 https://okt.to/xS4cBN #GoogleCloudNext
It's time for #EmbeddedWorld! 🙌
We're in Nuremberg this week showing you how to build your AI-accelerated future #onArm. 🎉
Can’t join us in person? Keep up to date on social media for live updates from the show! #ew24
🆕 Get ready to accelerate edge AI with the new Arm Ethos-U85 NPU and Corstone-320 IoT Reference Design Platform. ⚡
With performance and efficiency uplifts, developers can now deliver greater AI compute in smaller, more cost-sensitive devices: https://okt.to/cJPTCQ
When it comes to AI and ML at the edge, challenges like hardware fragmentation and performance optimization stand in the way of widespread adoption.
@pnwilliamson shares how developers can navigate this, with an invitation to join us at Embedded World: https://okt.to/tpsPTd
With the AI boom fueling demand for compute, our CEO Rene Haas speaks to @jchatterleyCNN on the importance of ecosystem collaboration to unlock unique capabilities we've not seen before.
Listen to the @CNN podcast at 28:38 for the full interview 👉 https://okt.to/mcH1tF
