A Total Compute Approach to Delivering Digital Immersion Under a Common Architecture
By Ian Smythe, vice president of marketing, Client Line of Business
News Highlights:
- Arm Total Compute represents a new approach to IP design focusing on use-case driven optimized system solutions
- Evolving capabilities of Arm CPU IP by adding new ML instructions such as Matrix Multiply (MatMul) to boost performance
- Arm and Unity Technologies extend strategic partnership to further push performance of Arm technology in the Unity real-time 3D development platform
During my Arm TechCon 2019 keynote, I talked about the multiple transformations our industry is facing, from challenges in process scaling and data privacy, to a very fragmented ecosystem. While 5G will create a world of opportunity, we still need to deliver the power, performance, and efficiency for the next generation of immersive experiences.
Along with 5G, the acceleration of AI, xR, and IoT are changing compute requirements. The performance we need for digital immersion is going to have to push beyond what we have today, towards the world of Total Compute. This requires a very different approach to how we design our IP, with a deep focus on optimizing performance, security, and developer access.
Make no mistake, it won’t be more of the same, but a paradigm shift in thinking. We are moving from a single product evolution focus to a use-case and experience-driven system solution by optimizing within and across IP, software, and tools to provide a secure foundation and deliver the performance required for the complex compute challenges of tomorrow’s workloads.
Pushing ML performance to new levels
Since we announced the Cortex-A73, we’ve gradually increased machine learning (ML) performance generation-over-generation and today, we’re working to significantly broaden our CPU coverage for ML. In order to enable this new digital world, we need to push compute to a higher level, which is why we’ve added Matrix Multiply (MatMul) to our next-generation Cortex CPU, “Matterhorn”, effectively doubling ML performance over previous generations.
Beyond the CPU, we need to focus and apply the Total Compute approach to each compute element and its infrastructure within the system. Whether it’s an Arm CPU, GPU, NPU, interconnect, or system IP, it must be optimized as an integrated solution. And this relies on the software and tools to make it happen, including Arm NN, the Arm Compute Library, the open source community, and open standards, all built on a secure foundation.
Securing the digital world
Looking at security and why it matters is very important for digital immersion. We are increasingly relying on our mobile phone as the hub for all our personal information, and you can’t have privacy without security. Security within Total Compute is based on three layers:
We are already starting to roll out innovative security features like Memory Tagging Extension (MTE), as part of Total Compute, to meet the various needs of our customers. In fact, Google recently announced their plans to partner with us to design MTE for Android devices. These features, combined with Platform Security Architecture (PSA), will help to standardize and defragment security across the entire ecosystem.
Enabling developers under a common architecture
Did you know there are 23 million software developers in the world focused on building the best experience?[1] They are hungry for a standard set of software and driver interfaces to build their platforms, and while we are some way from that today, Arm is investing in these developers to enable this digitally immersive future. Our aim is to deliver Total Compute as the platform of choice for all developers, unleashing greater performance from silicon and virtual prototypes.
As part of Arm’s commitment to developer enablement, during my keynote I also announced an expanded partnership with Unity Technologies, a strategic partner who shares our mission of enabling creators. Arm and Unity will work together to further optimize performance on Arm-based SoCs, CPUs, and GPUs allowing developers to spend more time creating new, immersive content. With 70% of VR content development today happening in Unity, this is a massive win for the entire ecosystem and key to our future success.
“We’re proud to partner with Arm to ensure the world’s largest group of creators – Unity developers – have tools that are uniquely optimized for the billion-plus Arm powered devices.” -Ralph Hauwert, vice president of Platforms, Unity Technologies
Total Compute: The platform of choice
Our industry is reaching a pivotal crossroads, specifically as we try to solve a significant integration challenge: individual IP and fragmented solutions are hard to optimize. If we are to take advantage of the enormous future technology opportunities, we need to put use cases, consumer experiences, and the needs of the ecosystem at the heart of our IP design.
There will be a range of elements involved in any Total Compute solution, whether it’s for a VR headset or a wearable, a smartphone or a DTV. Our aim is to provide the foundation of the future compute platform, and with a Total Compute approach, we will simplify security, improve performance and efficiency, and give developers more access to performance throughout the Arm ecosystem, ultimately delivering true digital immersion.
[1] Source: Evans Data Corporation, 2018
Any re-use permitted for informational and non-commercial or personal use only.
Media Contacts
Latest on Twitter
The future of automotive is here. 🚀
Hear from Dipti Vachani on @IBDinvestors as she shares details on the game-changing performance and functional safety features of our new Armv9-based AE processors and server-class Neoverse technology: https://okt.to/WVtw58
AI is expected to increase data center power consumption 3️⃣x by 2030.
To offset this, hyperscalers like Amazon and Google turn to Arm Neoverse to reduce power without compromising performance.
That's why the future of AI is built #onArm. https://okt.to/LPVFWd
We're working with our partners @Simprints, @Gavi and @_GHSofficial to enable healthcare equity in Ghana.
Built #onArm, Simprints technology is enabling vaccine equity by making it easier to verify vaccine delivery by individual: https://okt.to/MIcgxu
If Arm technology is in there, then the future will be too.
Our energy-efficient compute platforms are foundational to the world's technology and AI computing, shaping how we work, play and connect.
That's why the future is built #onArm. https://okt.to/M9wqc8
Here's to a fantastic week at Embedded World! 🎉
From lightning talks and speaker sessions to demos of our latest automotive and IoT technologies, we brought our vast ecosystem together to showcase what's possible when you build #onArm.
Thank you to everyone that joined us. 👏
🚗 Software-defined vehicles (SDVs) are the future of automotive and they're being built #onArm.
Robert Day joins @Sonatus and @MotorTrend on the latest podcast to talk all things SDVs and where the industry is headed.
🔊👇 Listen below.
🏆 And the winner of the Embedded Awards 2024 goes to… @Ambiq_AI's Apollo510 MCU!
This winning tech opens the door to new local AI opportunities on billions of devices.
Listen in as the team talk us through their exceptionally efficient Arm-based SoCs at #EmbeddedWorld.
David Maidment recently shared his thoughts on the future of edge computing at #EmbeddedWorld!
Missed the talk? Catch up on his insights into the evolution of edge computing across billions of diverse connected devices to build a secure AI-enabled future: https://okt.to/EtfSRN
AI is everywhere at this year's #EmbeddedWorld.
🚘 With the demand for more autonomy, increasingly advanced user experiences and the trend toward electrification Dennis Laudick shares why AI will remain crucial to drive innovation in the software-defined vehicle.
#ew24
Two identical demos. One different NPU.
Our new Ethos-U85 NPU is optimized for transformer networks to deliver the performance needed for edge AI use cases - including high performance voice and vision experiences.
This makes it perfect for AI applications like Gen AI. #ew24
We're ready for the final day of #EmbeddedWorld! 🚀
It's been a fantastic show so far showcasing our power-efficient compute platforms that are fueling the future of edge AI.
Reply with an emoji to let us know if you'll be visiting us on the show floor. 👋
#ew24
What's trending at #EmbeddedWorld?
AI, AI and more AI. 🔥
@pnwilliamson shares where you might find edge AI in action from our ecosystem partners building the future #onArm. #ew24
At the Arm booth at #EmbeddedWorld you'll find:
✅ Partner demos from the likes of @NXP, @Ambiq_AI and @_Elektrobit
✅ Partner Lightning Talks from @Microsoft, @EdgeImpulse and more
✅ Our latest IoT and Automotive tech
#ew24
🚀 We're taking edge AI innovation to the next level with the new Arm Ethos-U85 NPU and Corstone-320 IoT Reference Design Platform.
@pnwilliamson shares how these new technologies are transforming future voice, audio and vision applications live from #EmbeddedWorld. #ew24
Get to know LaunchX from NetsPresso by @nota_ai, on show at #EmbeddedWorld. 👇
Designed to help you easily convert and benchmark AI models, it supports a ton of Arm-based devices from our partners including Arduino, NXP, Renesas, Raspberry Pi and NVIDIA. #ew24
🇺🇸🇯🇵 We're proud to support new AI research partnerships between universities in the US and Japan.
Through close collaboration between business, academia and government we can continue to advance AI innovation to transform industries and improve lives. https://okt.to/9JbahF
📢 Custom Arm-based silicon from @GoogleCloud is here!
Axion, built on Armv9 Neoverse V2, will bring performance & energy efficiency gains to AI inferencing & general-purpose workloads, like web and app servers.
Congrats to the team! 👏 https://okt.to/xS4cBN #GoogleCloudNext
It's time for #EmbeddedWorld! 🙌
We're in Nuremberg this week showing you how to build your AI-accelerated future #onArm. 🎉
Can’t join us in person? Keep up to date on social media for live updates from the show! #ew24
🆕 Get ready to accelerate edge AI with the new Arm Ethos-U85 NPU and Corstone-320 IoT Reference Design Platform. ⚡
With performance and efficiency uplifts, developers can now deliver greater AI compute in smaller, more cost-sensitive devices: https://okt.to/cJPTCQ
When it comes to AI and ML at the edge, challenges like hardware fragmentation and performance optimization stand in the way of widespread adoption.
@pnwilliamson shares how developers can navigate this, with an invitation to join us at Embedded World: https://okt.to/tpsPTd
With the AI boom fueling demand for compute, our CEO Rene Haas speaks to @jchatterleyCNN on the importance of ecosystem collaboration to unlock unique capabilities we've not seen before.
Listen to the @CNN podcast at 28:38 for the full interview 👉 https://okt.to/mcH1tF
With the New PSA Certified Level 4 iSE/SE, we can ensure the security of data and assets in an AI-enabled world.
We’re pleased to be working with industry leaders as a part of @PSACertified to make this possible. 🎉 🙌
At our Employee Resource Group Summit, our co-chairs came together to collaborate, develop, and align. They left with stronger networks, a clearer purpose, and a plan for collaborative activities.
Thanks to our members for enabling Arm to be a place where everyone can belong. 👏
Meet the future of autonomous vehicles with @Nuro! 🚗
Using our leading-edge Automotive Enhanced technology, the next-generation Nuro Driver is allowing millions to access the benefits of autonomous goods delivery.
