Arm Brings Transformers to IoT Devices
By Sally Ward-Foxton, EETimes (May 4, 2024)
NUREMBERG, Germany— The next generation of Arm’s Ethos micro-NPU, Ethos-U85, is designed to support transformer operations, bringing generative AI models to IoT devices. The IP giant is seeing demand for transformer workloads at the edge, according to Paul Williamson, senior VP and general manager for Arm’s IoT line of business, though in much smaller forms than their bigger brothers, large language models (LLMs). For example, Arm has ported vision transformer ViT-Tiny and generative language model TinyLlama-1.1B to the Ethos-U85 so far.
“Most machine learning inferencing is already being done on Arm-powered devices today,” Williamson said. “It may seem like the AI explosion came overnight, but the truth is Arm’s been preparing for this moment for a long time. The benefits of edge AI cut across a whole host of segments within IoT…AI needs tight integration between the hardware and the software, and Arm has invested heavily in the last decade.”
E-mail This Article | Printer-Friendly Page |
|
Arm Ltd Hot IP
Related News
- New AI technology from Arm delivers unprecedented on-device intelligence for IoT
- Interview: Arm's SystemReady 2.0 to Secure IoT Devices
- Arm brings automation to IoT connectivity management
- Arm and Leading Test Laboratories Unveil Independent Security Certification for IoT Devices
- New Arm IP Helps Protect IoT Devices from Increasingly Prevalent Physical Threats
Breaking News
- AiM Future Brings GenAI Applications to Mainstream Consumer Devices
- Axiomise Names Two Executives to Newly Formed Technical Advisory Board
- GDDR7 Adds Headroom to Meet AI Pressures
- Esperanto Technologies and Rapidus Partner to Enable More Energy-Efficient Designs for the Coming "Post GPU Era"
- Actions Technology's smart watch SoC adopted VeriSilicon's 2.5D GPU IP
Most Popular
- GDDR7 Adds Headroom to Meet AI Pressures
- New Automotive Grade Linux Platform Release Adds Cloud-Native Functionality, RISC-V Architecture and Flutter-Based Applications
- Esperanto Technologies and Rapidus Partner to Enable More Energy-Efficient Designs for the Coming "Post GPU Era"
- ADTechnology and ANAFLASH to Team Up for Embedded Vision Summit (EVS) showcase
- Andes, HiRain, and HPMicro Join Hands to Build RISC-V AUTOSAR Software Ecosystem