Tenstorrent Engineers Talk Open-Sourced Bare-Metal Stack
By Sally Ward-Foxton, EETimes (February 2, 2024)
Tenstorrent, the Jim Keller–led AI chip and IP startup, is making available and open-sourcing its bare-metal software stack, which allows access to the hardware at the lowest level, Tenstorrent senior fellow Jasmina Vasiljevic told EE Times. The startup also recently showed EE Times a large language model (LLM)—Falcon-40B—up and running on its 32-chip Galaxy system, and it has made hardware available to purchase for the first time in the form of evaluation kits for its first-generation Grayskull chips.
One often-quoted reason for Nvidia’s dominance in AI and HPC applications is its mature software stack, CUDA, which allows users to write their own custom kernels for the most efficient possible execution of algorithms on Nvidia GPUs. Several startups have opened up bare-metal programming capabilities for their own hardware to date (including Untether, Esperanto and now Tenstorrent) to try to chip away at Nvidia’s lead in the data center. Doing so requires a significant software effort over and above the bare-essentials software stack many startups launch with, wherein typical initial functionality may be limited to inference for a subset of popular models.
E-mail This Article | Printer-Friendly Page |
|
Related News
- StarFive Released Open-Sourced Dubhe Linux SDK in RVspace Community
- Tenstorrent and MosChip Partner on High Performant RISC-V Design
- Ecosystem Collaborations Bring Full Stack Software Solutions to Develop Leading-edge Automotive Applications From Day One
- Tenstorrent RISC-V and Chiplet Technology Selected to Build the Future of AI in Japan
- Microchip's Low-Cost PolarFire® SoC Discovery Kit Makes RISC-V and FPGA Design More Accessible for a Wider Range of Embedded Engineers
Breaking News
- Packetcraft Delivers Bluetooth Software Enabling Channel Sounding to Early Access Licensees
- QuickLogic Releases Aurora 2.6 with Expanded Operating System Support and Up to 15% Faster Performance
- Rapid Silicon Introduces Revolutionary Rapid eFPGA Configurator for Hassle Free Embedded FPGA Evaluation
- Silvaco Announces Launch of Initial Public Offering
- TSMC's A16 Process Moves Goalposts in Tech-Leadership Game