Tenstorrent Engineers Talk Open-Sourced Bare-Metal Stack
By Sally Ward-Foxton, EETimes (February 2, 2024)
Tenstorrent, the Jim Keller–led AI chip and IP startup, is making available and open-sourcing its bare-metal software stack, which allows access to the hardware at the lowest level, Tenstorrent senior fellow Jasmina Vasiljevic told EE Times. The startup also recently showed EE Times a large language model (LLM)—Falcon-40B—up and running on its 32-chip Galaxy system, and it has made hardware available to purchase for the first time in the form of evaluation kits for its first-generation Grayskull chips.
One often-quoted reason for Nvidia’s dominance in AI and HPC applications is its mature software stack, CUDA, which allows users to write their own custom kernels for the most efficient possible execution of algorithms on Nvidia GPUs. Several startups have opened up bare-metal programming capabilities for their own hardware to date (including Untether, Esperanto and now Tenstorrent) to try to chip away at Nvidia’s lead in the data center. Doing so requires a significant software effort over and above the bare-essentials software stack many startups launch with, wherein typical initial functionality may be limited to inference for a subset of popular models.
E-mail This Article | Printer-Friendly Page |
|
Related News
- StarFive Released Open-Sourced Dubhe Linux SDK in RVspace Community
- Tenstorrent and MosChip Partner on High Performant RISC-V Design
- Ecosystem Collaborations Bring Full Stack Software Solutions to Develop Leading-edge Automotive Applications From Day One
- Tenstorrent RISC-V and Chiplet Technology Selected to Build the Future of AI in Japan
- Microchip's Low-Cost PolarFire® SoC Discovery Kit Makes RISC-V and FPGA Design More Accessible for a Wider Range of Embedded Engineers
Breaking News
- TSMC's A16 Process Moves Goalposts in Tech-Leadership Game
- EDA toolset parade at TSMC's U.S. design symposium
- Altera in negotiation on private equity partner
- Arm China's ex-CEO sets up RISC-V company
- CAN FD Controller & LIN 2.1 Controller IP Cores, Available for Immediate Licensing with Proven Automotive Compatibility
Most Popular
- Controversial former Arm China CEO founds RISC-V chip startup
- Qualitas Semiconductor Partners with TUV Rheinland Korea to Enhance ISO 26262 Functional Safety Management System
- TSMC Celebrates 30th North America Technology Symposium with Innovations Powering AI with Silicon Leadership
- TSMC plans 1.6nm process for 2026
- M31 has successfully launched MIPI C/D PHY Combo IP on the advanced TSMC 5nm process