32G Multi Rate Very Short Reach SerDes PHY - GlobalFoundries 12LP and 12LPP
RaiderChip launches its Generative AI hardware accelerator for LLM models on low-cost FPGAs
The startup pioneers Edge Generative AI inference on small devices, thanks to the efficiency of its AI accelerator IP core: the GenAI v1
Spain, June 4th, 2024 -- The company, which recently announced its first Generative AI Hardware accelerator, goes one step further, offering a turn-key solution for LLM inference now available on a wide range of low-cost FPGA devices.
RaiderChip GenAI v1 running the Phi-2 LLM model on a Versal FPGA with a single Memory Controller
RaiderChip’s v1 design leverages 32-bits floating point arithmetic, which provides full precision, allowing direct usage of original LLM model weights, without any modification or quantization. This preserves the full intelligence and reasoning capabilities of the raw LLM models, as their creators intended them.
This full precision is coupled with real-time AI LLM inference speeds: “Our design’s efficiency edge allows customers to run unquantized LLM models at full interactive speed, on limited memory bandwidths where competitors are more than 20% slower, especially faster than CPU based inference solutions”, explains RaiderChip’s team.
The GenAI v1 IP core is already available for FPGAs of every sub-family in the AMD Versal FPGA line-up, as well as earlier UltraScale Series devices, and more: “Our IP cores are target-agnostic, and can also be implemented on different FPGA vendor devices, following customer’s requirements for logic resources and inference speed.” the team highlights.
A standout feature of RaiderChip’s solutions is the plug’n’play nature of its IP cores, using only the minimal number of industry standard AXI interfaces. With the provided IP blocks the GenAI v1 becomes a simple peripheral: fully controllable from the customer’s Software.
The introduction of FPGAs for Generative AI Acceleration expands the available options for local AI inference of LLM models. Furthermore, their reprogrammable nature makes them ideal in the context of explosive innovation in the AI field, where new models and algorithmic upgrades appear on a weekly basis, where FPGAs allow field updates of already deployed systems.
More information at https://raiderchip.ai/technology/hardware-ai-accelerators
|
Related News
- RaiderChip Hardware NPU adds Falcon-3 LLM to its supported AI models
- Imagination launches Open Access program, providing scale-ups with a low-cost path to differentiated silicon
- RaiderChip unveils its fully Hardware-Based Generative AI Accelerator: The GenAI NPU
- RaiderChip brings Meta Llama 3.2 LLM HW acceleration to low cost FPGAs
- RaiderChip raises 1 Million Euros in seed capital to market its innovative generative AI accelerator: the GenAI v1.
Breaking News
- GUC Announces Tape-Out of the World's First HBM4 IP on TSMC N3P
- VeriSilicon Launches ISP9000: The Next-Generation AI-Embedded ISP for Intelligent Vision Applications
- Frontgrade Gaisler Launches New GRAIN Line and Wins SNSA Contract to Commercialize First Energy-Efficient Neuromorphic AI for Space Applications
- Latest intoPIX JPEG XS Codec Powers FOR-A's FA-1616 for Efficient IP Production at NAB 2025
- BrainChip Partners with RTX's Raytheon for AFRL Radar Contract
Most Popular
- Movellus and RTX's SEAKR Engineering Collaborate on Advancing Mission-Critical ASICs
- Intel brings 3nm production to Europe in 2025
- Silicon-Proven MIPI CSI-2 & DSI-2 Tx/Rx IP Cores for your Camera & Display SoCs
- Eliyan Sets New Standard for Chiplet Interconnect Performance with Latest PHY Delivering Data Rate of 64Gbps on 3nm Process Using Standard Packaging
- EnSilica Opens Second Brazilian Design Centre Following Multimillion Pound Design and Manufacturing Contract Win
![]() |
E-mail This Article | ![]() |
![]() |
Printer-Friendly Page |