"Raspberry Pi is launching a new add-on board capable of running generative AI models locally on the Raspberry Pi 5. Announced on Thursday, the $130 AI HAT+ 2 is an upgraded - and more expensive - version of the module launched last year, now offering 8GB of RAM and a Hailo 10H chip with 40 TOPS of AI performance. Once connected, the Raspberry Pi 5 will use the AI HAT+ 2 to handle AI-related workloads while leaving the main board's Arm CPU available to complete other tasks."
"Another shows how you can translate text from French to English with Qwen2. However, tech YouTuber Jeff Geerling found that a standalone Raspberry Pi 5 with 8GB of RAM generally outperformed the AI HAT+ 2 across the supported models. Geerling links the lower performance to power draw, as the Pi 5 can operate at up to 10 watts, while the AI HAT+ 2 is limited to 3W."
AI HAT+ 2 is a $130 add-on for Raspberry Pi 5 that provides 8GB of RAM and a Hailo 10H chip delivering 40 TOPS for local generative AI workloads. The board offloads AI tasks from the Pi 5’s Arm CPU and can run small models such as Llama 3.2, DeepSeek-R1-Distill, and several Qwen models, and supports training and fine-tuning. Demos include camera-stream descriptions and French-to-English translation with Qwen2. Performance can be limited by the HAT’s 3W power cap, and a standalone 16GB Pi 5 may outperform the add-on for many models. Raspberry Pi plans to release larger models for the HAT soon.
Read at The Verge
Unable to calculate read time
Collection
[
|
...
]