Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5, 6.43 tok/s (eval 11.68 tok/s)

Article URL: https://github.com/b4rtaz/distributed-llama/discussions/162 Comments URL: https://news.ycombinator.com/item?id=43059579 Points: 148 # Comments: 58

Fév 15, 2025 - 19:28
 0
Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5, 6.43 tok/s (eval 11.68 tok/s)

Article URL: https://github.com/b4rtaz/distributed-llama/discussions/162

Comments URL: https://news.ycombinator.com/item?id=43059579

Points: 148

# Comments: 58