Apple Silicon Is Groundbreaking for AI

Alex Cheema is the founder of EXO Labs, an AI company focused on “AI you can trust with your data” by making systems that run locally, on computers you own and control. Apple provided him with two M3 Ultra Mac Studios, each maxed out with 512 GB of unified memory. Within a day, he had them linked together by Thunderbolt 5 and had the full DeepSeek R1 model running on his desk. Sure, that’s over $20,000 of computing hardware. But to my knowledge there is no other way in the world to run the full DeepSeek R1 model for even close to $20,000, let alone doing it on your desk rather than a data center. It’s an exclusive advantage, made possible by Apple Silicon’s general performance and the breakthrough of Apple’s unified memory architecture, which lets the GPU cores access the same RAM as the CPU cores. Apple has tremendous technical advantages to offer in AI. But they’re marketing Genmojis of hot dogs carrying briefcases.  ★ 

Mar 20, 2025 - 00:22
 0

Alex Cheema is the founder of EXO Labs, an AI company focused on “AI you can trust with your data” by making systems that run locally, on computers you own and control. Apple provided him with two M3 Ultra Mac Studios, each maxed out with 512 GB of unified memory. Within a day, he had them linked together by Thunderbolt 5 and had the full DeepSeek R1 model running on his desk.

Sure, that’s over $20,000 of computing hardware. But to my knowledge there is no other way in the world to run the full DeepSeek R1 model for even close to $20,000, let alone doing it on your desk rather than a data center. It’s an exclusive advantage, made possible by Apple Silicon’s general performance and the breakthrough of Apple’s unified memory architecture, which lets the GPU cores access the same RAM as the CPU cores.

Apple has tremendous technical advantages to offer in AI. But they’re marketing Genmojis of hot dogs carrying briefcases.