https://jamesm.blog/tags/inference/ Recent content in Inference on jamesm.blog https://jamesm.blog/papermod-cover.png https://jamesm.blog/papermod-cover.png Hugo en Mon, 11 May 2026 13:00:00 +0100 https://jamesm.blog/ai/inference-hardware-insurgents/ Mon, 11 May 2026 13:00:00 +0100 https://jamesm.blog/ai/inference-hardware-insurgents/ A grounded look at the three serious AI inference hardware insurgents in 2026 - Cerebras with its wafer-scale WSE-3, Groq with its LPU architecture now part-licensed by Nvidia, and SambaNova with its SN40L and SN50 reconfigurable dataflow units - and what their different bets tell us about where inference is heading. https://jamesm.blog/ai/reasoning-models-2026/ Fri, 08 May 2026 19:00:00 +0100 https://jamesm.blog/ai/reasoning-models-2026/ A grounded look at the reasoning-model wave - what makes o3, DeepSeek R1/R2, Gemini Deep Think, and Claude Extended Thinking different from the generation that came before, when to actually reach for one, and what the cost and capability trade-offs look like in production. https://jamesm.blog/ai/mac-studio-local-llm-guide/ Sat, 18 Apr 2026 07:22:00 +0100 https://jamesm.blog/ai/mac-studio-local-llm-guide/ A practical guide to Mac Studio configs for running popular free models locally (Qwen, LLaMA, Mixtral), realistic performance expectations, and which hardware actually makes sense.