[ Video ] Running Nanbeige 4.2 3B on my 16GB MacBook Pro
I tested Nanbeige 4.2 3b on a 16GB MacBook Pro. The 4bit quant is good, but the generation is relatively slow.
Decision tools and frameworks for autonomous living
I tested Nanbeige 4.2 3b on a 16GB MacBook Pro. The 4bit quant is good, but the generation is relatively slow.
K2 Horizon 3.7B runs comfortably on a 16GB MacBook Pro. Worth noting that the 7B parameter version was better, but way too slow.
A Raspberry Pi 4 can run comfortably (3t/s) LFM3 1.7B. Not usable for heavy coding, but good enough for an orchestrator.
I tested Liquid Foundation LFM3 Omni 2.2B model, in a browser on my MacBook Pro. At 1.6GB download, the experience is spectacular.
I tested the Apple Intelligence model Apple ships with its default install, by actually chatting with it. One of the fastest models so far.
Spark 2.6 4B from Spark LLM is a decent model for its size. In my testing, there was even room left for other apps on my [...]
Testing Nemotron 3.5 Bolt E4B 4GB on my 16GB MackBook Pro: balanced answers and decent speed. It's a good model for day to day usage.
During development of one of my apps, Zen Tales, my coding agent (Claude, back then) deleted some audio files I already paid for. A difficult lesson.
Second installment of my stories from the vibe coding trenches is about a mindset shift: nothing is difficult anymore. Listen to your users.
Nvidia Nemotron Dory 1.0 4B is a surprisingly good model that can be run locally, on a 16GB MacBook Pro, for coding and text generation.
The 4th video in the series about what models can you realistically run on a 16GB MacoBook tests Liquid AI LFM 2.5. A solid model.
Artificial Intelligence might be replaced by Super Intelligence. It's just a word play, for now, but it may shape how we call it too.
Setting up local AI on a 16GB MacBook involves using optimized binaries for the Metal architecture. Start with MLX-serve. Optionally OpenWebUI
This week I'm testing Xiaomi MiMo V2.6, Qwen 9b distill, on a 16GB M1 MacBookPro. It works good enough for text generation and light coding
This week I'm testing Google Gemma 4 E4B on a 16GB M1 MacBookPro. It works surprisingly well for text generation and even light coding.
This is a brief test of a heavily quantized version of Qwen 3.8 27B, fitting in 7GB on disk. Impressive, but not 98% of the original [...]
In the final episode I talk about open weight model harnesses, or how to actually talk to your local AI. From llama-cpp chat to Pi, or [...]
In this episode I talk about running an open weights model locally. Two main hardware lines: Apple Silicon and NVIDIA, both good.
Episode 2 of the mini series about how to choose an open weights model, this time how to choose an open weights model provider.
How to choose and open weights model: the difference between slow, dumb and laggy - and state of the art inference, like Claude or Grok.
I've been blogging for 20 years
ask me anything