[ Video ] Running K2 Horizon 3.7B on my 16GB MacBook Pro
K2 Horizon 3.7B runs comfortably on a 16GB MacBook Pro. Worth noting that the 7B parameter version was better, but way too slow.
Decision tools and frameworks for autonomous living
K2 Horizon 3.7B runs comfortably on a 16GB MacBook Pro. Worth noting that the 7B parameter version was better, but way too slow.
A frontier model was capable to change a smaller model by just editing their weights. The short and long term consequences are fascinating.
A Raspberry Pi 4 can run comfortably (3t/s) LFM3 1.7B. Not usable for heavy coding, but good enough for an orchestrator.
I tested Liquid Foundation LFM3 Omni 2.2B model, in a browser on my MacBook Pro. At 1.6GB download, the experience is spectacular.
I tested the Apple Intelligence model Apple ships with its default install, by actually chatting with it. One of the fastest models so far.
Spark 2.6 4B from Spark LLM is a decent model for its size. In my testing, there was even room left for other apps on my [...]
Testing Nemotron 3.5 Bolt E4B 4GB on my 16GB MackBook Pro: balanced answers and decent speed. It's a good model for day to day usage.
During development of one of my apps, Zen Tales, my coding agent (Claude, back then) deleted some audio files I already paid for. A difficult lesson.
Second installment of my stories from the vibe coding trenches is about a mindset shift: nothing is difficult anymore. Listen to your users.
Nvidia Nemotron Dory 1.0 4B is a surprisingly good model that can be run locally, on a 16GB MacBook Pro, for coding and text generation.
The 4th video in the series about what models can you realistically run on a 16GB MacoBook tests Liquid AI LFM 2.5. A solid model.
Artificial Intelligence might be replaced by Super Intelligence. It's just a word play, for now, but it may shape how we call it too.
Setting up local AI on a 16GB MacBook involves using optimized binaries for the Metal architecture. Start with MLX-serve. Optionally OpenWebUI
At the end of the day, all AI models are the same: statistical approximation machines. A really good AI model is just in the question you [...]
This week I'm testing Xiaomi MiMo V2.6, Qwen 9b distill, on a 16GB M1 MacBookPro. It works good enough for text generation and light coding
This week I'm testing Google Gemma 4 E4B on a 16GB M1 MacBookPro. It works surprisingly well for text generation and even light coding.
Grok 4.7 was launched yesterday and I had a chance to test it. It has better prompt adherence, it's more thorough, but also token greedy.
A System One model, like JEV, doesn't output text, it only decides, and that's why is perfect for my Assess Decide Do framework.
This is a brief test of a heavily quantized version of Qwen 3.8 27B, fitting in 7GB on disk. Impressive, but not 98% of the original [...]
95% of my blog is coming from agents now. They didn't ask for permission, those bots, so I decided to make the AI agents pay.
I've been blogging for 20 years
ask me anything