[ Video ] Running Nanbeige 4.2 3B on my 16GB MacBook Pro
I tested Nanbeige 4.2 3b on a 16GB MacBook Pro. The 4bit quant is good, but the generation is relatively slow.
Decision tools and frameworks for autonomous living
I tested Nanbeige 4.2 3b on a 16GB MacBook Pro. The 4bit quant is good, but the generation is relatively slow.
K2 Horizon 3.7B runs comfortably on a 16GB MacBook Pro. Worth noting that the 7B parameter version was better, but way too slow.
I was invited to a very nice podcast recently "Punct. Si de la capat". We talk a about many thngs, but mostly about starting over.
A frontier model was capable to change a smaller model by just editing their weights. The short and long term consequences are fascinating.
A Raspberry Pi 4 can run comfortably (3t/s) LFM3 1.7B. Not usable for heavy coding, but good enough for an orchestrator.
I tested Liquid Foundation LFM3 Omni 2.2B model, in a browser on my MacBook Pro. At 1.6GB download, the experience is spectacular.
Ling 3.0 Tiny is a surprisingly good model to run on a 16GB MacBook Pro. Test generation can go as fast as 45 tokens / second.
I tested the Apple Intelligence model Apple ships with its default install, by actually chatting with it. One of the fastest models so far.
Anthropic IPO valuation was set a $2 trillion. On top of that, the company warns about extreme dangers posed by AI. Counterintuitive?
Spark 2.6 4B from Spark LLM is a decent model for its size. In my testing, there was even room left for other apps on my [...]
Testing Nemotron 3.5 Bolt E4B 4GB on my 16GB MackBook Pro: balanced answers and decent speed. It's a good model for day to day usage.
During development of one of my apps, Zen Tales, my coding agent (Claude, back then) deleted some audio files I already paid for. A difficult lesson.
Second installment of my stories from the vibe coding trenches is about a mindset shift: nothing is difficult anymore. Listen to your users.
Nvidia Nemotron Dory 1.0 4B is a surprisingly good model that can be run locally, on a 16GB MacBook Pro, for coding and text generation.
This are real stories from my life as a vibe coder. This one shows how I overpaid $150 on Cloudeflare while vibe coding Flight Lens.
The 4th video in the series about what models can you realistically run on a 16GB MacoBook tests Liquid AI LFM 2.5. A solid model.
Artificial Intelligence might be replaced by Super Intelligence. It's just a word play, for now, but it may shape how we call it too.
Adulthood is hard. And it comes without a user manual. So I built an iOS app that fills this gap: from health checks, to money management.
Setting up local AI on a 16GB MacBook involves using optimized binaries for the Metal architecture. Start with MLX-serve. Optionally OpenWebUI
At the end of the day, all AI models are the same: statistical approximation machines. A really good AI model is just in the question you [...]
I've been blogging for 20 years
ask me anything