Prompting an agent to run an npm script feels silly


With the Fable re-release, I’m reminded that with every model release I’ve found myself saying “if I could just run today’s best model on my machine I’d be set forever.”

The reality has been much different. With each frontier model release, I ramp up the ambition and scope of the projects I attempt. I used to copy and paste code out of ChatGPT so I could code faster. Then Cursor let me edit files inline by prompting, allowing me to make localized changes to code with natural language instructions. A harness with Sonnet 3.5 made multi-file editing possible, enabling some project-level changes, though repos would still devolve somewhat quickly if completely unsupervised. I remember making a webapp with a few prompts with this model. At the time it seemed amazing. Now it seems quaint.

Opus 4.x and GPT-5.5 now fluently work in and modify codebases of hundreds of thousands of lines at least, in any language or framework you throw at them. And open source models like GLM 5.2 can too, for a fraction of the cost. With better context management and tooling, these models can be productive in even larger codebases and for hours or days. I don’t fully understand what Fable 5 is capable of yet.

For some model releases (like this one), the capability jump is noticeable, but with time, after each release, I’ve adjusted my working approach accordingly within weeks or months. At the same time, there’s clearly a capability overhang.

I can’t try everything I think of. I don’t have the time. There are lots of areas I’m not an expert in and don’t even have the vocabulary or knowledge to push the model to its limits. And the model itself can help teach me to close these gaps if I dedicate the time.

Back down the rabbit hole to see what Fable can do. My early takeaways are that it’s much better at generating visual assets using code approaches (different from Nano Banana), and it can easily be prompted to work for hours and still produce good results.

Some people seem to find working with Fable roughly the same as Opus 4.8, but I’d have to disagree. If you can tee up a big project, Fable can deliver in a big way.

On this day

2024-07-02

2 years ago

A nice read by Stuart on Python development tools. This introduced me to the pyproject.toml configuration file, which is more comprehensive than a...

2023-07-02

3 years ago

A simple shell function to setup a Python project scaffold. It's idempotent, so it won't overwrite an existing folder or env.