It’s crunch time for my latest project. I always feel a mixture of love and hate for this phase of every project. It’s been gestating for many months and now there will be some pain in the delivery.

I remember a full dozen years ago the feeling of independence, tinged with some slight digital survivalism, of running a local version of Wikipedia from my Nexus One smartphone. It was cool, but I used that feature on maybe a couple of flights. I know better now that I feel a similar impulse about running powerful LLMs from my smartphone.