The problem is that this is one of the few use cases where I can afford the (dangerous and unreliable) cloud service but I’m far away from being able to do so self hosted.

I’m actually using LLMs quote a lot to counter some of my brains more weird bugs working-as-intended features. But this is way beyond what I could locally do.

For anyone in a similar shoe: you can mix local and remote quite well though, using local for everything that works out and remote for everything else. I.e speech to text and email analysis is done on my local server while bigger sets are done on the CLI with remote providers.