That’s true, but there are also massive economies of scale when you can afford the big Nvidia gpus and share them among many people.

I agree. I use openrouter myself.

In general I agree with you, but llms are the one exception where it’s not practical and not cost effective to run them locally. If you want to use them, the better option is by far to pay someone for the service.