Exactly. When i was younger i had this western digital thing that let me watch videos off a hard drive on my CRT TV. I pirated everything. Didnt have cable. This is pre streaming.
I reached a point in my life where i was making enough money that a $20 sub was worth the conveniance.
There is this tipping point where it becomes more cost effective to bring it inhouse, even with the staffing requirements. For small to medium sized buinesses though cloud all the way.
Depends on if you even need a better model though. Can you run a good enough model is what matters for the most part.
The wet dream for big tech has been to get people to pay subscription fees for compute, just like businesses do for cloud hosting. They tried with Stadia to get people to play games hosted in the cloud, but that was never going to fly.
With the compute demands of AI (which is comparable to a AAA game except for the largest models), they dont want to make the same mistake and let you have the compute. They see this as an oppurtunity for subscription fees for the earth.
The fact that we cant get hardware for a reasonable price is an added bonus to this plan.
All of this only works of everyone subscribes to this shit. Businesses will, because its just easier to manage it. Consumers though should not give in. If you want to run an agent, use a small local model.
The best thing that can be done is to make local open source agents and models approachable for regular users. Right now, they arent.
Its better this way. Limited content. You have to out the phone down and do something else
So you guys are bascially building out your own cloud? Where does one even start with something like that?
We are fully cloud where I am, but i have this dream where we self host our inferrence. Ever since i learned more about that 40k acre data cneter in Utah offering capacity for the big guys (AWS, etc), im very skeptical about how safe our data is when sending it to a model. Ethical issues aside