Right, but most of their expenditures are not in the queries themselves but in model training. I think capital for training will dry up in coming years but people will keep running queries on the existing models, with more and more emphasis on efficiency. I hate AI overall but it does have its uses.
No, that’s the thing. There’s still significant expenditure to simply respond to a query. It’s not like Facebook where it costs $1 million to build it and $0.10/month for every additional user. It’s $1billion to build and $1 per query. There’s no recouping the cost at scale like previous tech innovation. The more use it gets, the more it costs to run, in a straight line, not asymptotically.
No way is it $1 per query. Hell a lot of these models you can run on your own computer, with no cost apart from a few cents of electricity (plus datacenter upkeep)
Right, but most of their expenditures are not in the queries themselves but in model training. I think capital for training will dry up in coming years but people will keep running queries on the existing models, with more and more emphasis on efficiency. I hate AI overall but it does have its uses.
No, that’s the thing. There’s still significant expenditure to simply respond to a query. It’s not like Facebook where it costs $1 million to build it and $0.10/month for every additional user. It’s $1billion to build and $1 per query. There’s no recouping the cost at scale like previous tech innovation. The more use it gets, the more it costs to run, in a straight line, not asymptotically.
No way is it $1 per query. Hell a lot of these models you can run on your own computer, with no cost apart from a few cents of electricity (plus datacenter upkeep)