The connection was lost. Trying to connect again.

Post by Jan Wildeboer 😷:krulorange:

Earlier in the thread

Jan Wildeboer 😷:krulorange: @jwildeboer@social.wildeboer.net

(Disclaimer. I work at Red Hat, which is owned by IBM. But my opinions here are my own. So don't quote me, dear journalists)

On-Prem "AI" works and is Good Enough™ so more companies are running Open Weight LLM inference on their own bare metal. Says IBM CEO Arvind Krishna. I am not surprised. If you can save 90% of the costs and, more importantly, keep your data and prompts local, err, sovereign —it not only makes business sense, it also keeps the lawyers happy.

theregister.com/systems/2026/1

· Public · edited

Jan Wildeboer 😷:krulorange: @jwildeboer@social.wildeboer.net

And also to be very clear: This is about companies, not the basement GPUs you run at home. These systems are not cheap, but here is an interesting development I hear more and more about in the various rumour mills. Racks and racks of NVIDIA systems are sitting in storage as data centres can't be spun up fast enough and a market of selling that surplus to companies that have empty racks in their own datacenter is real. And growing. But don't talk about it or else ;)

· Public

Replies

Jan Wildeboer 😷:krulorange: @jwildeboer@social.wildeboer.net

Remember that most of these new data centres are built by shell companies, tasked or created by bigger ones like Microsoft, Oracle or Google and these shell companies are growing more and more desperate for cashflow to serve the promises given to investors. It's a weird world out there, once you dig deeper ;)

· Public

Jan Wildeboer 😷:krulorange: @jwildeboer@social.wildeboer.net

If you are a journalist and want the official version from me as a Red Hat Spokesperson, feel free to contact me via DM or on my Red Hat email address. I'll add even more :)

· Public