Jan Wildeboer 😷:krulorange:
@jwildeboer@social.wildeboer.net
(Disclaimer. I work at Red Hat, which is owned by IBM. But my opinions here are my own. So don't quote me, dear journalists)
On-Prem "AI" works and is Good Enough™ so more companies are running Open Weight LLM inference on their own bare metal. Says IBM CEO Arvind Krishna. I am not surprised. If you can save 90% of the costs and, more importantly, keep your data and prompts local, err, sovereign —it not only makes business sense, it also keeps the lawyers happy.
