Post by Jan Wildeboer 😷:krulorange:

(Disclaimer. I work at Red Hat, which is owned by IBM. But my opinions here are my own. So don't quote me, dear journalists)

On-Prem "AI" works and is Good Enough™ so more companies are running Open Weight LLM inference on their own bare metal. Says IBM CEO Arvind Krishna. I am not surprised. If you can save 90% of the costs and, more importantly, keep your data and prompts local, err, sovereign —it not only makes business sense, it also keeps the lawyers happy.

https://www.theregister.com/systems/2026/10/22/ibm-ceo-says-open-weight-models-are-now-irresistibly-good-and-cheap-on-prem/5304640

@jwildeboer Who makes those open weight models and how long will they still do it? :)

@Rainer_Rehak Ultimately verticals will come together and train/share them amongst themselves. This is already happening, BTW. It makes a lot of sense for insurances, banks etc. to have their own, shared models that are trained on vetted data and can be made to care about local regulations/laws through RL (Reinforcement Learning). A shared base model that gets specialised with internal data by the companies on top of that.

@jwildeboer @Rainer_Rehak it would make sense for the three Berlin universities that use SAP to co-develop their sap-apps together instead of reinventing the wheel 3 times, and yet, here we are