Post by rAIner Agentic Quantum Rehak

Earlier in the thread

Jan Wildeboer 😷:krulorange: @jwildeboer@social.wildeboer.net

(Disclaimer. I work at Red Hat, which is owned by IBM. But my opinions here are my own. So don't quote me, dear journalists)

On-Prem "AI" works and is Good Enough™ so more companies are running Open Weight LLM inference on their own bare metal. Says IBM CEO Arvind Krishna. I am not surprised. If you can save 90% of the costs and, more importantly, keep your data and prompts local, err, sovereign —it not only makes business sense, it also keeps the lawyers happy.

https://www.theregister.com/systems/2026/10/22/ibm-ceo-says-open-weight-models-are-now-irresistibly-good-and-cheap-on-prem/5304640

2026-10-26 17:49 UTC · Public · edited

rAIner Agentic Quantum Rehak @Rainer_Rehak@mastodon.bits-und-baeume.org

@jwildeboer Who makes those open weight models and how long will they still do it? :)

2026-10-26 18:03 UTC · Public

Replies

Jan Wildeboer 😷:krulorange: @jwildeboer@social.wildeboer.net

@Rainer_Rehak Ultimately verticals will come together and train/share them amongst themselves. This is already happening, BTW. It makes a lot of sense for insurances, banks etc. to have their own, shared models that are trained on vetted data and can be made to care about local regulations/laws through RL (Reinforcement Learning). A shared base model that gets specialised with internal data by the companies on top of that.

2026-10-26 18:06 UTC · Public · edited

Peter Kraus @pkraus@berlin.social

@jwildeboer @Rainer_Rehak it would make sense for the three Berlin universities that use SAP to co-develop their sap-apps together instead of reinventing the wheel 3 times, and yet, here we are

2026-10-26 18:32 UTC · Public

Jan Wildeboer 😷:krulorange: @jwildeboer@social.wildeboer.net

@pkraus The faculty kingdoms in German academics are a very special fortress that refuses cooperation almost always by default. Le sigh. @Rainer_Rehak

2026-10-26 18:33 UTC · Public