Newsletters




IBM and Together AI Collaborate to Scale Open Source AI Inference


IBM announced a partnership with Together AI to deliver IBM and NVIDIA AI infrastructure.

Under a multi-year $240M agreement between IBM and Together AI, IBM is positioned to deploy a large cluster of NVIDIA HGX B300 systems on IBM Cloud with expected availability in Q1 2027, according to the companies.

Together AI will use this cluster to provide open-source model inference. This deployment is the first dedicated, large-scale cluster built for inference on IBM Cloud using HGX B300 systems and NVIDIA Spectrum-XTM Ethernet networking. According to NVIDIA, it is built to deliver 30x more AI factory output compared to prior generations.

This collaboration aims to enable Together AI to deliver better performance and token economics to enterprises as they look to efficiently scale their AI deployments. Together AI is built on the principle that open-source models are essential for the future of AI and developers should be able to build using open, modular stacks.

Together AI selected IBM with NVIDIA because of their innovative product roadmaps and their ability to deliver GPU capacity at the pace required for rapid AI scaling and lowest token cost. Building on IBM's expertise in delivering enterprise-grade cloud capabilities, this collaboration aims to help Together AI to continue its expansion into the enterprise space while making open-source AI more accessible to developers and enterprises around the world, said the companies.

"Enterprises want the performance of the best frontier models without the closed-model price tag, and that only works if the infrastructure underneath is fast and reliable at scale," said Vipul Ved Prakash, CEO at Together AI. "Working alongside IBM with NVIDIA gives us that foundation. This cluster lets us bring production-grade inference to more companies, faster, and it's a big step in our push to make open-source AI the obvious choice for enterprises."

This work is the latest example of a larger collaboration between IBM and NVIDIA, who continue to work together to advance AI across infrastructure and software, to deliver performance and efficiency for enterprise and startup clients.

"Enterprises are in a race to adopt agentic AI at scale to drive real business outcomes," said?Alan Peacock, general manager of IBM Cloud. "IBM and NVIDIA are delivering scalable, economical, enterprise-grade AI infrastructure that can help Together AI accelerate innovation for the next generation of AI infrastructure."

For more information about this news, visit www.ibm.com.


Sponsors