Google Cloud and NVIDIA launch Vera Rubin instances
NVIDIA Blog: Google Cloud and NVIDIA Announce General Availability of NVIDIA Vera Rubin Infrastructure
General availability of the instances is coming next month, with planned expansion of availability to Europe — bringing an integrated platform for training, inference and large-scale reinforcement learning to cloud customers. A5X instances bring together NVIDIA Vera Rubin NVL72, NVIDIA ConnectX-9 SuperNICs, Google Cloud Virgo Network and Google Cloud’s fourth-generation advanced liquid-cooling technology for demanding agentic inference and reinforcement learning workloads at scale. Google Cloud
Get smart on it
Google Cloud and NVIDIA have made cloud computing instances with NVIDIA Vera Rubin processors generally available, starting next month with expansion to Europe. These A5X instances are designed to support agentic artificial intelligence systems and reinforcement learning, which involves training AI models through cycles of generating experience, evaluating outcomes, and updating the system. The infrastructure combines processors, networking components, and liquid-cooling technology to handle large-scale workloads, with one early customer using it to build systems that continuously improve through their own experience. Google Cloud is also offering security features called Confidential Computing to protect proprietary models and sensitive data when organizations run AI systems on cloud infrastructure they do not own.
Relevant courses
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on MavenRelated news
Hugging Face ❤️ TorchTPU: TPUs, Natively
Tighter integration between the popular open-source platform and Google's specialized processors could lower barriers for researchers training large models.
Also reported by MarkTechPost and SiliconANGLE
European Leaders Turn to NVIDIA Vera CPUs to Build Local Infrastructure
Nebius and Nscale are among global technology partners looking to NVIDIA Vera CPUs to build the next wave of infrastructure. Their momentum reflects rapid advancements in agentic computing. Agents do more than generate answers: they retrieve information, run software tools, execute code and evaluate results. Each step depends on fast CPU processing. Vera accelerates that work, helping agents respond faster and enabling data centers to make better use of computing capacity. Vera is designed to
Google Cloud Ships llm-d 1.0 With Cache-Aware Routing for TPU and GPU Fleets
Google team have released llm-d 1.0, the first stable version of its distributed inference stack. This open-source, Kubernetes-native layer turns vLLM or SGLang model servers into one coordinated pool. They released it at the PyTorch Conference North America. It targets self-hosted agent and RL workloads, where round-robin load balancing breaks down. TL;DR A serving stack: Google reports a published benchmark on a 17,000-node multi-region GKE deployment. Runs on: Kubernetes with NVID
Google has joined Amazon in attacking Nvidia’s stronghold with AI app developers
Google has joined Amazon in releasing a developer tool that makes it easy for PyTorch users to move their apps off Nvidia GPUs.
CoreWeave’s debt is becoming the whole AI industry’s problem
CoreWeave had a bad week last week. Its bonds slipped into distressed territory by a common definition - when investors demand 1,000 basis points more in yield than they'd get from government bonds. Last Tuesady Chamath "SPAC King" Palihapitiya noticed the distressed debt, and also asked whether the AI buildout was a private credit bubble. Its shares are down more than 20 percent since Tuesday's close, which is kind of a lot! There even seemed to be some collateral damage in th
Amazon is taking its biggest shot at Nvidia yet with new TorchNeuron dev tool
Amazon wants to break Nvidia’s hold on PyTorch, the free toolkit used to build most AI apps, so that more developers run their apps on alternative chips like its own.