OpenAI scales Habitat storage to serve over 1 billion ChatGPT users
OpenAI: Rapidly scaling online storage to serve over 1 billion ChatGPT users (Part II)
Learn how OpenAI scaled Habitat with reliable multi-tenancy, global caching, and Azure Cosmos DB to deliver 12× faster reads for ChatGPT.
Get smart on it
OpenAI describes how it scaled its online storage platform, called Habitat, to serve over 1 billion users across 40 geographic regions by optimizing its use of Azure Cosmos DB. The platform needed to respond in milliseconds while supporting explosive growth in new use cases, which required rethinking fundamental design decisions about whether to use single-tenant or multi-tenant database architecture. OpenAI cycled through different approaches, initially relying on Azure Cosmos DB's built-in limits, then attempting single-tenant containers, before settling on a multi-tenant model with data movement capabilities to handle issues like hot keys and resource contention. The storage platform now manages over 500 petabytes of data and serves as the underlying infrastructure for multiple OpenAI products that need fast and reliable access to information.
Relevant courses
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on MavenRelated news
OpenAI models are coming to Google Cloud
OpenAI and Google Cloud are bringing frontier models and Codex workflows to Gemini’s Model Garden, available through Google Cloud Marketplace.
Also reported by Ars Technica, The Decoder and SiliconANGLE
Uber brings ChatGPT Work to all employees with OpenAI
Uber is rolling out ChatGPT Work to more than 30,000 employees, helping teams research, analyze data, create presentations, and complete complex workflows.
Also reported by TechCrunch
Claude Duet app is Anthropic’s bet on agents
Claude Duet is available through waitlist for Pro and Max plan users
Also reported by The Verge and SiliconANGLE
1Password lets AI agents use your passwords without seeing them
1Password is introducing a new feature that allows AI agents to sign into your accounts without actually seeing or handling your passwords. The aptly named 1Password for Agents doesn't give bots free reign to access all of your connected accounts - you'll still need to grant approval for sign-in requests - but should make it less cumbersome to use Agents for tasks that require them to log into various services. "Agents are starting to do real work on our behalf. The old model w
Also reported by TechCrunch
Zoom’s next act: From video company to AI data platform
Since its launch, Zoom has been defined by one word: video. Customers, consumers, investors and competitors have long known Zoom as the industry’s easiest-to-use and best video platform. However, even before the pandemic, the company had been evolving into something much bigger than the unified-communications-as-a-service and contact-center-as-a-service buckets that analyst firms put it in. Those […] The post Zoom’s next act: From video company to AI data platform appeared firs
Agentic AI Foundation adds four more open-source AI tools
The Agentic AI Foundation, a consortium that maintains open-source artificial intelligence tools, today took four new projects under its wing. The technologies were donated by OpenAI Group PBC, Anthropic PBC, Hugging Face Inc. and Alibaba Group Holding Ltd. They bring the total number of projects maintained by the AAIF to 10. That’s up from the […] The post Agentic AI Foundation adds four more open-source AI tools appeared first on SiliconANGLE.