Data Center Knowledge: How Chiplets Could Transform Server Design, And Data Centers
Chiplets are reshaping CPU design, enabling data centers to do more without increasing space or power consumption.
Chiplets are small modular pieces of silicon that can be combined to build processors, replacing the traditional approach of manufacturing CPUs as single large pieces. Instead of one monolithic die, chipmakers can now assemble multiple smaller dies optimized for specific functions like compute, input/output, cache, or AI acceleration. For data centers, chiplets could enable servers to deliver more processing power without increasing physical size or power consumption proportionally, potentially allowing operators to support heavier workloads within existing facilities. The technology may also reduce manufacturing costs and supply chain delays while enabling more specialized server designs tailored to specific workloads like AI or analytics.
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on Maven
Microsoft will make its in-house Azure Maia chips the main AI inference system across its products starting in 2027, deploying them at multi-gigawatt scale. The upcoming Maia 300 should deliver 40 percent more tokens per megawatt than leading GPU systems. CEO Satya Nadella calls it "our biggest bet yet on our own silicon." The article Microsoft plans to scale its own Maia AI chips to gigawatt levels by 2027 appeared first on The Decoder.

NVIDIA RTX Spark is a new beginning for the PC — a reinvention combining the capabilities of a gaming PC, a creative studio and a personal AI supercomputer into a single superchip. With up to 128GB of unified memory and 1 petaflop of AI compute, RTX Spark delivers the full stack of NVIDIA RTX and CUDA technologies for creators, developers and gamers, while unlocking a new paradigm in personal computing via powerful local AI agents. Last week, NVIDIA and Microsoft announced that RTX Spark laptops

Data from a16z shows a Jevons paradox in the AI market: token prices keep falling, but H100 GPU rental prices hold steady or climb. Cheaper AI drives demand faster than costs drop. If that demand flattens, the chain from chip makers to cloud providers takes a hit. The article Cheaper AI tokens are driving more demand, and that's Jensen Huang's best-case scenario appeared first on The Decoder.

Microsoft’s Maia 300 chip. | Image: Microsoft Microsoft is announcing its third-generation Maia in-house AI chip today, designed to be the "primary AI inference system" for Microsoft's products and services. Maia 300 not only improves the cost and efficiency of running AI workloads in the cloud, it's also more capable of handling the latest reasoning models and agentic tasks. Maia 300 will start being rolled out to production in 2027, and it has been designed with efficiency in

Ukrainian drone strikes have knocked out two of five data centers belonging to the Russian tech giant Yandex. The damage has left Yandex, known as “Russia’s Google” because it operates the country’s most popular search engine, struggling to maintain its AI chatbot and other online services. The Ukrainian drones struck Yandex data centers in the Sasovo and Kaluga regions of Russia on October 8 and October 9, according to Reuters. Those actions came as a direct response to a Russian drone strike c

Amazon says it will stop using NDAs when negotiating data center deals with local governments, following a similar move from Microsoft earlier this year. Secrecy has fueled community backlash against AI infrastructure, with opposition leading to hundreds of proposed and enacted moratoriums from New York to San Francisco. Meanwhile, a wave of startups is betting that consumers will hand AI agents access […]