Global AI Server Shipments Forecasted to Increase 40% in 2023 Amid Rising AI Demand, Says TrendForce

TrendForce predicts a dramatic surge in AI server shipments for 2023, with an estimated 1.2 million units—outfitted with GPUs, FPGAs, and ASICs—destined for markets around the world, marking a robust YoY growth of 38.4%. This increase resonates with the mounting demand for AI servers and chips, resulting in AI servers poised to constitute nearly 9% of the total server shipments, a figure projected to increase to 15% by 2026. TrendForce has revised its CAGR forecast for AI server shipments between 2022 and 2026 upwards to an ambitious 22%. Furthermore, AI chip shipments in 2023 are slated to increase by an impressive 46%.

AiThority Interview Insights: AiThority Interview with Elliott Jobe, Chief Innovation Officer and Co-Founder at Infinite Reality

AI server shipments set to soar in 2023, boosted by robust demand and NVIDIA’s market dominance. Emerging ChatBOTs and pricier GPU models like NVIDIA’s H100 & H800 expected to fuel a 50% growth surge!

TrendForce analysis indicates that NVIDIA’s GPUs currently dominate the AI server market, commanding an impressive 60–70% market share. Hot on its heels are ASIC chips, independently developed by CSPs, seizing over 20% of the market. Three crucial factors fuel NVIDIA’s market dominance: First, NVIDIA’s A100 and A800 models are sought after by both American and Chinese CSPs. Interestingly, the demand curve for 2H23 is predicted to gradually tilt towards the newer H100 and H800 models. These models carry an ASP that’s 2–2.5 times that of the A100 and A800, amplifying their allure. Furthermore, NVIDIA isn’t resting on its laurels; it’s proactively bolstering the appeal of these models through aggressive promotion of its self-developed machine solutions, such as DGX and HGX.

Read More about AiThority Interview: AiThority Interview with Dorian Selz, Co-Founder & CEO at Squirro

Second, the profitability of high-end GPUs, specifically the A100 and H100 models, plays a vital role. TrendForce research suggests that NVIDIA’s supreme positioning in the GPU market allows for a significant price variation of the H100, which could amount to a stark difference of nearly US$5,000, depending on the buyer’s purchase volume.

Lastly, the pervasive influence of ChatBOTs and AI computations is predicted to persist, expanding its footprint across various professional fields such as cloud and e-commerce services, intelligent manufacturing, financial insurance, smart healthcare, and advanced driver-assistance systems as we move into the latter half of the year. Simultaneously, there’s been a noticeable upswing in demand for AI servers—particularly cloud-based ones equipped with 4–8 GPUs and edge AI servers boasting 2–4 GPUs. TrendForce forecasts an annual growth rate surprising 50% in the shipment of AI servers armed with NVIDIA’s flagship A100 and H100 models.

TrendForce reports that HBM, a high-speed RAM interface deployed in advanced GPUs, is poised for a significant uptick in demand. The forthcoming H100 GPU from NVIDIA, slated for release this year, is equipped with the faster HBM3 technology. This improvement over the previous HBM2e standard amplifies the computation performance of AI server systems. As the need for cutting-edge GPUs—including NVIDIA’s A100 and H100, AMD’s MI200 and MI300, and Google’s proprietary TPU—continues to escalate, TrendForce forecasts a striking 58% YoY increase in HBM demand for 2023, with an estimated further boost of 30% expected in 2024.

 Latest AiThority Interview Insights : AiThority Interview with James Rubin, Product Manager at Google

 [To share your insights with us, please write to sghosh@martechseries.com]