This episode of Embedded Insights features a column by James Kolb, Director of Operations at hi-tequity, about the challenges of power and energy in AI Data Centers and how it impacts performance and the grid.
A recent Deloitte survey of 120 US-based power company and data center executives identified power and cooling limitations as significant barriers to AI data center growth over the next three to five years for 72% of them. Since AI workloads are demanding three to five times higher power densities than traditional data center applications, and GPU clusters require up to 100kW per rack compared to the 10-15kW typical of conventional servers, every part of embedded system design is seeing big changes.