ByteDance, the Chinese technology giant known for its popular platform TikTok, is taking significant steps to develop its own central processing units (CPUs) to bolster its artificial intelligence (AI) infrastructure. This move comes in response to the escalating prices and ongoing shortages of chips that have been impacting the tech industry globally.

Addressing AI Infrastructure Needs

As AI models increasingly demand more from CPUs, ByteDance is focusing on creating proprietary CPUs to enhance its internal operations. The company aims to deploy these custom chips in its servers and data centers, supporting a wide range of agent-based products, including its Coze platform. This strategic development underscores the industry’s shift towards ‘inference,’ where AI models are used for performing complex tasks.

ByteDance’s initiative places it alongside other major tech companies like Google, Amazon, and Microsoft, which are also exploring custom CPU solutions to manage costs and optimize performance. The company’s approach involves pursuing two chip architecture tracks: one based on SoftBank-owned Arm and another on the open-source RISC-V instruction set architecture. This dual-track strategy allows ByteDance to evaluate its options before committing to large-scale manufacturing.

Global Chip Market Challenges

The global chip market has been experiencing significant challenges, with Intel warning Chinese customers of extended delivery lead times for server CPUs. The demand for CPUs from AI firms has been so robust that Intel has sold chips it had previously written off. Similarly, AMD has reported a tight market with demand surpassing forecasts, leading to supply constraints.

ByteDance currently sources CPUs from Intel and AMD, but recent price hikes have prompted the company to accelerate its efforts to develop in-house alternatives. These price increases, ranging from 10% to 35% quarter-over-quarter, reflect sustained demand and increased component costs, according to industry sources.

Nvidia, traditionally known for its graphics processing units (GPUs), is also expanding into the CPU market. The company’s CEO, Jensen Huang, has introduced new central processors and AI systems, aiming to capture a share of the burgeoning $200 billion market.

While ByteDance has not publicly commented on its CPU development plans, the company’s efforts highlight the broader trend of tech giants seeking greater control over their hardware to meet specific operational needs and mitigate the impact of global supply chain disruptions.

Original reporting: Appleton, WI News Feed (HLL/CB) — read the source article.