AI chips

report:-sam-altman-seeking-trillions-for-ai-chip-fabrication-from-uae,-others

Report: Sam Altman seeking trillions for AI chip fabrication from UAE, others

chips ahoy —

WSJ: Audacious $5-$7 trillion investment would aim to expand global AI chip supply.

WASHINGTON, DC - JANUARY 11: OpenAI Chief Executive Officer Sam Altman walks on the House side of the U.S. Capitol on January 11, 2024 in Washington, DC. Meanwhile, House Freedom Caucus members who left a meeting in the Speakers office say that they were talking to the Speaker about abandoning the spending agreement that Johnson announced earlier in the week. (Photo by Kent Nishimura/Getty Images)

Enlarge / OpenAI Chief Executive Officer Sam Altman walks on the House side of the US Capitol on January 11, 2024, in Washington, DC. (Photo by Kent Nishimura/Getty Images)

Getty Images

On Thursday, The Wall Street Journal reported that OpenAI CEO Sam Altman is in talks with investors to raise as much as $5 trillion to $7 trillion for AI chip manufacturing, according to people familiar with the matter. The funding seeks to address the scarcity of graphics processing units (GPUs) crucial for training and running large language models like those that power ChatGPT, Microsoft Copilot, and Google Gemini.

The high dollar amount reflects the huge amount of capital necessary to spin up new semiconductor manufacturing capability. “As part of the talks, Altman is pitching a partnership between OpenAI, various investors, chip makers and power providers, which together would put up money to build chip foundries that would then be run by existing chip makers,” writes the Wall Street Journal in its report. “OpenAI would agree to be a significant customer of the new factories.”

To hit these ambitious targets—which are larger than the entire semiconductor industry’s current $527 billion global sales combined—Altman has reportedly met with a range of potential investors worldwide, including sovereign wealth funds and government entities, notably the United Arab Emirates, SoftBank CEO Masayoshi Son, and representatives from Taiwan Semiconductor Manufacturing Co. (TSMC).

TSMC is the world’s largest dedicated independent semiconductor foundry. It’s a critical linchpin that companies such as Nvidia, Apple, Intel, and AMD rely on to fabricate SoCs, CPUs, and GPUs for various applications.

Altman reportedly seeks to expand the global capacity for semiconductor manufacturing significantly, funding the infrastructure necessary to support the growing demand for GPUs and other AI-specific chips. GPUs are excellent at parallel computation, which makes them ideal for running AI models that heavily rely on matrix multiplication to work. However, the technology sector currently faces a significant shortage of these important components, constraining the potential for AI advancements and applications.

In particular, the UAE’s involvement, led by Sheikh Tahnoun bin Zayed al Nahyan, a key security official and chair of numerous Abu Dhabi sovereign wealth vehicles, reflects global interest in AI’s potential and the strategic importance of semiconductor manufacturing. However, the prospect of substantial UAE investment in a key tech industry raises potential geopolitical concerns, particularly regarding the US government’s strategic priorities in semiconductor production and AI development.

The US has been cautious about allowing foreign control over the supply of microchips, given their importance to the digital economy and national security. Reflecting this, the Biden administration has undertaken efforts to bolster domestic chip manufacturing through subsidies and regulatory scrutiny of foreign investments in important technologies.

To put the $5 trillion to $7 trillion estimate in perspective, the White House just today announced a $5 billion investment in R&D to advance US-made semiconductor technologies. TSMC has already sunk $40 billion—one of the largest foreign investments in US history—into a US chip plant in Arizona. As of now, it’s unclear whether Altman has secured any commitments toward his fundraising goal.

Updated on February 9, 2024 at 8: 45 PM Eastern with a quote from the WSJ that clarifies the proposed relationship between OpenAI and partners in the talks.

Report: Sam Altman seeking trillions for AI chip fabrication from UAE, others Read More »

report:-black-market-keeps-nvidia-chips-flowing-to-china-military,-government

Report: Black market keeps Nvidia chips flowing to China military, government

Out of control —

Unknown suppliers keep Nvidia’s most advanced chips within China’s reach.

An Nvidia H100 graphics processor chip.

Enlarge / An Nvidia H100 graphics processor chip.

China is still finding ways to skirt US export controls on Nvidia chips, Reuters reported.

A Reuters review of publicly available tender documents showed that last year dozens of entities—including “Chinese military bodies, state-run artificial intelligence research institutes, and universities”—managed to buy “small batches” of restricted Nvidia chips.

The US has been attempting to block China from accessing advanced chips needed to achieve AI breakthroughs and advance modern military technologies since September 2022, citing national security risks.

Reuters’ report shows just how unsuccessful the US effort has been to completely cut off China, despite repeated US attempts to expand export controls and close any loopholes discovered over the past year.

China’s current suppliers remain “largely unknown,” but Reuters confirmed that “neither Nvidia” nor its approved retailers counted “among the suppliers identified.”

An Nvidia spokesperson told Reuters that the company “complies with all applicable export control laws and requires its customers to do the same.”

“If we learn that a customer has made an unlawful resale to third parties, we’ll take immediate and appropriate action,” Nvidia’s spokesperson said.

It’s also still unclear how suppliers are procuring the chips, which include Nvidia’s most powerful chips, the A100 and H100, in addition to slower modified chips developed just for the Chinese market, the A800 and H800. The former chips were among the first banned, while the US only began restricting the latter chips last October.

Among military and government groups purchasing chips were two top universities that the US Department of Commerce has linked to China’s principal military force, the People’s Liberation Army, and labeled as a threat to national security. Last May, the Harbin Institute of Technology purchased six Nvidia A100 chips to “train a deep-learning model,” and in December 2022, the University of Electronic Science and Technology of China purchased one A100 for purposes so far unknown, Reuters reported.

Other entities purchasing chips include Tsinghua University—which is seemingly gaining the most access, purchasing “some 80 A100 chips since the 2022 ban”—as well as Chongqing University, Shandong Chengxiang Electronic Technology, and “one unnamed People’s Liberation Army entity based in the city of Wuxi, Jiangsu province.”

In total, Reuters reviewed more than 100 tenders showing state entities purchasing A100 chips and dozens of tenders documenting A800 purchases. Purchases include “brand new” chips and have been made as recently as this month.

Most of the chips purchased by Chinese entities are being used for AI, Reuters reported. None of the purchasers or suppliers provided comments in Reuters’ report.

Nvidia’s highly sought-after chips are graphic processing units capable of crunching large amounts of data at the high speeds needed to fuel AI systems. For now, these chips remain irreplaceable to Chinese firms hoping to compete globally, as well as nationally, with China’s dominant technology players, such as Huawei, Reuters suggested.

While the “small batches” of chips found indicate that China could still be accessing enough Nvidia chips to enhance “existing AI models,” Reuters pointed out that US curbs are effectively stopping China from bulk-ordering chips at quantities needed to develop new AI systems. Running a “model similar to OpenAI’s GPT would require more than 30,000 Nvidia A100 cards,” research firm TrendForce reported last March.

For China, which has firmly opposed the US export controls every step of the way, these curbs remain a persistent problem despite maintaining access through the burgeoning black market. On Monday, a Bloomberg report flagged the “steepest drop” in the value of China chip imports ever recorded, falling by more than 15 percent.

China’s black market for AI chips

The US still must confront whether it’s possible to block China from accessing advanced chips without other allied nations joining the effort by lobbying their own export controls.

In October 2022, a senior US official warned that without more cooperation, US curbs will “lose effectiveness over time.” A former top Commerce Department official, Kevin Wolf, told The Wall Street Journal last year that it’s “insanely difficult to enforce” US export controls on transactions overseas.

Part of the problem, sources told Reuters in October 2023, is that overseas subsidiaries were “easily” smuggling restricted chips into China or else providing remote access to chips to China-based employees.

On top of that activity, a black market for chips developed quickly, selling “excess stock that finds its way to the market after Nvidia ships large quantities to big US firms” or else chips imported “through companies locally incorporated in places such as India, Taiwan, and Singapore,” Reuters reported.

The US has maintained that its plan is not to ensure that China has absolutely no access but to limit access enough to keep China from getting ahead. But Nvidia CEO Jensen Huang has warned that curbs could have the opposite effect. While China finds ways to skirt the bans and acquire chips to “inspire” advancements, US companies that have been impacted by export controls restricting sales in China could lose so much revenue that they fall behind competitively, Huang predicted.

One example likely worrying to Huang and other tech firms came last November, when Huawei shocked the US government by unveiling a cutting-edge chip that seemed to prove US sanctions weren’t doing much to limit China’s ability to compete.

Report: Black market keeps Nvidia chips flowing to China military, government Read More »