data centers

proposed-underwater-data-center-surprises-regulators-who-hadn’t-heard-about-it

Proposed underwater data center surprises regulators who hadn’t heard about it

Proposed underwater data center surprises regulators who hadn’t heard about it

BalticServers.com

Data centers powering the generative AI boom are gulping water and exhausting electricity at what some researchers view as an unsustainable pace. Two entrepreneurs who met in high school a few years ago want to overcome that crunch with a fresh experiment: sinking the cloud into the sea.

Sam Mendel and Eric Kim launched their company, NetworkOcean, out of startup accelerator Y Combinator on August 15 by announcing plans to dunk a small capsule filled with GPU servers into San Francisco Bay within a month. “There’s this vital opportunity to build more efficient computer infrastructure that we’re gonna rely on for decades to come,” Mendel says.

The founders contend that moving data centers off land would slow ocean temperature rise by drawing less power and letting seawater cool the capsule’s shell, supplementing its internal cooling system. NetworkOcean’s founders have said a location in the bay would deliver fast processing speeds for the region’s buzzing AI economy.  

But scientists who study the hundreds of square miles of brackish water say even the slightest heat or disturbance from NetworkOcean’s submersible could trigger toxic algae blooms and harm wildlife. And WIRED inquiries to several California and US agencies who oversee the bay found that NetworkOcean has been pursuing its initial test of an underwater data center without having sought, much less received, any permits from key regulators.

The outreach by WIRED prompted at least two agencies—the Bay Conservation and Development Commission and the San Francisco Regional Water Quality Control Board—to email NetworkOcean that testing without permits could run afoul of laws, according to public records and spokespeople for the agencies. Fines from the BCDC can run up to hundreds of thousands of dollars.

The nascent technology has already been in hot water in California. In 2016, the state’s coastal commission issued a previously unreported notice to Microsoft saying that the tech giant had violated the law the year before by plunging an unpermitted server vessel into San Luis Obispo Bay, about 250 miles south of San Francisco. The months-long test, part of what was known as Project Natick, had ended without apparent environmental harm by the time the agency learned of it, so officials decided not to fine Microsoft, according to the notice seen by WIRED.

The renewed scrutiny of underwater data centers has surfaced an increasingly common tension between innovative efforts to combat global climate change and long-standing environmental laws. Permitting takes months, if not years, and can cost millions of dollars, potentially impeding progress. Advocates of the laws argue that the process allows for time and input to better weigh trade-offs.

“Things are overregulated because people often don’t do the right thing,” says Thomas Mumley, recently retired assistant executive officer of the bay water board. “You give an inch, they take a mile. We have to be cautious.”

Over the last two weeks, including during an interview at the WIRED office, NetworkOcean’s founders have provided driblets of details about their evolving plans. Their current intention is to test their underwater vessel for about an hour, just below the surface of what Mendel would only describe as a privately owned and operated portion of the bay that he says is not subject to regulatory oversight. He insists that a permit is not required based on the location, design, and minimal impact. “We have been told by our potential testing site that our setup is environmentally benign,” Mendel says.

Mumley, the retired regulator, calls the assertion about not needing a permit “absurd.” Both Bella Castrodale, the BCDC’s lead enforcement attorney, and Keith Lichten, a water board division manager, say private sites and a quick dip in the bay aren’t exempt from permitting. Several other experts in bay rules tell WIRED that even if some quirk does preclude oversight, they believe NetworkOcean is sending a poor message to the public by not coordinating with regulators.

“Just because these centers would be out of sight does not mean they are not a major disturbance,” says Jon Rosenfield, science director at San Francisco Baykeeper, a nonprofit that investigates industrial polluters.

School project

Mendel and Kim say they tried to develop an underwater renewable energy device together during high school in Southern California before moving onto non-nautical pursuits. Mendel, 23, dropped out of college in 2022 and founded a platform for social media influencers.

About a year ago, he built a small web server using the DIY system Raspberry Pi to host another personal project, and temporarily floated the equipment in San Francisco Bay by attaching it to a buoy from a private boat in the Sausalito area. (Mendel declined to answer questions about permits.) After talking with Kim, also 23, about this experiment, the two decided to move in together and start NetworkOcean.

Their pitch is that underwater data centers are more affordable to develop and maintain, especially as electricity shortages limit sites on land. Surrounding a tank of hot servers with water naturally helps cools them, avoiding the massive resource drain of air-conditioning and also improving on the similar benefits of floating data centers. Developers of offshore wind farms are eager to electrify NetworkOcean vessels, Mendel says.

Proposed underwater data center surprises regulators who hadn’t heard about it Read More »

amd-signs-$4.9-billion-deal-to-challenge-nvidia’s-ai-infrastructure-lead

AMD signs $4.9 billion deal to challenge Nvidia’s AI infrastructure lead

chip wars —

Company hopes acquisition of ZT Systems will accelerate adoption of its data center chips.

Visitors walk past the AMD booth at the 2024 Mobile World Congress

AMD has agreed to buy artificial intelligence infrastructure group ZT Systems in a $4.9 billion cash and stock transaction, extending a run of AI investments by the chip company as it seeks to challenge market leader Nvidia.

The California-based group said the acquisition would help accelerate the adoption of its Instinct line of AI data center chips, which compete with Nvidia’s popular graphics processing units (GPUs).

ZT Systems, a private company founded three decades ago, builds custom computing infrastructure for the biggest AI “hyperscalers.” While the company does not disclose its customers, the hyperscalers include the likes of Microsoft, Meta, and Amazon.

The deal marks AMD’s biggest acquisition since it bought Xilinx for $35 billion in 2022.

“It brings a thousand world-class design engineers into our team, it allows us to develop silicon and systems in parallel and, most importantly, get the newest AI infrastructure up and running in data centers as fast as possible,” AMD’s chief executive Lisa Su told the Financial Times.

“It really helps us deploy our technology much faster because this is what our customers are telling us [they need],” Su added.

The transaction is expected to close in the first half of 2025, subject to regulatory approval, after which New Jersey-based ZT Systems will be folded into AMD’s data center business group. The $4.9bn valuation includes up to $400mn contingent on “certain post-closing milestones.”

Citi and Latham & Watkins are advising AMD, while ZT Systems has retained Goldman Sachs and Paul, Weiss.

The move comes as AMD seeks to break Nvidia’s stranglehold on the AI data center chip market, which earlier this year saw Nvidia temporarily become the world’s most valuable company as big tech companies pour billions of dollars into its chips to train and deploy powerful new AI models.

Part of Nvidia’s success stems from its “systems” approach to the AI chip market, offering end-to-end computing infrastructure that includes pre-packaged server racks, networking equipment, and software tools to make it easier for developers to build AI applications on its chips.

AMD’s acquisition shows the chipmaker building out its own “systems” offering. The company rolled out its MI300 line of AI chips last year, and says it will launch its next-generation MI350 chip in 2025 to compete with Nvidia’s new Blackwell line of GPUs.

In May, Microsoft was one of the first AI hyperscalers to adopt the MI300, building it into its Azure cloud platform to run AI models such as OpenAI’s GPT-4. AMD’s quarterly revenue for the chips surpassed $1 billion for the first time in the three months to June 30.

But while AMD has feted the MI300 as its fastest-ever product ramp, its data center revenue still represented a fraction of the $22.6 billion that Nvidia’s data center business raked in for the quarter to the end of April.

In March, ZT Systems announced a partnership with Nvidia to build custom AI infrastructure using its Blackwell chips. “I think we certainly believe ZT as part of AMD will significantly accelerate the adoption of AMD AI solutions,” Su said, but “we have customer commitments and we are certainly going to honour those”.

Su added that she expected regulators’ review of the deal to focus on the US and Europe.

In addition to increasing its research and development spending, AMD says it has invested more than $1 billion over the past year to expand its AI hardware and software ecosystem.

In July the company announced it was acquiring Finnish AI start-up Silo AI for $665 million, the largest acquisition of a privately held AI startup in Europe in a decade.

© 2024 The Financial Times Ltd. All rights reserved. Please do not copy and paste FT articles and redistribute by email or post to the web.

AMD signs $4.9 billion deal to challenge Nvidia’s AI infrastructure lead Read More »

data-centers-demand-a-massive-amount-of-energy-here’s-how-some-states-are-tackling-the-industry’s-impact.

Data centers demand a massive amount of energy. Here’s how some states are tackling the industry’s impact.

rethinking incentives —

States that offer tax exemptions to support the industry are reconsidering their approach.

A Google data center in Douglas County, Georgia.

A Google data center in Douglas County, Georgia.

This article was produced for ProPublica’s Local Reporting Network in partnership with The Seattle Times. Sign up for Dispatches to get stories like this one as soon as they are published.

When lawmakers in Washington set out to expand a lucrative tax break for the state’s data center industry in 2022, they included what some considered an essential provision: a study of the energy-hungry industry’s impact on the state’s electrical grid.

Gov. Jay Inslee vetoed that provision but let the tax break expansion go forward. As The Seattle Times and ProPublica recently reported, the industry has continued to grow and now threatens Washington’s effort to eliminate carbon emissions from electricity generation.

Washington’s experience with addressing the power demand of data centers parallels the struggles playing out in other states around the country where the industry has rapidly grown and tax breaks are a factor.

Virginia, home to the nation’s largest data center market, once debated running data centers on carbon-emitting diesel generators during power shortages to keep the lights on in the area. (That plan faced significant public pushback from environmental groups, and an area utility is exploring other options.)

Dominion Energy, the utility that serves most of Virginia’s data centers, has said that it intends to meet state requirements to decarbonize the grid by 2045, but that the task would be more challenging with rising demands driven largely by data centers, Inside Climate News reported. The utility also has indicated that new natural gas plants will be needed.

Some Virginia lawmakers and the state’s Republican governor have proposed reversing or dramatically altering the clean energy goals.

A northern Virginia lawmaker instead proposed attaching strings to the state’s data center tax break. This year, he introduced legislation saying data centers would only qualify if they maximized energy efficiency and found renewable resources. The bill died in Virginia’s General Assembly. But the state authorized a study of the industry and how tax breaks impact the grid.

“If we’re going to have data centers, which we all know to be huge consumers of electricity, let’s require them to be as efficient as possible,” said state Delegate Richard “Rip” Sullivan Jr., the Democrat who sponsored the original bill. “Let’s require them to use as little energy as possible to do their job.”

Inslee’s 2022 veto of a study similar to Virginia’s cited the fact that Northwest power planners already include data centers in their estimates of regional demand. But supporters of the legislation said their goal was to obtain more precise answers about Washington-specific electricity needs.

Georgia lawmakers this year passed a bill to halt the state’s data center tax break until data center power use could be analyzed. In the meantime, according to media reports, the state’s largest utility said it would use fossil fuels to make up an energy shortfall caused in part by data centers. Georgia Gov. Brian Kemp then vetoed the tax break pause in May.

Lawmakers in Connecticut and South Carolina have also debated policies to tackle data center power usage in the past year.

“Maybe we want to entice more of them to come. I just want to make sure that we understand the pros and the cons of that before we do it,” South Carolina’s Senate Majority Leader Shane Massey said in May, according to the South Carolina Daily Gazette.

Countries such as Ireland, Singapore, and the Netherlands have at times forced data centers to halt construction to limit strains on the power grid, according to a report by the nonprofit Tony Blair Institute for Global Change. The report’s recommendations for addressing data center power usage include encouraging the private sector to invest directly in renewables.

Sajjad Moazeni, a University of Washington professor who studies artificial intelligence and data center power consumption, said states should consider electricity impacts when formulating data center legislation. Moazeni’s recent research found that in just one day, ChatGPT, a popular artificial intelligence tool, used roughly as much power as 33,000 U.S. households use in a year.

“A policy can help both push companies to make these data centers more efficient and preserve a cleaner, better environment for us,” Moazeni said. “Policymakers need to consider a larger set of metrics on power usage and efficiency.”

Eli Sanders contributed research while a student with the Technology, Law and Public Policy Clinic at the University of Washington School of Law.

Data centers demand a massive amount of energy. Here’s how some states are tackling the industry’s impact. Read More »

google’s-greenhouse-gas-emissions-jump-48%-in-five-years

Google’s greenhouse gas emissions jump 48% in five years

computationally intensive means energy intensive —

Google’s 2030 “Net zero” target looks increasingly doubtful as AI use soars.

Cooling pipes at a Google data center in Douglas County, Georgia.

Cooling pipes at a Google data center in Douglas County, Georgia.

Google’s greenhouse gas emissions have surged 48 percent in the past five years due to the expansion of its data centers that underpin artificial intelligence systems, leaving its commitment to get to “net zero” by 2030 in doubt.

The Silicon Valley company’s pollution amounted to 14.3 million tonnes of carbon equivalent in 2023, a 48 percent increase from its 2019 baseline and a 13 percent rise since last year, Google said in its annual environmental report on Tuesday.

Google said the jump highlighted “the challenge of reducing emissions” at the same time as it invests in the build-out of large language models and their associated applications and infrastructure, admitting that “the future environmental impact of AI” was “complex and difficult to predict.”

Chief Sustainability Officer Kate Brandt said the company remained committed to the 2030 target but stressed the “extremely ambitious” nature of the goal.

“We do still expect our emissions to continue to rise before dropping towards our goal,” said Brandt.

She added that Google was “working very hard” on reducing its emissions, including by signing deals for clean energy. There was also a “tremendous opportunity for climate solutions that are enabled by AI,” said Brandt.

As Big Tech giants including Google, Amazon, and Microsoft have outlined plans to invest tens of billions of dollars into AI, climate experts have raised concerns about the environmental impacts of the power-intensive tools and systems.

In May, Microsoft admitted that its emissions had risen by almost a third since 2020, in large part due to the construction of data centers. However, Microsoft co-founder Bill Gates last week also argued that AI would help propel climate solutions.

Meanwhile, energy generation and transmission constraints are already posing a challenge for the companies seeking to build out the new technology. Analysts at Bernstein said in June that AI would “double the rate of US electricity demand growth and total consumption could outstrip current supply in the next two years.”

In Tuesday’s report, Google said its 2023 energy-related emissions—which come primarily from data center electricity consumption—rose 37 percent year on year and overall represented a quarter of its total greenhouse gas emissions.

Google’s supply chain emissions—its largest chunk, representing 75 percent of its total emissions—also rose 8 percent. Google said they would “continue to rise in the near term” as a result in part of the build-out of the infrastructure needed to run AI systems.

Google has pledged to achieve net zero across its direct and indirect greenhouse gas emissions by 2030 and to run on carbon-free energy during every hour of every day within each grid it operates by the same date.

However, the company warned in Tuesday’s report that the “termination” of some clean energy projects during 2023 had pushed down the amount of renewables it had access to.

Meanwhile, the company’s data center electricity consumption had “outpaced” Google’s ability to bring more clean power projects online in the US and Asia-Pacific regions.

Google’s data center electricity consumption increased 17 percent in 2023, and amounted to approximately 7-10 percent of global data center electricity consumption, the company estimated. Its data centers also consumed 17 percent more water in 2023 than during the previous year, Google said.

© 2024 The Financial Times Ltd. All rights reserved. Not to be redistributed, copied, or modified in any way.

Google’s greenhouse gas emissions jump 48% in five years Read More »

us-gov’t-announces-arrest-of-former-google-engineer-for-alleged-ai-trade-secret-theft

US gov’t announces arrest of former Google engineer for alleged AI trade secret theft

Don’t trade the secrets dept. —

Linwei Ding faces four counts of trade secret theft, each with a potential 10-year prison term.

A Google sign stands in front of the building on the sidelines of the opening of the new Google Cloud data center in Hesse, Hanau, opened in October 2023.

Enlarge / A Google sign stands in front of the building on the sidelines of the opening of the new Google Cloud data center in Hesse, Hanau, opened in October 2023.

On Wednesday, authorities arrested former Google software engineer Linwei Ding in Newark, California, on charges of stealing AI trade secrets from the company. The US Department of Justice alleges that Ding, a Chinese national, committed the theft while secretly working with two China-based companies.

According to the indictment, Ding, who was hired by Google in 2019 and had access to confidential information about the company’s data centers, began uploading hundreds of files into a personal Google Cloud account two years ago.

The trade secrets Ding allegedly copied contained “detailed information about the architecture and functionality of GPU and TPU chips and systems, the software that allows the chips to communicate and execute tasks, and the software that orchestrates thousands of chips into a supercomputer capable of executing at the cutting edge of machine learning and AI technology,” according to the indictment.

Shortly after the alleged theft began, Ding was offered the position of chief technology officer at an early-stage technology company in China that touted its use of AI technology. The company offered him a monthly salary of about $14,800, plus an annual bonus and company stock. Ding reportedly traveled to China, participated in investor meetings, and sought to raise capital for the company.

Investigators reviewed surveillance camera footage that showed another employee scanning Ding’s name badge at the entrance of the building where Ding worked at Google, making him look like he was working from his office when he was actually traveling.

Ding also founded and served as the chief executive of a separate China-based startup company that aspired to train “large AI models powered by supercomputing chips,” according to the indictment. Prosecutors say Ding did not disclose either affiliation to Google, which described him as a junior employee. He resigned from Google on December 26 of last year.

The FBI served a search warrant at Ding’s home in January, seizing his electronic devices and later executing an additional warrant for the contents of his personal accounts. Authorities found more than 500 unique files of confidential information that Ding allegedly stole from Google. The indictment says that Ding copied the files into the Apple Notes application on his Google-issued Apple MacBook, then converted the Apple Notes into PDF files and uploaded them to an external account to evade detection.

“We have strict safeguards to prevent the theft of our confidential commercial information and trade secrets,” Google spokesperson José Castañeda told Ars Technica. “After an investigation, we found that this employee stole numerous documents, and we quickly referred the case to law enforcement. We are grateful to the FBI for helping protect our information and will continue cooperating with them closely.”

Attorney General Merrick Garland announced the case against the 38-year-old at an American Bar Association conference in San Francisco. Ding faces four counts of federal trade secret theft, each carrying a potential sentence of up to 10 years in prison.

US gov’t announces arrest of former Google engineer for alleged AI trade secret theft Read More »