Ayar Labs Raises $500M to Mass-Produce Optical Chips That Connect Thousands of GPUs

Ayar Labs raises $500M to mass-produce CPO chiplets

Company aims to stitch tens of thousands of GPUs together for more efficient training and inference It's a good time to be an AI chip startup, especially if you happen to specialize in silicon photonics. On Tuesday, Nvidia-backed startup Ayar Labs raised $500 million to accelerate the mass production of its co-packaged optics (CPO) tech. The cash infusion comes a day after Nvidia said it would inject $4 billion into photonic networking providers Coherent and Lumentum ($2 billion each) to scale up their manufacturing capacity in anticipation of demand. Founded in 2015, Ayar Labs' TeraPHY chiplets provide an alternative to copper for chip-to-chip communications that's capable of supporting higher bandwidths over longer distances. Above 800 Gbps, copper interconnects are limited to a couple of meters and often require retimers to keep error rates from getting out of hand. Because of this, higher-speed copper interconnects, like those found in Nvidia's NVL72 systems, are usually constrained to the rack while pluggable optics are used for rack-to-rack communications. Pluggable optics support much longer ranges, but that reach comes at the expense of higher power consumption and latency. This is the problem that silicon photonics providers, like Ayar, are trying to address. By integrating its TeraPHY chiplets directly into the GPU or accelerator, Ayar says its designs can support significantly higher bandwidth while using a fraction of the power required by pluggables. Over the past few years, Ayar has worked to validate its tech with multiple prototypes including one built in collaboration with Intel and the Defense Advanced Research Projects Agency (DARPA). More recently, Ayar began working with Taiwanese semiconductor design services provider Global Unichip Corp (GUC) to develop reference designs based on its optical I/O chiplets. One of these reference designs was developed in collaboration with Alchip and uses eight of Ayar's next-gen TeraPHY chiplets. Combined, the company claims it can support more than 200 Tbps of aggregate bandwidth per package. For reference, that's about 5x more bandwidth than we see on Nvidia's Rubin GPUs, which top out at 28.8 Tbps (3.6 TB/s) of bidirectional bandwidth. What's more, since Ayar's interconnects are optical, the links aren't limited to a single rack. "We want to be able to scale up to 10,000 GPU dies connected in a scale-up domain, while keeping the rack power and power density to around 100kW," Ayar CTO Vladimir Stojanovic told El Reg in an exclusive interview late last year. With datacenters increasingly facing power constraints and the performance advantage of scale-up systems, like Nvidia's NVL72 or AMD's Helios, becoming clearer, it isn't surprising to see venture capitalists lining up to push photonics startups like Ayar over the finish line. In addition to scaling up high-volume production and test capacity, Ayar says the funding will enable it to expand its global operations beginning with a new office in Hsinchu, Taiwan. The $500 million Series E funding round was led by Neuberger Berman but included a whole host of investors, including MediaTek and (again) Nvidia, which dropped its first cash into the startup back in 2022, according to Pitchbook. Ayar is one of many photonics startups trying to carve out a niche for themselves. Lightmatter is another startup playing in the CPO space. Last year the company launched a photonic interposer alongside an optical I/O chiplet in a similar vein to Ayar's TeraPHY. Meanwhile, others have already found their exit. In February, IP giant Marvell Technology completed its roughly $3.25 billion acquisition of Celestial AI. ®

Nvidia-backed Ayar Labs raises $500 million at $3.75 billion valuation

March 3 (Reuters) - Nvidia-backed (NVDA.O), opens new tab Ayar Labs, which develops chips that transmit data using light, said on Tuesday it has raised $500 million in a series E round at a valuation of $3.75 billion. The latest round, which brings the company's total funding to $870 million, was led by investment firm Neuberger Berman and involved new investors including ⁠ARK Invest, Qatar Investment Authority and 1789 Capital. Chipmaker Advanced Micro Devices (AMD.O), opens new tab is among Ayar's existing backers and invested in the latest funding round. Investor appetite in the AI ecosystem has remained strong as venture and private-equity firms bet on the technology to upend traditional workflows, driving steady funding into companies building the infrastructure. Ayar's technology uses light instead of the traditionally used ⁠electrical signals, aiming to speed transmission by linking AI computing chips with memory chips, an increasingly valuable prospect as hyperscalers and governments spend hundreds of billions of dollars for achieving AI infrastructure supremacy. The ⁠company competes with firms such as Celestial AI, which raised $250  million last March, as well as Lumentum (LITE.O), opens new tab and Coherent (COHR.N), opens new tab, which received $2  billion each in investments ⁠from Nvidia on Monday. Ayar plans to use the new funds to scale production and test capacity, expand global operations, ⁠including at its new Hsinchu, Taiwan-based office and accelerate the deployment of its co-packaged optics solution. Reporting by Pragyan Kalita in Bengaluru; Editing by Shailesh Kuber and Nick Zieminski Our Standards: The Thomson Reuters Trust Principles., opens new tab

Nvidia-backed Ayar Labs raises $500 million at $3.75 billion valuation - The Economic Times

Ayar Labs, supported by Nvidia, has secured $500 million in a new funding round. This brings their total funding to $870 million. The company develops chips that use light for data transmission. This technology aims to speed up AI computing by connecting chips with memory. Ayar Labs plans to use the funds to boost production and expand globally.Nvidia-backed Ayar Labs, which develops chips that transmit data using light, said on Tuesday it has raised $500 million in a series E round at a valuation of $3.75 billion. The latest round, which brings its total ⁠funding ⁠to $870 million, was led by investment firm Neuberger Berman and involved new investors including ARK Invest, Qatar Investment Authority and 1789 Capital. Investor appetite in the AI ecosystem has remained strong as venture and private-equity firms bet on ⁠the technology to upend traditional workflows, driving steady funding into companies building the infrastructure. Ayar's technology ⁠uses light instead of the traditionally used electrical signals, aiming to speed transmission by linking AI computing chips with memory chips, an increasingly valuable prospect as hyperscalers and governments spend hundreds of billions of dollars for achieving AI infrastructure supremacy. The company competes with firms such as Celestial AI, which raised $250  million last March, as well as Lumentum and ⁠Coherent, which received $2  billion each in investments from Nvidia on Monday. Ayar plans to use the new funds to scale production and test capacity, expand global operations, including at its new Hsinchu, Taiwan-based office and accelerate the deployment of its co-packaged optics solution.