Revolutionary AI Chip Developed for Decentralized Computing Without Cloud Dependency

AI chip developed for decentralized use without the cloud

A new AI chip developed at the Technical University of Munich (TUM) works without the cloud server or internet connections needed by existing chips. The AI Pro, designed by Prof Hussam Amrouch, is modelled on the human brain. Its innovative neuromorphic architecture enables it to perform calculations on the spot, ensuring full cyber security. It is also up to ten times more energy efficient. The professor of AI processor design at TUM has already had the first prototypes produced by semiconductor manufacturer Global Foundries in Dresden. Unlike conventional chips, the computing and memory units of the AI Pro are located together. This is possible because the chip applies the principle of 'hyperdimensional computing': This means that it recognizes similarities and patterns, but does not require millions of data records to learn. Instead of being shown countless images of cars, as with the deep learning method used in conventional AI chips, this chip combines various pieces of information, such as the fact that a car has four wheels, usually drives on the road, and can have different shapes. Like the new chip, explains Prof. Amrouch, 'humans also draw inferences and learn through similarities.' An important advantage of brain-like thinking: it saves energy. For the training of a sample task, the new chip consumed 24 microjoules, while comparable chips required ten to a hundred times more energy -- 'a record value,' notes Prof. Amrouch. 'This mix of modern processor architecture, algorithm specialization and innovative data processing makes the AI chip something special.' This also sets it apart from all-rounders like the chips from industry giant NVIDIA. 'While NVIDIA has built a platform that relies on cloud data and promises to solve every problem, we have developed an AI chip that enables customized solutions. There is a huge market there.' Neuromorphic chips: Modelled on the human brain The one square millimeter chip currently costs 30,000 euros. With around 10 million transistors it is not quite as densely packed or as powerful as NVIDIA chips with 200 billion transistors. But that is not Prof. Amrouch's primary concern. His team specializes in AI chips that perform the processing directly on site instead of having to send the data to the cloud to be processed along with millions of other data sets before being sent back again. This saves time and server computing capacity and reduces the carbon footprint of AI. The chips are also customized for specific applications. 'That makes them very efficient,' says chip expert Amrouch. For example, they focus on processing heartrate and other vital data collected via smartwatch or navigation data of a drone. Because this personal and sometimes sensitive data remains on board the device, issues with stable internet connections or cybersecurity do not even arise. The chip expert is convinced: 'The future belongs to the people who own the hardware.'

Brain-like thinking AI chip with 100x less energy use developed

"This mix of modern processor architecture, algorithm specialization and innovative data processing makes the AI chip something special," Amrouch said. The team stated that the AI Pro is tailored for specific applications. Its architecture tightly integrates memory and processing units, enabling real-time decision-making directly on the spot. This has vast implications for industries like healthcare, robotics, and autonomous navigation, especially in environments where internet access is unreliable or where data privacy is paramount. "That makes them very efficient," Amrouch claimed, adding that smartwatches fitted with the chip could process sensitive heart rate or blood oxygen data on the spot, eliminating the need to transmit it to external servers, while drones could analyze navigation patterns mid-flight without relying on satellite links. Because data stays local, both latency and cybersecurity risks drop dramatically. Priced at around $33,700 (€30,000), the prototype isn't ready for mass production just yet. Still, the team isn't concerned about competing with big tech companies. Their goal is to create a new kind of AI chip, one that's efficient, secure, and built for specific tasks instead of raw power.

AI chip developed for decentralized use without the cloud

A new AI chip developed at the Technical University of Munich (TUM) works without the cloud server or internet connections needed by existing chips. The AI Pro, designed by Prof Hussam Amrouch, is modeled on the human brain. Its innovative neuromorphic architecture enables it to perform calculations on the spot, ensuring full cyber security. It is also up to 10 times more energy efficient. The professor of AI processor design at TUM has already had the first prototypes produced by semiconductor manufacturer Global Foundries in Dresden. Unlike conventional chips, the computing and memory units of the AI Pro are located together. This is possible because the chip applies the principle of "hyperdimensional computing": This means that it recognizes similarities and patterns, but does not require millions of data records to learn. Instead of being shown countless images of cars, as with the deep learning method used in conventional AI chips, this chip combines various pieces of information, such as the fact that a car has four wheels, usually drives on the road, and can have different shapes. Like the new chip, explains Prof. Amrouch, "humans also draw inferences and learn through similarities." An important advantage of brain-like thinking: it saves energy. For the training of a sample task, the new chip consumed 24 microjoules, while comparable chips required 10 to 100 times more energy -- "a record value," notes Prof. Amrouch. "This mix of modern processor architecture, algorithm specialization and innovative data processing makes the AI chip something special." This also sets it apart from all-rounders like the chips from industry giant NVIDIA. "While NVIDIA has built a platform that relies on cloud data and promises to solve every problem, we have developed an AI chip that enables customized solutions. There is a huge market there." The one-square-millimeter chip currently costs 30,000 euros. With about 10 million transistors it is not quite as densely packed or as powerful as NVIDIA chips with 200 billion transistors. But that is not Prof. Amrouch's primary concern. His team specializes in AI chips that perform the processing directly on site instead of having to send the data to the cloud to be processed along with millions of other data sets before being sent back again. This saves time and server computing capacity and reduces the carbon footprint of AI. The chips are also customized for specific applications. "That makes them very efficient," says chip expert Amrouch. For example, they focus on processing heart rate and other vital data collected via smartwatch or navigation data of a drone. Because this personal and sometimes sensitive data remains on board the device, issues with stable internet connections or cybersecurity do not even arise. "The future belongs to the people who own the hardware," says Amrouch.