2 Sources
[1]
Hailo launches Hailo-10H chip with support for generative AI at the edge - SiliconANGLE
Hailo launches Hailo-10H chip with support for generative AI at the edge Artificial intelligence chip startup Hailo Technologies Ltd. today announced the commercial release of the Hailo-10H, its second-generation AI accelerator featuring powerful generative AI capabilities. The Hailo-10H introduces new on-device capabilities that include large language models, vision-language models and other generative architectures without relying on cloud connectivity. The new AI chip builds on the success of the company's previous Hailo-8 processor that was focused on vision AI tasks. The new chip adds support for generative AI while retaining the same power-efficient design optimized for edge environments. The Hailo-10H has a typical power draw of just 2.5 watts and allows for sophisticated AI applications in products ranging from personal devices and smart home systems to automotive and telecom infrastructure. "With the Hailo-10H now available for order, we're taking another major step toward our mission of making AI accessible to all," said Orr Danon, chief executive officer and co-founder of Hailo. "This is the first discrete AI processor to bring real generative AI performance to the edge, combining high efficiency, cost-effectiveness and a robust software ecosystem." The Hailo-10H is fully compatible with Hailo's existing software stack and benefits from the support of a global developer community that has more than 10,000 users each month. The chip allows developers to run state-of-the-art vision and generative AI models directly on edge devices, delivering real-time responsiveness with ultra-low latency. It also allows for real-time deployment of AI models with ultra-low latency, achieving first-token generation in under a second and processing more than 10 tokens per second on 2B parameter models. In video use cases, it delivers state-of-the-art performance with 4K object detection using models like YOLOv11m. By enabling local processing, according to Hailo, the chip improves data privacy and reduce dependency on cloud-based AI services, which also helps cut operational costs. It's automotive-qualified to AEC-Q100 Grade 2 standards and is targeted for 2026 production in automotive systems such as cockpit displays and driver monitoring units. Halio is a venture capital-backed startup that has raised $564 million over nine rounds, including $136 million in October 2021. Investors in the company include SKC Co. Ltd., 5AM Ventures LP, Versant Ventures LP, GPB Capital Holdings, Reedland Capital Partners and Mitsubishi UFJ Capital Co. Ltd.
[2]
Nvidia Rival Hailo Launches GenAI Chip For Edge Devices
Among the companies adopting the Hailo-10H is HP Inc., which is using the chip as the basis for the HP AI Accelerator M.2 Card that can integrate "seamlessly" with HP point-point sale services as well as HP workstations and commercial PCs. Nvidia rival Hailo on Tuesday announced the general availability of its second-generation AI accelerator chip, saying that the product is the first of its kind to "bring real generative AI performance to the edge" while consuming very little energy. Hailo, an Israel-based AI chip startup, said the Hailo-10H chip is capable of 40 trillion operations per second (TOPS) of 4-bit integer (INT4) performance and 20 TOPS of 8-bit integer (INT8) performance using 2.5 watts. By contrast, Nvidia's Jetson Orin Nano chips can hit up to 67 TOPS of INT8, which is double the size of INT4, but has a power range of 7-25 watts. [Related: 7 New, Cutting-Edge AI Chips From Nvidia And Rivals In 2025] Designed for edge devices across consumer, enterprise and automotive markets, the Hailo-10H combines "high efficiency, cost-effectiveness and a robust software ecosystem," which is backed by its "mature and widely adopted software stack" that's used by more than 10,000 monthly users, according to the startup. Among the companies adopting the Hailo-10H is HP Inc., which is using the chip as the basis for the HP AI Accelerator M.2 Card that can integrate "seamlessly" with HP point-point sale services as well as HP workstations and commercial PCs. The startup said the Hailo-10H can enable advanced use cases like natural language human-machine interaction, visual awareness and multi-modal AI to run seamlessly within the power and cost constraints typical of edge environments." In performance benchmarks conducted by Hailo, the chip was shown to achieve a "first-token latency of under 1 second and over 10 tokens per second" on various 2-billion-parameter language and vision-language models, according to the startup. Hailo, which is among several AI chip startups challenging Nvidia, works with a wide range of partners, from OEMs such as HP, Dell and Advantech to distributors like J-Squared Technologies and Kaga Fei America, among others. Founded in 2017, the startup has raised more than $340 million from investors, which includes $120 million for a Series C extension round it announced last year.
Share
Copy Link
Hailo Technologies Ltd. has launched the Hailo-10H, a second-generation AI accelerator chip that brings generative AI capabilities to edge devices with high efficiency and low power consumption.
Hailo Technologies Ltd., an Israel-based AI chip startup, has announced the commercial release of its second-generation AI accelerator, the Hailo-10H. This new chip marks a significant advancement in edge AI technology, bringing powerful generative AI capabilities to edge devices without relying on cloud connectivity 1.
Source: CRN
The Hailo-10H boasts impressive specifications, delivering 40 trillion operations per second (TOPS) of 4-bit integer (INT4) performance and 20 TOPS of 8-bit integer (INT8) performance while consuming only 2.5 watts of power 2. This level of efficiency positions the Hailo-10H as a formidable competitor in the AI chip market, particularly when compared to offerings from industry giants like Nvidia.
In benchmark tests, the chip demonstrated remarkable capabilities, achieving a first-token latency of under 1 second and processing over 10 tokens per second on 2-billion-parameter language and vision-language models 2. For video applications, it delivers state-of-the-art performance with 4K object detection using models like YOLOv11m 1.
The Hailo-10H is designed to support a wide range of AI applications across various sectors:
The chip enables advanced use cases such as natural language human-machine interaction, visual awareness, and multi-modal AI within the power and cost constraints typical of edge environments 2.
HP Inc. has already adopted the Hailo-10H for its AI Accelerator M.2 Card, which can integrate seamlessly with HP point-of-sale services, workstations, and commercial PCs 2. This early adoption by a major tech company signals strong potential for the Hailo-10H in the market.
Hailo works with a diverse range of partners, including OEMs like Dell and Advantech, as well as distributors such as J-Squared Technologies and Kaga Fei America 2.
Source: SiliconANGLE
Founded in 2017, Hailo has quickly established itself as a notable player in the AI chip industry. The company has raised significant funding, with reports varying between $340 million 2 and $564 million 1 across multiple rounds. Key investors include SKC Co. Ltd., 5AM Ventures LP, Versant Ventures LP, and Mitsubishi UFJ Capital Co. Ltd 1.
The release of the Hailo-10H represents a significant step in Hailo's mission to make AI accessible to all, as stated by CEO and co-founder Orr Danon 1. By enabling local processing, the chip not only improves data privacy but also reduces dependency on cloud-based AI services, potentially cutting operational costs for businesses implementing edge AI solutions.
As the first discrete AI processor to bring real generative AI performance to the edge, the Hailo-10H could potentially disrupt the market, challenging established players like Nvidia. With its combination of high efficiency, cost-effectiveness, and robust software ecosystem, Hailo is well-positioned to capitalize on the growing demand for edge AI solutions across various industries.
A thriving black market for Nvidia's advanced AI chips has emerged in China, with at least $1 billion worth of processors smuggled into the country despite US export restrictions. The situation highlights the challenges in enforcing tech export controls and the high demand for cutting-edge AI hardware in China.
12 Sources
Technology
2 hrs ago
12 Sources
Technology
2 hrs ago
OpenAI is preparing to release its next-generation AI model, GPT-5, as early as August 2025. This highly anticipated launch promises enhanced capabilities and a unified approach to AI tasks.
7 Sources
Technology
1 hr ago
7 Sources
Technology
1 hr ago
Google introduces 'Web Guide', an AI-driven feature that reorganizes search results into thematic groups, potentially changing how users interact with search engines.
8 Sources
Technology
2 hrs ago
8 Sources
Technology
2 hrs ago
Google reports significant growth in AI-powered features across its products, with AI Overviews reaching 2 billion monthly users and Gemini app hitting 450 million users. The company processes 980 trillion monthly tokens, showcasing the increasing adoption of AI technologies.
6 Sources
Technology
18 hrs ago
6 Sources
Technology
18 hrs ago
Walmart announces the rollout of AI-powered 'super agents' to enhance customer experience, streamline operations, and boost e-commerce growth, aiming to compete with Amazon in the AI-driven retail landscape.
6 Sources
Technology
10 hrs ago
6 Sources
Technology
10 hrs ago