Anthropic Quietly Releases Claude 3.5 Haiku: A Faster, More Capable AI Model

You Can Now Use the Claude 3.5 Haiku AI Model on Both Web and Mobile Apps

Anthropic says Claude 3.5 Haiku is its fastest model The 3.5 Haiku surpasses Claude 3 Opus in several benchmarks The model is optimised for AWS Trainium2 and Amazon Bedrock Anthropic has silently released the Claude 3.5 Haiku artificial intelligence (AI) model to users. On Thursday, several netizens began posting about the model's availability in Claude's web interface and mobile apps. Anthropic stated that the new generation of Haiku is the company's fastest large language model developed. Further, in several benchmarks, the foundation model also outperforms the Claude 3 Opus, the previous generation's most capable model. Notably, all Claude users will get access to the Claude 3.5 Haiku irrespective of their subscription. While the AI firm did not make any announcements regarding the release of the new Haiku model, several users on X (formerly known as Twitter) posted about its availability on both the website as well as the mobile apps. Gadgets 360 staff members were also independently able to verify that Claude 3.5 Haiku is now the default language model on the chatbot. Additionally, it is the sole model available for those on the free tier of Claude. Anthropic first announced the Claude 3.5 family of AI models in October, when the first iteration of the 3.5 Sonnet was released. At the time, the company highlighted that the 3.5 Haiku is its fastest model. Some of the upgrades in the new generations include lower latency (improved response time), improved instruction following, as well as precise tool use. For enterprises, the AI firm highlighted that Claude 3.5 Haiku excels at user-facing products, specialised sub-agent tasks, and generating personalised experiences from large volumes of data. Coming to performance, the new Haiku model scored 40.6 percent on the Software Engineering (SWE) benchmark, outperforming the first iteration of 3.5 Sonnet and OpenAI's GPT-4o. It also outperforms GPT-4o mini on the HumanEval and Graduate-Level Google-Proof Q&A (GPQA) benchmarks. Notably, earlier this month, Anthropic optimised the Claude 3.5 Haiku for the AWS Trainium2 AI chipset and added support for latency-optimised inference in Amazon Bedrock. The company is yet to add support to Google Cloud's Vertex AI. The new AI model can only generate text but accepts both text and images as input.

Anthropic's 3.5 Haiku model comes to Claude users

Anthropic has released one its newest AI models, Claude 3.5 Haiku, for users of its AI chatbot platform, Claude. Reports of 3.5 Haiku's launch in Claude began rolling in Thursday morning on social media, and TechCrunch was able to independently confirm that the model is available in Claude on the web and mobile. 3.5 Haiku, which Anthropic announced last month, matches or bests the performance of Anthropic's previous flagship model, Claude 3 Opus, on specific benchmarks. Anthropic says 3.5 Haiku is particularly well-suited for coding suggestions, data extraction and labeling, and content moderation. 3.5 Haiku can also output longer chunks of text than 3 Haiku, and the model has a more recent knowledge cutoff, meaning it can reference more recent events. 3.5 Haiku doesn't support image analysis, however -- making it less capable than Anthropic's other available models, 3 Haiku (3.5 Haiku's predecessor) and 3.5 Sonnet, in at least one respect. 3.5 Haiku become the subject of minor controversy when it arrived in Anthropic's API early last month. Anthropic previously suggested that 3.5 Haiku would cost the same as 3 Haiku, but unexpectedly changed its tune -- arguing the model's increased "intelligence" warranted a higher API cost.

Claude 3.5 Haiku now available to all users - how to try it

While the model's release was spotted by several outlets and users, Anthropic hasn't yet announced its broader release. Even Claude seems confused. The market for artificial intelligence (AI) models is especially hot at the moment, and Anthropic is taking note. Originally announced in October, 3.5 Haiku is, Anthropic says, the company's fastest model, "ideal for software teams looking to streamline their coding process and boost productivity." Other suggested use cases include data extraction, content moderation, personalization, and building chatbots that require scalable engagement. Although the release has been confirmed by several outlets and users, Claude itself seemed a bit confused about whether it was running the latest version of Haiku. When I asked, Claude stated that its sibling model, Claude 3.5 Sonnet, is the most up-to-date. In terms of benchmarks, 3.5 Haiku is comparable to Claude 3.5 Sonnet, but currently ranks below both Claude 3 Opus and 3.5 Sonnet in the Chatbot Arena. Overall, however, Haiku is reportedly cheaper and higher-quality than average, and outperforms several popular models, especially in coding. Gemini 1.5, GPT-4o, 3.5 Sonnet, and o1 are more expensive, and 3.5 Haiku is faster than Gemini 1.5, Llama 3.1 405B, and 3.5 Sonnet. The model also can be used with Artifacts, a sidebar feature launched in June that "can create and display the fully formatted results of your request in real-time and side-by-side with your conversation," as ZDNET's Lance Whitney explains. Anthropic has yet to officially announce the release. As with many free tiers for AI chatbots, users will likely experience daily messaging limits, but can upgrade to the Claude Pro plan for $20 a month (or $18 per month billed annually) if they want more usage.

Anthropic's fastest model Claude 3.5 Haiku now generally available

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More Anthropic has officially rolled out its Claude 3.5 Haiku model to all users through the Claude chatbot on the web and mobile apps, as sighted by AI power users on X. Previously limited to developers accessing it via Anthropic's API following its launch in October 2024, this smaller, faster model has garnered attention for its ability to outperform larger models on key benchmarks while maintaining a competitive price point. According to the third-party benchmarking organization Artificial Analysis, Claude 3.5 Haiku "has a lower latency compared to average, taking 0.80s to receive the first token (TTFT)," yet " is slower compared to average, with a output speed of 65.1 tokens per second." The release -- which hasn't been officially announced -- comes on the heels of major updates from Anthropic's AI rivals OpenAI and Google, which have also shipped new models to general availability in their chatbots as the year winds down, namely OpenAI's o1 and o1-mini models and Google's Gemini 2. The question for Anthropic is whether customers will be impressed enough with Claude 3.5 Haiku's performance to sign up for its Pro tier or continue using it instead of some of these other advanced and fast rivals. Claude 3.5 Haiku is accessible through the Claude Chatbot As the fastest and most cost-effective model in Anthropic's lineup, Claude 3.5 Haiku excels in real-time tasks such as processing large datasets, analyzing financial documents, and generating outputs from long-context information. It features a 200,000-token context window -- more than the 128,000 token window on OpenAI's GPT- -- allowing it to handle extensive input with ease. On the Claude chatbot, Haiku brings functionality that enhances its versatility. Users can analyze images and file attachments, making it useful for multimedia tasks and workflows involving large document sets. Haiku also integrates with Claude Artifacts, the interactive sidebar first introduced in June 2024. Artifacts provides a dedicated workspace for manipulating and refining AI-generated content in real time, including running full apps. In my test of Artifacts with Haiku this morning, it was able to code a fully playable version of Pong within less than a minute: Despite its strengths, Haiku has limitations. It does not currently support web browsing or image generation, both of which are offered by competitors like OpenAI's GPT-4o and GPT-4. Additionally, my brief test of it this morning showed it failed on the "Strawberry Test," a common user-designed challenge in which an AI must identify all three 'R's in the word strawberry. Access and subscription details Claude 3.5 Haiku is freely accessible via the Claude chatbot, but users face a variable daily message limit depending on server demand. For example, on the free tier this morning when I tried it out, I was able to perform approximately 10 exchanges (20 total messages in and out) before reaching Anthropic's quota, which resets daily. To unlock more extensive usage, users can subscribe to the Claude Pro plan, priced at $20 per month. This subscription provides up to five times the free tier's usage, priority access during high-traffic periods, early access to new features, and access to additional models like Claude 3 Opus. The pricing structure mirrors OpenAI's ChatGPT Plus subscription, offering a premium experience for power users. Performance and cost On the API, Claude 3.5 Haiku offers exceptional performance at an affordable price. Starting at $0.80 per million input tokens and $4 per million output tokens, it provides an economical solution compared to larger models like Claude 3 Opus. Developers can reduce costs further using prompt caching, which offers up to 90% savings, and the Message Batches API, which cuts costs by 50%. In benchmark testing, Haiku has surpassed many larger, publicly available models. Its performance includes a 40.6% score on SWE-bench Verified, a key coding benchmark, demonstrating its strength in tasks requiring intelligence and speed. This makes Haiku an excellent choice for user-facing applications and time-sensitive workflows. Key considerations While Claude 3.5 Haiku delivers strong capabilities, its current limitations should be considered. The lack of web browsing and image generation may make it less appealing for certain use cases compared to competitors. Furthermore, the daily message cap may be inconvenient for users who don't wish to upgrade to the Claude Pro subscription. However, with features like image and file analysis, robust coding capabilities, and integration with Artifacts, Haiku remains a powerful tool for tasks requiring speed and precision. The Artifacts feature, in particular, extends its functionality beyond text generation, enabling collaborative editing and real-time content refinement. For users ready to explore its potential, Claude 3.5 Haiku is now live and available through the Claude chatbot on web and mobile apps on iOS and Android.

Anthropic's Claude 3.5 Haiku is Finally Here | AI News

As predicted by AIM, Anthropic is officially rolling out Claude Haiku 3.5 on Claude.ai. Haiku 3.5 is the latest iteration of Anthropic's smallest and fastest model. Haiku 3.5 also surpasses Claude 3 Opus, which is Anthropic's largest model, albeit from the previous generation. However, Haiku 3.5 doesn't seem to support images as inputs yet, and Claude defaults back to Haiku 3. Haiku 3.5 is available on both the Claude web and the mobile app. The model was announced a month ago and was made available via the API on Amazon Bedrock and Google Cloud's Vertex AI. A few days ago, Anthropic also announced that they're optimising Claude 3.5 Haiku on AWS Trainium 2. "By enabling latency optimisation, Claude 3.5 Haiku can deliver up to 60% faster inference speed -- making it the ideal choice for use cases ranging from code completions to real-time content moderation and chatbots," said Anthropic in the announcement. Anthropic also lowered the price of Claude 3.5 Haiku to $0.80 per million input tokens and $4 per million output tokens. Moreover, Dario Amodei revealed a few weeks ago that there are plans to release the flagship Opus 3.5 Soon. As per reports, Anthropic has apparently finished training Claude 3.5 Opus, and 'it performed well, with it scaling appropriately'. The report also said that Anthropic did not release it because it used Claude 3.5 Opus to generate synthetic data and for reward modelling to enhance the capabilities of 3.5 Sonnet. It rings a bell, doesn't it? Amodei also said, "Scaling is continuing. There will definitely be more powerful models coming from us than the models that exist today. "Or if there aren't, we've deeply failed as a company," he added. But is Haiku 3.5 a tad bit too late? Google's latest Gemini 2.0 Flash is a small model that offers tremendous performance, even better than the flagship Gemini 1.5 Pro. Forget Haiku; the model offers close performance with Claude 3.5 Sonnet on most benchmarks. Moreover, it also offers multimodal features, including images, video, and audio, as well as multimodal outputs such as natively generated images combined with text and steerable text-to-speech (TTS) multilingual audio.