Adobe Firefly Launches AI Audio Tools: Generate Music, Speech and Sound Effects Go Live

No Mic Needed: You Can Create Music and Speech With Adobe's AI Audio Tools - CNET

Katelyn is a reporter with CNET covering artificial intelligence, including chatbots, image and video generators.... Read full bio Adobe announced Thursday that it's adding to its vast collection of artificial intelligence tools, this time with a focus on audio. The new Firefly AI tools use AI to generate speech, music and sound effects, forming "a very stable foundation" of audio options for creators, said Jay LeBoeuf, Adobe's head of AI audio. Unlike Suno or other AI music generators that can create entire songs in seconds, Adobe is offering more targeted, professional-grade tools for filmmakers, musicians and creators. Think about AI converting creators' scripts into audio to be overlaid on a TikTok video or creating custom soundtracks without worrying about copyright infringement, thanks to Adobe's universal license. "We're not trying to be somebody's wedding music here," LeBoeuf said in an interview. The goal is to build AI "tools that are useful" and address pain points in the audio creation and editing process. To use the new tools, you'll need access to Firefly, Adobe's AI hub, which may be included in your current Creative Cloud subscription, depending on your specific plan or your company's AI permissions. AI audio generations will count as generative credits, so keep an eye on how quickly you use those up. You can nab a Firefly-only subscription starting at $10 per month. AI audio that isn't robotic To create speech, upload a script you've written, and it will transform it into an audio file. You'll be able to choose from several artificial voices in a variety of genders and ages, and you can translate the audio into over 20 languages. If you have names or products that are hard for the AI to read, you can add pronunciation guidance. My last name, Chedraoui, for example, could be phonetically spelled out as "Shed-rao-wee," instead of whatever hideous sound the AI produces when pronouncing four vowels in a row. One of the biggest challenges with AI audio is making voices sound less robotic. Monotonous audio is boring to listen to, and it's a clear sign of AI. Adobe built its AI audio model to recognize and apply various emotions to its outputs. When you use Adobe's generate speech tool you can use "emotion tags" to direct the AI to apply different expressions. To help the models understand emotions, Adobe collected more emotive training material, LeBoeuf said. "Our design team knew that we were going to control them with these adjectives and these verbs. So because it's been part of the training since the get-go, we have this nice vertically integrated stack that allows for the highest quality expressiveness." Adobe's AI policy says that it only uses licensed and publicly available content and data to train its AI models. The company says it never trains on customers' work to improve its services. Copyright-friendly AI music and futuristic sound effects When generating music or soundtracks, the tools are primarily meant to create background audio -- the Firefly tunes are instrumental only -- not full AI songs (which you likely won't want to listen to anyway). You can create this background music using a Mad Libs-style fill-in-the-blank format. Choose the vibe, genre and situation you want your AI music to reflect, like a "dreamline song, with electronic, ambient style, for a video game." If you're not sure where to start, you can let Firefly do the scoring for you. Upload a video, and the AI can write a prompt and create four sample audio tracks -- up to 30 seconds long -- that might fit your video's vibe. Sound effects make up the final part of the AI audio triad and require a prompt or an uploaded recording. For example, you can upload a video where you try to create the sound effect you want. The AI will take your human voice and transform it into whatever you want, like deepening your roar to sound like a dinosaur or monster, syncing it to the video. Most importantly, all audio created by Adobe's AI is commercially safe, and the music is automatically granted a universal license. That's critical for musicians and video creators, the majority of whom have run into licensing issues before, according to a recent survey from Berklee College of Music. Social media platforms can penalize users for sharing videos that contain copyrighted music without permission. The universal license means you don't have to worry about being personally sued for copyright infringement. 'Control and agency' Adobe's new AI audio tools were first teased at last year's Adobe Max conference, where they were released in beta. Now generally available, they add to the path that Adobe has been hurtling down to integrate generative AI into every one of its flagship programs. And AI is already part of the daily work, said Mark Ethier, executive director of the Berklee Emerging Artistic Technology Lab. One in five surveyed musicians and creators use generative AI at some point in their process, and one-third use AI-generated audio in their final cuts. But AI audio, specifically music, is not immune to the controversies and issues that surround AI images and video. We struggle to hear with our naked ears, if you will, the difference between AI and human-created music. After strenuous push from listeners, streaming platforms like Spotify and Deezer are adding labels to AI-generated music. Suno is also adding labels, following backlash after users learned the service trained its models on YouTube videos. "The most important thing we heard is the desire for creators to have expressive control and agency," Ethier said. "And really being able to have tools that support their creative process and don't take it away."

Adobe Firefly's music, voiceover, and sound effects generation tools now generally available

Users can now create fully licensed tracks, voiceover, and sound effects on Adobe's Firefly AI assistant. Here are the details. Firefly audio tools now generally available Adobe recently conducted a survey in partnership with Berklee College of Music to understand the workflows and challenges faced by video creators, musicians, and marketers. According to Adobe, 100% of respondents said they use music in their videos, with 32.7% using AI-generated music. 43.2% cited legal and copyright risks as the main barrier to using music, while 38.9% cited licensing costs. Today, Adobe is making the Generate Music tool generally available on Firefly, alongside two other tools: Generate Speech and Generate Sound Effects: * Generate Music creates original, fully licensed tracks tuned to your video's length and mood, so your music can go wherever your content does without worrying about licensing or takedowns. * Generate Speech turns a script into clear, natural voiceovers. You can choose from Adobe's own Firefly speech model or ElevenLabs. * Generate Sound Effects creates custom sounds that match the action, timing and energy of your content. The company stresses that Generate Music creates fully licensed music that is ready for finished work, and like Generate Speed and Generate Sound Effects, does not require a separate subscription to generate commercially safe material. Generate Music can analyze the contents of a video, and create editable prompts based on what it identifies as the best fit for it. Users can also adjust parameters such as the music tempo, energy, and duration before hitting Generate to receive four options in return. When using the Generate Speech effect, users can add expressivity and pronunciation tags to certain parts of the script, while Generate Sound Effects lets users fill in a text prompt or record a sound effect with their voice to use as a reference for the generated audio. Here's Adobe: Sound is usually the last thing you add and the first thing people notice. It's also where creative flow tends to get disrupted, sending you off to specialized tools and separate services, then back again to stitch it all together. Today we're excited to share that Firefly's popular audio tools including Generate Music, Generate Speech, and Generate Sound Effects, are generally available and ready to use in your creative workflows, from social content and live vlogs to short films, product tutorials, and podcast clips. The new tools are available on Adobe Firefly's desktop and mobile web app. Adobe expands AI models list inside Firefly Additionally, Adobe today announced that Gemini Omni Flash is now on Firefly, letting users "prompt with video, audio, and image inputs alongside text, giving you more ways to develop your video and reshape it through back-and-forth edits, [...]." The move comes just days after the company added Runway Aleph 2.0 and Kling 2.0 to its third-party model toolset, which already featured models from Google, Kling AI, Luma AI, OpenAI, Runway, and Adobe itself. To learn more about Firefly, follow this link. Worth checking out on Amazon

Adobe Firefly just added three new AI audio tools for creators and marketers -- I tested them all to see if they're any good

Adobe Firefly's Generate Music, Speech, and Sound Effects go on general release today, but one AI tool stole the show during my testing * Adobe releases three new AI audio tools on Firefly * Creators can now use Generate Music, Generate Speech, and Generate Sound Effects * I tried them out to see how they perform in video creation After sitting in beta for sometime, Adobe Firefly has now made three new AI audio tools promising "studio-quality sound" available for all creators. I had a play with each one to see if the results were as good as promised - and on the whole, they delivered, with a few quirks. Generate Music, Generate Sound Effects, and Generate Speech are the latest audio features to hit Adobe's browser-based AI platform (no prizes for guessing what each of these do (sorry)). From my experimenting with all three, Generate Music is the high-point here, it's way better than I thought it'd be and I can see marketers and creators getting serious use from it. The launch coincides with a recent survey conducted by Adobe alongside Berklee College of Music, 32.7% of video creators, musicians, and marketers confirmed they use AI-generated music "as the final track in their published work." And it's that sizeable figure, I suspect, driving this particular update. So, what's new? There are three AI tools now available to everyone. They're all pretty self-explanatory, but here's what you need to know. * Generate Music lets you create licensed tracks matching your videos' length and mood. * Generate Speech takes scripts and turns them into voiceovers. * Generate Sound Effects generates - you guessed it - sound effects that match the action and timing of a video. But are they any good? I've written before about my agnosticism towards AI in general, and my issues using it for creative work. It's a facsimile of art. Still, Adobe's tools have impressed even the hyper AI-sceptics on my team - notably features like Generative Extend in its video editing software. And I'm nothing if not open minded. So, I decided to try these tools out for myself to find out what's really going on here. You can try them yourself by clicking here. The focus here, at least for now, is around speeding up creative workflows for the likes of marketers and content creators. Creating AI music I started with Generate Music, where you have two methods for creating tracks. First, you can upload a video - I used a short 27-second clip I filmed for my reMarkable Paper Pure review (mostly because it was still in my download folder). Based on that, Firefly suggested a prompt for "a calm, thoughtful song with ambient electronic style for a product demonstration." I hit Generate, and in a couple of seconds - it's actually impressively fast - I was served four tracks to choose from, all different but with the same vibe. They were...ok. A bit generic, but they'd do in a pinch. Or to rush a project to completion. I decided to add a few more terms to the prompt, like "jazz", "cinematic", for use in a "vlog" and "trailer". I changed the Energy from "low" to "medium." The results were a big improvement. Like all AI tools, the more prompting, the better the output, and there is an option to describe the vibe, style, and purpose yourself if you have an idea in mind. You can download the music and video, or just the music from here. Creating AI voiceovers Switching over to Generate Speech, I first used the side-bar to determine which AI model to use - at the time of writing, there's Adobe's commercially safe Firefly and the ElevenLabs Multilingual V2 partner model. I then picked a speaker from a list of 45, each variably described as male, female, non-binary, young adult, middle-aged, senior, and so on. Finally, I pasted in my text into the text field - Firefly can figure out what language I'm using, but you do get the option to choose it yourself. I used the poem Ozymandias (with my greatest apologies to Shelley). What I liked here was that with your text in place, you can choose to add additional text, or tell the AI to pause in certain places. To actually preview, I had to select the entire passage and use the context menu to (it's where you also fix pronunciation and adjust the tone of voice. For all the talk of speeding up workflows, this feels like a misstep to me. It just needs a play button at the bottom of the screen, as it was with generating music. I had to tweak the pauses to give my text room to breathe, and once in place, I could alter the timings by clicking the pause on the preview screen. And for some reason, the word "land", of all things, is what tripped up the AI, where it was pronounced "lan." Creating AI SFX For this test, I again used a video filmed for my reMarkable review - this time a 12-second clip comparing the reMarkable 2 with the Paper Pure. This process is a lot more in-depth, in the sense that the AI isn't going to guess what the likely SFX should be. I had to manually describe what I wanted. After that, I clicked the "Enhance Prompt", which added more descriptions. We end up, then, with "A sliding whistle descending softly with a metallic timbre and gentle resonance." Clicking Generate, the service rapidly produced four ear-piercing variations. I won't subject you to those results. It's not fair on anyone. Instead, I changed the prompt to a more soothing "crickets in a field" for a duration of 12 seconds, to fill the video length. What's nice about the SFX option is that you can add multiple audio tracks and use the handles to adjust its positioning. With a timeline sprawled across the bottom of the screen, it feels more like a real audio editor (to a degree, at least). Tug in the handles of the audio and you can further adjust volume or delete the track. Worth it? Overall, there are some UI tweaks I'd like to see here to make production workflows faster. And I don't think they'll substitute professional sound designers, composers, and musicians any time soon. But having worked in marketing, I can see they have their place for marketers and everyday video creation. Speech is a world away from the days of robotic Microsoft Sam sound-alikes, but for nuanced line delivery, nothing's going to beat a performer in a booth. Sound Effects has a lot more utility, though. Across a spectrum of generations, I couldn't tell the difference between the AI sounds and those playing on an old SFX CD I own. The real winner here is Generate Music. Even the base prompt delivered audio that wouldn't feel out of place in a product demo, review, business explainer, or similar. And it got better with every generation I created. An update worth exploring, then, for fast-moving video production. Follow TechRadar on Google News and add us as a preferred source to get our expert news, reviews, and opinion in your feeds.

Adobe expands generative AI audio with Firefly music, speech and sound effects

Adobe expands generative AI audio with Firefly music, speech and sound effects Adobe Inc. today announced the general availability of audio capabilities in Firefly, the company's all-in-one creative AI tool suite, allowing users to produce music, speech, and sound effects for their projects. In June, the company unveiled big changes for Firefly, including a large number of skills for Firefly AI Assistant that built in agentic capabilities for Elements - the company's user-friendly video and photo editing tool suite - that allowed users to introduce characters, locations and objects that stay the same across projects. Today's new tools include generators for music, speech and sound effects. Generate Music is powered by Firefly Music Model under the hood and creates universally licensed original tracks designed for a user's own video's length and mood, so the music can go with whatever content is being generated without worries about copyright issues. It can also be fine-tuned to match the brand and presentation. Generate Speech uses both Firefly Speech and an option for a model from ElevenLabs Inc. It can take a script and turn it into a fluid, natural voiceover that allows for control over voice, cadence and emotion. ElvenLabs is well known for extremely powerful speech models that cover a wide variety of synthetic voices with varied capabilities, emotionality and control. The sound effect tool also includes an underlying Firefly model that creates custom effects using a prompt, following the timing and energy of the content to produce an appropriate sound. "Going back to school and trying to stay consistent as a content creator can get really overwhelming. I love that Adobe Firefly has made my creative process so much easier," said Esther Rehema, a fashion, beauty and lifestyle creator. "Being able to find music that is safe for commercial use and fits my content is such a game-changer. Adobe added that the audio produced by Firefly Studio is production quality and commercially safe, like everything else generated by its AI models. No separate subscription is needed for any track generated by the tool. AI audio generation tools, from music to special effects, have been trending for years. This includes audio tools such as Lyra 3 from Google LLC, OpenAI Group PBC's reported music-generation experiments and Stability AI Ltd.'s Stable Audio open-source model.

Adobe Firefly adds AI music, speech and sound effects generation

Adobe has expanded Firefly with AI tools for generating music, speech and sound effects. The update also expands Firefly AI Assistant, introduces a free experience with daily generations, and adds Gemini Omni Flash to Firefly. In June, Adobe added more creative skills to Firefly AI Assistant and began releasing Elements, which lets users save characters, locations and objects and carry them across projects. Firefly combines Adobe tools for image, video, audio and design with models from Google, ElevenLabs, Kling AI, Luma AI, OpenAI, Runway and others. Firefly adds AI audio tools Adobe's Generate Music, Generate Speech and Generate Sound Effects tools are now broadly available in Firefly. They support projects including social content, live vlogs, short films, product tutorials and podcast clips. * Generate Music: Powered by the Firefly Music Model, it creates original tracks based on a video's length and mood. Adobe says the tracks are universally licensed and safe for commercial use. * Generate Speech: Powered by the Firefly Speech Model, it converts scripts into voiceovers with controls for voice, pacing and emotion. Users can also choose ElevenLabs. * Generate Sound Effects: Powered by the Firefly Audio Model, it creates custom sounds based on the action, timing and energy of the content. Adobe cited the "In Sync: Music and Video 2026 -- Creators, Musicians, and the Age of AI" study from the Berklee Emerging Artistic Technology Lab. It found that 80% of surveyed video creators, musicians and marketers post video content daily or several times a week, while every respondent reported using music in their videos. Adobe supported the study but did not control respondent recruitment, survey responses, analysis or conclusions, while Berklee BEATL retained editorial responsibility. Fashion, beauty and lifestyle creator Esther Rehema said Generate Music reduces the time she spends searching for suitable music. She said finding music that is safe for commercial use and fits her content previously took hours but can now take seconds. Madeline Salazar, who combines Photoshop, Firefly and special effects in short-form videos, said music licensing is a consideration when creating content for brands. She said Generate Music lets her create an original soundtrack for a video and helps address music licensing when delivering projects to clients. Firefly AI Assistant Firefly AI Assistant, introduced in beta earlier this year, has gained additional creative skills including Create Storyboard and Create Brand Kit, which Adobe says are among its most-used skills. It can also create branded mockups, generate storyboards before production and batch edit dozens of images. Adobe is also introducing a free Firefly AI Assistant experience with daily generations. Gemini Omni Flash Gemini Omni Flash has joined models from Google, Kling AI, Luma AI, OpenAI and Runway in Firefly. It supports video, audio and image inputs alongside text prompts, which Adobe says can help turn a rough idea into a storyboarded first cut. Availability Firefly's Generate Music, Generate Speech and Generate Sound Effects tools are now generally available. The free Firefly AI Assistant experience with daily generations and Gemini Omni Flash are also available in Firefly.

Adobe Firefly expands its creative AI studio: generate music, speech, and sound effects in one place

The moment your big, creative idea suddenly appears is also the moment that things get complicated. You're bouncing between workspaces, apps, browser tabs, and LLM models with every move stalling your creative flow. That's why we built Adobe Firefly, your all-in-one creative AI studio, where you can bring any idea to life. Firefly gives you the best Adobe tools across image, video, audio, and design, alongside industry-leading models from Google, ElevenLabs, Kling AI, Luma AI, OpenAI, Runway and more. In June we unveiled big innovations in Firefly, including more creative skills in Firefly AI Assistant, and an early release of features like Elements that help you save the characters, locations, and objects at the heart of your work and carry them across every project. Today, we're excited to share that Firefly's audio capabilities are now generally available for all. Studio-quality sound: Generate music, speech & sound effects Music, voiceover, and sound effects are essential to telling a story that can grab your audience's attention. In a recent survey* of video creators, musicians, and marketers, Berklee College of Music found that nearly four in five (80 percent) post video content daily or several times a week with every respondent reporting that they use music in their videos. Sound is usually the last thing you add and the first thing people notice. It's also where creative flow tends to get disrupted, sending you off to specialized tools and separate services, then back again to stitch it all together. Today, Firefly's popular audio tools -- Generate Music, Generate Speech, and Generate Sound Effects -- are now broadly available, bringing commercially safe AI audio to your creative workflows, from social content and live vlogs to short films, product tutorials, and podcast clips: * Generate Music, powered by the Firefly Music Model, creates universally licensed original tracks tuned to your video's length and mood, so your music can go wherever your content does without worrying about takedowns. * Generate Speech, powered by the Firefly Speech Model with the option to use ElevenLabs, turns a script into clear, natural voiceovers with control over voice, pacing and emotion. * Generate Sound Effects, powered by the Firefly Audio Model, creates custom sounds that match the action, timing and energy of your content. Generate Music gives creators a fast, worry-free way to get an original track that is safe for commercial use and fits their content. For Esther Rehema, a fashion, beauty and lifestyle creator, that means spending less time searching for music and more time creating. "Going back to school and trying to stay consistent as a content creator can get really overwhelming. I love that Adobe Firefly has made my creative process so much easier," says Rehema. "Being able to find music that is safe for commercial use and fits my content is such a game changer. What used to take me hours and hours of searching for the right song can now take seconds." For Madeline Salazar, a creator known for combining Photoshop, Firefly and special effects in her short-form videos, creating for brands means finding the right music and the rights that come with it. "When I am making content for a brand, there is always the complication of licensing the background music. Using Generate Music I am able to create a soundtrack that is unique to the video I'm making, and it gives me peace of mind because I know the music is safe for commercial use," says Salazar. "When I deliver something to a client, I'm putting my name behind the entire project, so being able to create original music for the piece, and feel confident about handing it over, is really important to me." This is audio built for real production: commercially safe and ready for finished work. No separate subscription or time spent hunting for a track you're allowed to use. Whatever you're creating, everything you need for studio-quality sound is now right inside Adobe Firefly. Firefly AI Assistant gets smarter, and now you can try it for free When we introduced Firefly AI Assistant (beta) earlier this year, we shared our vision for a fundamentally new way to create: one where you describe what you want to make, and your AI creative partner helps bring it to life. We've continued to make Firefly AI Assistant even more useful with new creative skills and tools that help you move from idea to finished content faster -- like Create Storyboard and Create Brand Kit, which are among the most-used Firefly AI Assistant skills. Whether you're turning a product into a full set of branded mockups, generating a storyboard before production, or batch editing dozens of images at once, Firefly AI Assistant helps you spend less time managing tools and more time getting to the outcome you want. To help everyone experience the magic of Firefly AI Assistant, we're introducing a free experience with daily generations that lets you start creating immediately. More choice with industry-leading AI models, right inside Firefly The more you explore Firefly, the more choice you have in how you create using top models from across the industry. Today, we're expanding that choice with the addition of Gemini Omni Flash which joins other models from Google, Kling AI, Luma AI, OpenAI and Runway giving you more flexibility in how you develop your ideas. Gemini Omni Flash lets you prompt with video, audio and image inputs alongside text, so a rough idea becomes a storyboarded first cut quickly.