Adobe Introduces AI-Powered Search and Caption Translation in Premiere Pro Beta

Adobe Premiere Pro Will Soon Let You Quickly Search Footage Using AI

Adobe After Effects is adding a modern caching system for quick playback Adobe announced new features for its video editing software and cloud-sharing platform on Wednesday. These features are being rolled out to the latest beta build of Adobe Premiere Pro and After Effects as well as to Frame.io. Premiere Pro is getting two new artificial intelligence (AI) features that will make it easier for users to search for the right footage from their library and add AI-generated caption translations. The company claims that these features are aimed at reducing tedium for video professionals. The company shared details of two new AI features coming to Adobe Premiere Pro, via a blog post. They are currently available in the latest beta version of the application, which means that users on the stable release channel will have to wait for a while until the features are rolled out. Adobe has yet to announce when these features might be rolled out to a wider user base. The first is a new search panel that uses generative AI (the company calls it media intelligence) to analyse natural language text prompts and can find the right footage from the user's library. Adobe said the feature can be used to either describe the visuals in the footage, spoken words, or embedded metadata such as shoot date or camera type to find the right clip. Users can also use a combination of these metrics to further refine their search. For example, users can type "person skating with a lens flare" and see the relevant footage that matches the description, according to Adobe. The same applies to typing any words that were spoken in the clip. Additionally, the beta version of Premiere Pro is also getting an AI-generated caption translation feature. The AI tool can automatically translate captions into 17 languages that can be added to the video in separate caption tracks. Users can also keep multiple tracks visible at the same time to efficiently edit a video that contains audio in a different language. Two new features are also coming to the Adobe After Effects beta. First is a new caching system that allows users to preview and playback a composition without having to pause for caching. This is being done as the new system uses both the device's RAM and high-performance attached hard disks to reduce the wait time. HDR monitoring is also being added to the platform. After Effects will now support Perceptual Quantizer (PQ) and Hybrid Log-Gamma (HLG) encoders for HDR to allow users to view their compositions more accurately. Finally, the company's cloud-sharing platform Frame.io's Camera to Cloud (C2C) feature now supports Canon's C80 and C400 cameras. These are the first Canon cameras that will support the cloud platform. It joins other supported brands including Red, Fujifilm, and Panasonic. The integration allows users shooting video with these cameras to automatically upload proxy files to the cloud server to let the video editing professionals access them. Notably, while proxy files can be used to edit the footage in Premiere Pro, interlinking with the actual footage is necessary before the video is exported.

Adobe Introduces AI-Powered Caption Translation and AI Search Tools for Faster Video Workflows

Instagram's New Mobile Video Editor Sure Sounds a Lot Like CapCut Quick Links Premiere Pro Is Boosted Intelligent Search Using Keywords AI-Powered Caption Translation Adobe Premiere Pro video editor gets boosted features for smarter editing workflows along with enhanced tools for motion design elsewhere. Premiere Pro Is Boosted Adobe announced on January 22nd, ahead of the Sundance Film Festival 2025, that it will be bringing new AI-powered features to Premiere Pro (beta). The Adobe video editing tool isn't shy of introducing new features, after 2024's announcement of Premiere Pro's upcoming generative AI video tool, powered by Adobe Firefly. Along with some workflow-boosting features in Premiere Pro, Adobe also adds innovative tools to After Effects and in Frame.io to elevate filmmakers of the future. Frame.io is Adobe's file management system, built initially for a focus on video footage, but now used for images and documents too. New features include further Frame.io camera-to-cloud support, allowing filmmakers and content creators to film scenes and send the footage from their camera directly to their Frame.io library. After Effects users receive innovations in the form of improved caching and HDR support. Intelligent Search Using Keywords When editing videos, you'll likely be faced with countless raw video footage files, among trimmed clips, different angles, and other files you may include in your editing. It's hard to find the file you need when there are so many to search through. If you work within a team or temporarily working with new people, there may be differences of how to store or name the files, making it practically impossible to search with logic. Premiere Pro's media intelligence and search panel allows you to search for footage and files using keywords. Not only can these keywords relate to the file's title -- which seems too obvious to be a feature worth talking about -- but they can also search from the video footage's metadata. Now that's what I'd consider intelligent search powers. You can search for video files using location names, descriptions of content in the video -- for example, "girl with the dog" -- dates and times, dialogue, and even camera angles. This search tool will save frustration and time and help you claw back minutes or even hours during your editing workflow. It is much easier to describe the footage you're looking for than it is trying to recall the time, date, or location it was captured. This feature will boost workflow for larger teams, allowing everyone to be as productive as possible. The AI tools being announced by Adobe are exciting, even if they're just in beta for now. AI-Powered Caption Translation The second major feature of Premiere Pro's updated tools is an AI-powered caption translator. Premiere Pro can translate your captions in up to 17 different languages, allowing you and your team to save time on manually translating and applying the nuanced difference of languages. Not only are captions important for accessibility and connecting with your audience, but with the global push of video content, translation captions allow you to reach more people, regardless of borders. Using captions allows your video content to remain authentic, compared to dubbed audio or AI-model replacements seen more commonly. Combined, all Adobe's added motion features can improve collaborative workflows in teams of filmmakers, video editors, and motion designers. Premiere Pro's AI caption translation and intelligent search features are available in Premiere Pro (Beta). Adobe Creative Cloud users can download Adobe beta apps from the Creative Cloud.

Find the Perfect Clip in Seconds With New AI in Adobe Premiere Pro

With the famous Sundance Film Festival kicking off this week in Park City, Utah, Adobe thought it a good time to discuss what's next for Adobe Premiere Pro, a popular video editing platform for amateur and professional filmmakers alike. No matter their experience level, all video editors deal with some of the same problems, including tedious tasks like finding clips, transcribing or translating footage, waiting for software to catch up, and dealing with complicated color spaces. Adobe hopes to address all these issues with new beta releases for Premiere Pro, After Effects, and Frame.io. In the Premiere Pro beta, Adobe utilizes new artificial intelligence (AI) to help video editors find what they need faster than ever. "With new Media Intelligence and the Search panel in Premiere Pro (beta), the power of AI helps you find exactly what you need, when you need it," Adobe explains in a new blog post. Premiere Pro automatically analyzes the content of a user's clips and recognizes objects, locations, camera angles, and more. Within the new Search panel, users can seek out certain visuals, specific spoken words, or information within embedded metadata using natural language queries. For example, someone could search for a "close up of a person running at sunset," and Premiere Pro will find that clip. Or someone could look for "California," and see all clips with related visuals, transcript mentions, and embedded location metadata. Adobe adds that this all occurs on the device, so users don't need an internet connection to use the media analysis and new search. Premiere Pro is also receiving caption translations. As of now, this works with 17 languages, although it is a safe bet that more will be added later. This also supports multi-language caption tracks so that multiple languages can be visible on-screen simultaneously. Moving to After Effects, Adobe is focusing on improving performance. After Effects (beta) has a new and improved caching system that uses both the computer's RAM and high-performance disks to preview and playback larger, complex projects faster than ever. The prior version relied exclusively on RAM, so adding disk resources should significantly speed up playback in After Effects. After Effects is also getting HDR monitoring with support for PQ and HLG video. Jumping to the final cog in the Adobe video editing wheel, Frame.io, Camera to Cloud is now available for select Canon cameras. This was announced at Adobe MAX 2024, and now Canon EOS C80 and C400 cinema cameras natively work with Frame.io's Camera to Cloud feature. Adobe is quick to add that Premiere Pro supports RAW video files from these cameras, too. "No matter your workflow, genre, content, or delivery platform, we're focused on making tools that reduce the tedium so you can focus on what you love: telling your story," Adobe says. "And as more professional editors and motion designers than ever choose Premiere Pro, After Effects, and Frame.io, we're continuing to prioritize core workflows so you can tell your story with powerful industry standard tools." All the new features are now available in beta. Users can learn more about accessing Premiere Pro (beta) and After Effects (beta) on Adobe's website.

Adobe Previews AI-Powered Search and Caption Translation for Premiere Pro at Sundance

Katelyn is a writer with CNET covering social media, AI and online services. She graduated from the University of North Carolina at Chapel Hill with a degree in media and journalism. You can often find her with a novel and an iced coffee during her time off. Here's some non-TikTok video news for you: Adobe's Premiere Pro beta is getting some new AI-powered features. On Wednesday, Adobe announced a new media intelligence panel that uses advanced machine learning to bring smarter search to your clip library, plus a new tool that can translate your captions into 17 different languages. The features are rolling out this week in the Premiere Pro beta app before a potential future wider release. One of the first things you learn when you start fiddling with video editing is the importance of naming your clips and organizing files in your library, so that you can find and retrieve specific clips later and avoid those dreaded "media not found" error messages. But as anyone who's done that knows, it's a tedious and time-consuming task. That's where the new media intelligence panel can help. Media intelligence is a kind of advanced search panel that aims to make it easier to find specific clips. You can still search by file name and location, but media intelligence can recognize certain elements in clips and pull them -- subjects like "skateboarders" or technical elements like lens flares, or both, clips of people skateboarding where there's a lens flare. The idea is to make it easier and quicker to find the clips you need, even if they aren't named after the subject or include the keyword you're using to search. Media intelligence uses clips' metadata, including shoot date and camera type -- meaning you can get really specific with your searches. It can also highlight sections of longer videos, so if you want one question from a taped interview, you can search for that without having to scrub the whole video searching for that one part. Media intelligence runs locally on your computer and doesn't read or store information about your clips. Adobe doesn't train its AI models on its users' content. Premiere Pro's auto-captioning is also getting upgraded to include translations. Adobe said it has heard from users that they want the ability to add captions in multiple languages on the same clip, and the new tool lets you do that without leaving Premiere. You can already automatically generate transcripts of your videos, and from there, you can add captions. With the new beta feature, you can transcribe those captions into 17 different languages, including Spanish, German, French and Japanese. A couple of other smaller updates were also announced this week. Frame.io is now compatible with two new cameras (the Canon C80 and C400), and the After Effects beta app is also getting improved caching and HDR support. Adobe made the announcement in advance of the Sundance Film Festival, where 60% of this year's films used Premiere Pro during their editing processes, according to Adobe.

Adobe Premiere Pro Can Now Find Your Clips With Text Searches

Logitech's Harmony Line Is Long Gone, but There's Still Room for Universal Remotes Adobe is bringing new features to its Premiere Pro video editor, including caption translations and the ability to search videos by describing them. Premiere Pro can now recognize objects, locations, camera angles, and more in videos but doesn't identify or label people (yet). You can simply describe the footage to find videos in your library via a new Search panel. For example, you can find matching items with simple search keywords like "California" or use natural language for more complex queries, such as "a person skating with a lens flare" or "a person skating with a lens flare," the company said. The feature will find matching sections of a clip or the relevant range. If you edit many videos in Premiere Pro, this feature could save you time compared to manually reviewing videos to find the right footage for your project. It takes advantage of an AI-powered computer vision algorithm Adobe calls Media Intelligence. The company says Media Intelligence currently only identifies visuals, not sound. It also does not use optical character recognition, so you can't find a specific text in a frame. The app can also find spoken words if the video file has a transcript attached. And beacuse Media Intelligence can analyze metadata, too, you can find videos based on GPS locations, camera types, capture dates, and other information embeded in the metadata. Adobe's FAQ page says privacy is guaranteed because all processing for Media Intelligence is performed on-device. Nothing is uploaded to the cloud, and no internet connectivity is required for Media Intelligence to work. Your content is not used to train Adobe's models. Premiere Pro can also now automatically translate captions into 17 languages, with multiple caption tracks visible at the same time. Video is transcribed in real-time using AI voice-to-text technology, and you can then edit the video directly from the transcript. Adobe isn't alone in bringing AI capabilities to video editing. Apple's Final Cut Pro software recently gained the ability to automatically create closed captions using a large language model that transcribes spoken audio. Microsoft's Clipchamp video editor in Windows has a similar feature, where you edit videos by using text transcripts instead of the usual timeline. The new Search panel, caption translations, and other improvements are available in the Premiere Pro Beta starting today. To run the betas, you need an active Creative Cloud or Premiere Pro subscription. Creative Cloud subscribers who don't wish to install the betas can get those features later when they are released to all users. Adobe also announced improvements for After Effects and Frame.io, its cloud-based video collaboration platform which now supports Canon's C80 and C400 cameras. After Effects has a new caching system that should eliminate the need to pause playback to cache or render on slower computers. The app now supports HDR monitoring for PQ and HLG video via a calibrated reference monitor. You can try these improvements in the After Effects Beta. Source: Adobe

Adobe Premiere Pro's new AI tool could save video editors hours of time

Media intelligence can analyse thousands of clips in just seconds. While a lot of the focus has been on generative AI, Adobe continues to roll out workflow-focused AI features across its Creative Cloud suite too. And today there's big news for video editors who use Premiere Pro. At Sundance 2025 in Utah, the creative tech giant has announced a new AI-powered Media Intelligence tool that automatically analyses visuals across thousands of clips in seconds. Available in Premiere Pro in beta, it can identify the contents of each clip to make them searchable by text, potentially saving video editors many hours when searching through footage. The new media intelligence and search panel in Adobe Premiere Pro (beta) aim to speed up video editors' workflows by allowing them to quickly locate the best clips in huge libraries of files without having to manually sift through hours of footage. Media Intelligence automatically recognises clip content, including people, objects, locations, camera angles, camera type and more. This allows editors to simply type out the clip type needed in the new Search Panel, which displays interactive visual results, transcripts, and other metadata results from across an entire project. Other updates in Premiere Pro beta include AI-caption translation, which sounds more than a little bit risky considering the unreliability of automatic translation. Meanwhile After Effects gets improved HDR support and improved caching for longer playback footage from Canon C80 and C400 cameras can now be automatically uploaded to Frame.io. In other news, Adobe and the Adobe Foundation have announced an expansion of the Adobe Film & TV Fund, committing an extra $5m in 2025 to support underrepresented creators and filmmakers. Adobe says three filmmakers who were supported through its grant to The Latinx House last year have films premiering at Sundance 2025: María Gabriela Torres with The Librarians, Isabel Castro, with Selena y Los Dinos and Mario Fierro with Sweet Talkin' Guy. The new Media Intelligence tool in Premiere Pro follows the introduction of other AI-driven features including Firefly-powered Generative Extend. See below for Premiere Pro prices in your region.

Adobe Premiere Pro now lets you find video clips by describing them

Users can enter search terms like "a person skating with a lens flare" to find corresponding clips within their media library. Adobe says the media intelligence AI can automatically recognize "objects, locations, camera angles, and more," alongside spoken words -- providing there's a transcript attached to the video. The feature doesn't detect audio or identify specific people, but it can scrub through any metadata attached to video files, which allows it to fetch clips based on shoot dates, locations, and camera types. The media analysis runs on-device, so doesn't require an internet connection, and Adobe reiterates that users' video content isn't used to train any AI models.