Adobe Firefly Expands into AI Video Generation, Pushing Boundaries of Creative Technology

Adobe Firefly's Newest Feature Will Be AI Video Generation

Katelyn is a writer with CNET covering social media, AI and online services. She graduated from the University of North Carolina at Chapel Hill with a degree in media and journalism. You can often find her with a novel and an iced coffee during her time off. Adobe is expanding its AI model Firefly to include video generation capabilities, the company announced Wednesday. Previously, Firefly offered image generation and editing tools integrated throughout Adobe's Creative Cloud suite of programs. Adobe teased the new feature in a video where we can see someone inserting a lengthy prompt in a query box to create different kinds of videos. We also see a sidebar menu that lets you adjust the motion of a shot and insert a reference image in your prompt. It also showed how you can use it to create new footage to extend existing clips and fill in potential gaps. This video is all we have for now, as the feature won't be available with Firefly until later this year. You can join the waitlist here, but be sure to use the email that's associated with your Adobe account. Read More: Why Procreate's Anti-AI Pledge Is Resonating With Its Creators Earlier this summer, Adobe upgraded its AI tools in Photoshop and Illustrator, introducing an AI image generator in Photoshop and a generative shape-fill tool in Illustrator. Firefly's current privacy policy states that it does not train its models on Creative Cloud subscribers' personal content; Adobe says its models are trained on licensed databases like Adobe Stock (excluding editorial content) and public domain images with expired copyright. Adobe's foray into generative AI has certainly had its bumps in the road. Adobe users were angered over a vague update to its terms of service that had them concerned the company could scan and read their content. Adobe later clarified that it can only do its content moderation on files stored on the Cloud, not users' devices. It cited generative AI's ability to be used to create illegal content as part of the motivation behind the changes. Adobe is also facing a lawsuit from the US Department of Justice that alleges its cancellation process is convoluted with hidden cancellation fees.

Adobe's top technologist on what makes an AI tool good enough to launch

Adobe is moving some of its video generation tools, first teased in April, into private beta. The new options appear powerful, but for Adobe, it's as important that these tools are practical. Adobe needs to master the UI of AI. Text to Video is basically Adobe's answer to OpenAI's Sora (which is also yet to be released publicly). It lets you type a prompt, like "closeup of a daisy," to generate video of it. Adobe's distinguishing feature is cinemagraphic creative control. A drop down menu will share options like camera angles to help guide you in the process.