Adobe Set To Launch AI-Powered Tool With Advanced Text-To-Video And Image-To-Video Options

Adobe has introduced its latest generative AI tool, Adobe Firefly Video Model , which enables users to create videos from text prompts and images. This addition to Adobe's growing Firefly suite is designed to enhance creative possibilities, providing a new method for video production.

The Firefly-powered AI model includes both text-to-video and image-to-video functionalities. Although this tool is currently set for a beta release later this year, Adobe has also announced an upgrade to its Premiere Pro software, incorporating a feature called Generative Extend . This new function allows video editors to expand an image or video frame by adding AI-generated backgrounds.

“The Firefly Video Model is designed to be commercially safe and is only trained on content we have permission to use – never on Adobe customer content,” the company clarified.

Features of Adobe’s Firefly Video Model
The Firefly video model introduces a range of capabilities that can assist video editors. Through the use of text prompts, editors can generate new videos, adjust elements like angle, motion, and zoom, and even create B-Roll by referencing specific images.

The tool also offers image-to-video features, allowing still images or illustrations to be transformed into dynamic videos, further expanding creative options.

Ashley Still , Senior Vice President of Creative Product Group at Adobe, highlighted the potential of this new tool, stating, “Building upon our foundational Firefly models for imaging, design, and vector creation, our Firefly foundation video model is designed to help the professional video community unlock new possibilities, streamline workflows and support their creative ideation.”

Potential Applications
This innovative AI tool opens up several possibilities, such as generating animations with control over camera movements, integrating AI-generated footage into real-life video, and adding inserts into key video shots.

Since its debut in March 2023, Adobe Firefly has expanded its AI capabilities to include models for images, vectors, and design. Popular features like Generative Fill in Photoshop, Generative Remove in Lightroom , and Text-to-Template in Express showcase Adobe's ongoing commitment to enhancing creative workflows through AI innovation.