Adobe’s Generative AI Video Model is Available Via a New Firefly Web App

Since first being showcased at Adobe MAX 2024 in Miami last year, Adobe’s Firefly Video Model has been one of the most talked about and anticipated models in this budding AI video space.

Adobe, to the company’s credit, has made a strong push to bring about the industry’s first commercially safe generative AI video models to market, and—as of today—the new Firefly Video Model is now available in public beta.

Along with the Firefly Video Model tech that we’ve seen previewed in the past, Adobe has also unveiled a new Firefly web application that will feature its own Generate Video (beta) feature, along with the Generative Extend (beta) featured in Premiere Pro already.

Let’s look at this new Firefly web app and how the Firefly Video Model continues to further integrate into Adobe’s suite of creative tools.

Adobe Firefly Web App

The big news here is a new Firefly web app that is set to offer a comprehensive set of tools powered by the Firefly family of models and integrate directly with Adobe applications. The goal here is for creators to be able to seamlessly move from ideation to production with a growing list of AI-powered tools and features.

The Firefly Web App will also feature a Generative Video (beta) feature that will allow creative professionals to generate video clips from a text prompt or image, use camera angles to control shots, create professional quality images from 3D sketches, craft atmospheric elements, and develop custom motion design elements.

The app will support 1080p resolution to start, with both a lower resolution ideation model for high-speed iteration and a 4K model for pro-level production work reportedly coming soon. Adobe shares that creative professionals, enterprises, entertainment brands, and media agencies like Dentsu, Gatorade, and Stagwell are already using this tech and finding success with the video model beta, praising its commercially safe, IP-friendly generations and unrivaled levels of creative control for real-world applications.

Firefly Web App Features

At launch, the Firefly web application is set to feature a suite of professional-grade controls,

enabling creative professionals to deliver their finest work from ideation to production. Users can create 3D worlds, starting with style and structure reference images, using professional camera angles to get the perfect shot, and translating audio and video into multiple languages while maintaining an authentic voice, all with Firefly.

The app integrates with Adobe Creative Cloud applications, including Photoshop, Premiere Pro, Express, and more, and, as mentioned earlier, is safe for commercial use.

Here are the new features available in the Firefly web app starting today:

• Generate Video (beta) for industry-leading controls that enable creative professionals to generate videos, b-roll, animations, and more, all powered by the Firefly Video Model. With Text to Video and Image to Video features, creative professionals can produce stunning high-quality 1080p video from simple text prompts, generate b-roll to fill gaps in timelines, add atmospheric elements to a shot and develop custom motion design elements. Intuitive controls provide new levels of precision to fine-tune any shot with detailed camera settings, like sweeping aerial views, frame subjects exactly as envisioned, from dramatic close-ups to expansive long shots, and dynamic movement by selecting from multiple motion paths. Creative professionals can also lock in the first and last frames of a shot to preserve visual continuity, keep colors and character details consistent and more.
• Scene to Image (beta) to create professional quality images from 3D sketches and reference shapes. Using a lightweight 3D sketching tool, creative professionals can transform artwork into beautiful high resolution images, build structure references directly within Text to Image and create precise visual guides using intuitive 3D tools. Creative professionals can change 3D image angles and perspectives to get the perfect output. With Scene to Image, creators can seamlessly render production-ready assets from 3D shapes, all with the flexibility and precision required in professional graphic design workflows.
• Translate Audio and Video for the translation of spoken dialog into multiple languages while maintaining an authentic voice. Creators can quickly and easily translate videos and audio files to reach a large, global audience with personalized, natural-looking content. With voice, tone, cadence and acoustic match when translating video content into different languages, creators can also spend less time on dubbing performance and audio mixing, saving time and budget on translation and dubbing services. Translate Audio and Video supports translations in over 20 languages.

Pricing and Availability

Available today with early access pricing, two new Adobe Firefly plan offerings — Firefly Standard and Firefly Pro — are set to give creators unlimited access to Firefly imaging and vector features as well as tiered capacity for new video and audio features.

The Firefly Standard plans enable access to 2,000 video/audio credits per month, up to 20 five-second 1080p video generations, starting at $9.99 USD. While Firefly Pro plans allow access to 7,000 video/audio credits per month, up to 70 five-second 1080p video generations start at $29.99 USD.

Additionally, a new Firefly Premium plan designed for professionals looking to generate video content on a regular basis will be coming soon to provide even more audio and video capacity for high-volume creators and teams.

The Generate Video (beta) feature is also available on the Firefly web application through new Firefly plan offerings, which can be found here.