Today Adobe (Nasdaq: ADBE) released the Firefly Video Model in public beta, bringing the industry’s first commercially safe AI video generation model to market. Available in the Firefly web application with Generate Video (beta) and in Adobe Premiere Pro with Generative Extend (beta), the Firefly Video Model generates IP-friendly video content that can be used in production today. It is the latest offering in the Firefly family of creative generative AI models, which has been used to generate over 18 billion assets globally. Two new Firefly plan offerings at tiered price points designed to meet customers’ flexible usage needs enable access to new audio and video capabilities as well as image and vector generations, all powered by Firefly and available today through a new, redesigned Firefly web application.
Generate Video (beta), powered by the Firefly Video Model, empowers creative professionals with tools to generate video clips from a text prompt or image, use camera angles to control shots, create professional- quality images from 3D sketches, craft atmospheric elements and develop custom motion design elements. It supports 1080p resolution to start, with both a lower resolution ideation model for high-speed iteration and a 4K model for pro-level production work coming soon. Creative professionals, enterprises, entertainment brands and media agencies – including Dentsu, Gatorade and Stagwell – are finding success with the video model beta, praising its commercially safe, IP-friendly generations and unrivaled levels of creative control for real-world applications.
Adobe is introducing new Firefly Standard and Firefly Pro plan offerings that enable access to the new Firefly web application, the most comprehensive destination to generate images, videos and more with unmatched creative control. Adobe Firefly’s breadth of capabilities allow users to generate images, edit the images, turn them into videos and control camera angles and cinematic movement before moving to Adobe Creative Cloud applications to transition seamlessly from ideation to production. Using Adobe’s suite of industry-leading creative apps, creative professionals can refine their work with Photoshop on the web, Premiere Pro and Adobe Express, or leverage Firefly-powered features such as Generative Fill in Photoshop and Generative Remove in Lightroom to edit and bring photos to life with the video model.
“Firefly is designed for creative professionals looking for unmatched creative control and IP-friendly tools that can be used safely and effectively in production,” said David Wadhwani, president of Adobe’s digital media business. “We’ve been thrilled to hear from beta customers who’ve found it a game-changer for ideating concepts and producing stunning videos, and we can’t wait to see how the creative community uses it to bring their stories to the world.”
Introducing the New Firefly Web Application
The Firefly web application offers a suite of professional grade controls, enabling creative professionals to deliver their finest work from ideation to production. They can now create 3D worlds, start with style and structure reference images, use professional camera angles to get the perfect shot and translate audio and video into multiple languages while maintaining an authentic voice, all with Firefly. It integrates with Adobe Creative Cloud applications including Photoshop, Premiere Pro, Express and more – and Firefly is safe for commercial use, providing creators confidence to use it for production-ready content.
In under two years, Firefly has been used to generate over 18 billion assets globally – an uptick of 50% over the past few months – and evolved from an image generation tool to the most comprehensive generative offering for creative teams. Beyond generating high-quality images, it provides creators unmatched control over their work through professional camera angles and positioning, rich detail and prompt accuracy and the ability to match the structure of style of a reference image in image, video and 3D outputs.
New and available in the Firefly web app today:
• Generate Video (beta) for industry-leading controls that enable creative professionals to generate videos, b-roll, animations and more, all powered by the Firefly Video Model. With Text to Video and Image to Video features, creative professionals can produce stunning high-quality 1080p video from simple text prompts, generate b-roll to fill gaps in timelines, add atmospheric elements to a shot and develop custom motion design elements. Intuitive controls provide new levels of precision to fine-tune any shot with detailed camera settings, like sweeping aerial views, frame subjects exactly as envisioned, from dramatic close-ups to expansive long shots, and dynamic movement by selecting from multiple motion paths. Creative professionals can also lock in the first and last frames of a shot to preserve visual continuity, keep colors and character details consistent and more.
• Scene to Image (beta) to create professional quality images from 3D sketches and reference shapes. Using a lightweight 3D sketching tool, creative professionals can transform artwork into beautiful high- resolution images, build structure references directly within Text to Image and create precise visual guides using intuitive 3D tools. Creative professionals can change 3D image angles and perspectives to get the perfect output. With Scene to Image, creators can seamlessly render production-ready assets from 3D shapes, all with the flexibility and precision required in professional graphic design workflows.
• Translate Audio and Video for the translation of spoken dialog into multiple languages while maintaining an authentic voice. Creators can quickly and easily translate videos and audio files to reach a large, global audience with personalized, natural-looking content. With voice, tone, cadence and acoustic match when translating video content into different languages, creators can also spend less time on dubbing performance and audio mixing, saving time and budget on translation and dubbing services. Translate Audio and Video supports translations in over 20 languages.
Legal Disclaimer: The Editor provides this news content "as is," without any warranty of any kind. We disclaim all responsibility and liability for the accuracy, content, images, videos, licenses, completeness, legality, or reliability of the information contained in this article. For any complaints or copyright concerns regarding this article, please contact the author mentioned above.
