Last Updated on 12/09/2024 by Arun jain
Adobe has announced a new addition to its suite of creative tools: Adobe Firefly Video Modelhis own foray more and more Competitive AI video generation Space, built on top of its existing and ever-expanding family Firefly generative AI static image modelsWhich the company claims to be ethically trained and commercially safe, thanks to using only data it owns or has licensed, uploaded by contributors to its Adobe Stock service.
However, as VentureBeat reported last year, some Adobe Stock creators dispute this Because they had to agree to terms of service that allowed Adobe to upload their works to the service for broad use, they never imagined that the generative AI era would arrive and use said works to potentially create new ones in their style. And it competes with their efforts.
Adobe’s Firefly video model will be available in beta later this year, and the company is offering early access through a waitlist — interested parties. You can apply here.
It also supports text-to-video, image-to-video and video editing features in a single model. However, generations are limited Up to 5 seconds, according to The Verge.
Impressive high-quality examples
Initial examples of clips generated by Firefly Video have been posted Adobe’s blog Show impressive quality and adherence to text prompts, generated in less than 2 minutes.
For example, this prompt: “Cinematic closeup and detailed shot of a reindeer in a snowy forest at sunset. The lighting is cinematic and gorgeous and soft and sun-kissed, with golden backlights and dreamy bokeh and lens flare. The color grade is cinematic and magical.”
…results in this video:
The prompt: “Landscape of a slow-burning volcano, lava pouring out of craters. The camera flies over the lens through lava and lava splatters. The lighting is cinematic and moody. The color grade is cinematic, dramatic and high-contrast.”
…results in:
What it means for enterprise decision makers
For enterprise decision makers looking to use AI to create external videos for employees and training or just “vibes” or for customers and marketing efforts, even for full-blown advertising — Adobe’s new professionally safe Firefly Video could be a very attractive option.
Finally, Adobe offers compensation for usersThat is, one AGREEMENT TO PROTECT USERS FROM INFRINGEMENT CLAIMS And legal action has been taken against them for using its AI models, though it has not yet made clear whether the Firefly video will be covered.
But, enterprise decision makers will have to weigh the cost of waiting to gain access to Adobe Firefly Video and jump in and use many other high-quality AI video generators, such as those now publicly available. Runway Gen-3 Alpha Turbo Or Luma AI’s Dream Machine.
The next stage in Firefly’s progression
Since launching Adobe Firefly in March 2023, Adobe has deployed a model based on new AI features in its widely used Creative Cloud software suite.
Firefly tools are already embedded in popular applications such as Photoshop, IllustratorAnd LightroomEmpowering users with features like generative fill, generative remove and text-to-template.
According to Adobe, more than 12 billion images and vectors have been generated using Firefly since its launch, making it one of the company’s fastest-adopting innovations.
Ashley Still, the Adobe executive leading the project and author of Adobe’s announcement blog post, said the firm “worked closely with the video editing community to advance the Firefly video model.”
“Guided by their feedback and built with creators’ rights in mind, we’re developing new workflows that leverage the model to help editors brainstorm and explore their creative vision, fill in gaps in their timelines, and add new elements to existing footage.“
More than just AI video generation
As such, Firefly Video does much more than generate new videos from text prompts. It also offers AI-powered editing features, including removing unwanted objects and perfecting transitions.
The rise of short-form video content, coupled with ever-tighter production deadlines, has forced editors and filmmakers to work across multiple disciplines.
Adobe’s Firefly Video Model helps address this by offering tools that enable editors to not only crop footage but also manage color correction, animation, visual effects and more.
Editors can now take advantage of AI to speed up these processes while maintaining high quality output, freeing them to focus on creativity.
The model also supports a wide range of creative effects, including B-roll, macro shots and atmospheric elements such as fire, smoke or water that users can layer over pre-recorded or animated footage.
A unique feature coming to Premiere Pro later this year is Generative Extend. This function will allow editors to extend video clips, fill in gaps in footage, or smooth transitions – helping to match cuts with the pacing of audio and other visual elements.
Adobe demonstrated this capability by showing how Generative Extend can hold a shot longer to perfectly align with a musical crescendo:
A look at Firefly Video and Adobe’s plans
Adobe sees the Firefly video model as part of a broader push to integrate AI into creative workflows. The model is designed to handle a variety of use cases, from generating 2D and 3D animations to creating atmospheric elements such as smoke and fire.
Still not mentioning the blog post Adobe has previously stated and previewed plans to add competing AI video models from other companies — such as OpenAI’s Sora and Runway’s Gen-3 Alpha — to its premier pro video editor software. This makes me wonder if Adobe is rethinking the approach given the increased competition in the space.
Adobe envisions that these tools will give creators more time to explore new ideas, grow their projects, and ultimately deliver better results for their customers.
By incorporating generative AI into its suite of video editing tools, Adobe is positioning Firefly Video as an essential part of the modern editor’s toolkit – empowering creators to advance their projects with cutting-edge technology.
Post Adobe Firefly Video previews an AI model that offers high quality generation appeared first Venture beat.