Heaptalk, Jakarta — Adobe is collaborating with several AI companies, including OpenAI, Runway, and Pika Labs, to integrate generative AI models into its video creation tool, Adobe Premiere Pro.
This move aims to invent new workflows for video creation and production, keeping up with the high-speed pace of video production. The AI video tools, coming this year, are claimed to enable users to streamline video editing, including adding or removing objects in a scene or extending an existing clip.
The AI video tools will be part of Firefly models, which consist of Image, Vector, Design, and Text Effects. Adobe is also developing Firefly AI with deep domain expertise in imaging, video, audio, and 3D. These models will be embedded into Creative Cloud and Adobe Express.
Allowing third-party tools within Premiere Pro
In addition, Adobe is developing a feature that allows users to utilize third-party tools from OpenAI, Runway, and Pika Labs to produce and use video within Premiere Pro. Video editors can leverage video generation models from OpenAI and Runway, integrated into Premiere Pro, to generate a B-roll to edit into their project. They can also use Pika Labs with the Generative Extend tool to add a few seconds to the end of a shot.
“Adobe is reimagining every step of video creation and production workflow to give creators new power and flexibility to realize their vision. By bringing generative AI innovations deep into core Premiere Pro workflows, we are solving real pain points that video editors experience every day, while giving them more space to focus on their craft,” stated Senior Vice President and Creative Product Group at Adobe Ashley Still in a written statement (04/15).
By bringing new generative AI features powered by Adobe Firefly and diverse models developed by several third parties, Adobe gives users access to multiple new capabilities without leaving the workflows they use daily in Premiere Pro. In addition, the company also introduced the upcoming general availability of AI-powered audio workflows in Premiere Pro, including new fade handles, clip badges, dynamic waveforms, AI-based category tagging, and more.
