Adobe is adding generative AI capabilities to its Premiere Pro video editing software, the company announced in a blog post.
The new AI-powered tools will allow video editors to extend video clips, add or remove objects, and generate missing B-roll footage without leaving the familiar Premiere Pro workspace.
Ashley Still, product manager at Adobe, said the integration of AI into Adobe Premiere Pro addresses three key needs of the video editing community: seamless integration with existing workflows and tools, faster editing of existing content, and more control and flexibility for editors.
Adobe is developing a proprietary AI model called Firefly Video, which will join the company's existing lineup of Firefly models for image, vector, design, and text effects.
In addition, Premiere Pro will also provide interfaces to third-party AI models from companies such as OpenAI, RunwayML, and Pika, as Adobe seeks partnerships to deliver the capabilities its customers want.
Add, remove, extend
The Generative Extend tool allows users to extend video shots by a few frames to make precise cuts, hold a scene, or cover transitions, the blog post said.
Intelligent AI-based masking and tracking tools simplify the selection of moving objects, allowing editors to replace them, remove distracting elements, or add props when combined with the Object Add and Object Remove features, according to the blog post.
The Generative B-Roll tool allows editors to use simple text instructions to create video clips that are difficult to film or obtain, or to generate placeholders for scheduling purposes.
Adobe is taking an open approach to providing AI models, partnering with companies such as OpenAI and Pika to allow customers to choose the most appropriate model for their use case.
Deepa Subramaniam, vice president of product marketing at Adobe, tells Reuters that it is still unclear how revenue from the use of third-party AI tools on the Adobe software platform will be shared between Adobe and external developers.
The company aims to provide transparency with Content Credentials, a label for content creation that identifies which models were used. This standard, which was co-founded by Adobe, is now supported by many companies and social media platforms.
Users will be notified if they are not using Adobe's "commercially safe" AI models, and all videos created with Adobe Premiere Pro will clearly indicate which AI technology was used.
However, a new report reveals that Adobe may not have been as consistently candid as it has claimed since unveiling Firefly. About five percent of the training images used for Firefly were AI-generated images from other AI generators, such as Midjourney.
While it is true that these AI images were part of Adobe's own stock database and therefore licensed, these generators have an unclear legal and controversial ethical basis.