"Adobe Firefly": The web app now generates AI videos
With the "Adobe Firefly" AI, you were previously able to generate images from text. In a new beta, you can now also use it to create videos.
The web app "Adobe Firefly" is an AI that creates images from text. Developer Adobe has now expanded it. You can now also create five-second videos using prompts.
This is what the "Adobe Firefly" video tool can do
The beta programme currently runs via Adobe's web browser and is accessible to everyone. However, you must register with an email address and a plan is required after two videos, more on this below.
You have two options for your own AI videos. "Text to video" and "Image to video". You can make some settings for the end result, such as the format - 16:9 or 9:16. The camera movement and the setting size can also be determined in advance. The result is a five-second video with a resolution of 1080p.
Source: Michelle Brändle
Currently, the AI takes around two minutes to create the clip. However, Adobe would like to release a faster model in which the content has a lower resolution. These can then serve as inspiration for further iterations, for example.
My experiments with the video generator
With the prompt, it is important to describe exactly and technical terms are also useful for backgrounds, style and camera settings. This way, the video comes as close as possible to the desired result.
My prompt, in English, for a heart-warming cat video: "cinematic closeup and detailed portrait of a cat in a field of sunflowers at golden hour. The lighting is cinematic and gorgeous and soft, with beautiful strong backlight and lens flare. The cat is extremely realistic with detailed fur texture, the camera doesn't move."
With the right words and explanations, the result is an impressive video. The result can serve as inspiration and illustrative material for a real film - or as a special effect in existing clips. I can do this by using the tool to produce a green screen video.
Nonetheless, it remains a trial and error process and the results are subject to a certain degree of chance. My second attempt at dancing mice therefore turned out a bit creepy instead of cuddly and loving. The prompt here: "Tiny adorable mice made out of wool and felt, dancing with each other, 3D render, octane, soft lighting, dreamy bokeh, cinematic."
My last attempt, from a self-painted picture of a woman eating pizza, was actually very unsuccessful. The prompt was "The woman lying on the floor eating the slice of pizza, zoom in to the pizza slice, romantic lighting, cinematic".
I don't want to withhold this video from you either. Don't forget that this is currently still a beta version of the generator.
Data and transparency of the AI software
Adobe has been criticised in the past for the origin of its AI training data. Users feared that their work could be misused. However, Adobe continues to emphasise that the AI was only trained with content for which the company owns the rights and that it never uses user data for AI training. Adobe has also made this clear in its terms of use. I have already reported on this in the past.
Price adjustments to the cloud plan
Adobe is adjusting its subscription models with the new AI video generator. Previously, AI functions were billed in the form of credits. A job, i.e. a prompt, cost you one credit. Depending on your plan, you had a different number of credits available each month.
With the new video AI Adobe is swapping this pricing model for two new plans. With these, you can use all of Firefly's image and vector functions for an unlimited time. You will have to spend credits for video and audio.
Firefly Standard costs you just under 11 francs or euros per month and includes 2000 credits. However, you now pay 20 credits for one second of video. This means you can create 20 five-second videos. Firefly Pro costs around 33 francs or euros and includes 7000 credits, which are enough for 70 videos.
Header image: Michelle Brändle
14 people like this article
In my world, Super Mario chases Stormtroopers with a unicorn and Harley Quinn mixes cocktails for Eddie and Peter at the beach bar. Wherever I can live out my creativity, my fingers tingle. Or maybe it's because nothing flows through my veins but chocolate, glitter and coffee.
