Adobe is previewing several experimental AI tools for animation, image generation, and video and photo cleanup that may eventually be added to Creative Cloud apps.
Although these tools apply to very different media, all three have similar purposes. That means automating most of the tedious and complex tasks required for content creation and giving creators more control over the results than simply connecting a prompt to an AI generator. The idea is to allow people to create animations, images, and do complex video editing without requiring a lot of time or experience.
The first tool is called “Project Scenic,” and it gives users more control over the images produced by Adobe’s Firefly model. Rather than relying solely on textual descriptions, Scenic actually generates the entire 3D scene and allows you to add, move, and resize specific objects. The final result is used as a reference to generate a 2D image that matches the 3D plan.
Next up is Project Motion, a tool that allows you to easily create animated graphics in a variety of styles in just two steps. The first stage is a simple animation builder that allows creators to add motion effects to text and basic images without any animation experience. The second stage then transforms this animated video using text descriptions and reference images, and adds colors, textures, and background sequences.
Project Clean Machine is an editing tool that automatically removes unwanted distractions in images and videos, such as camera flashes or people entering the frame. This is similar to automated content-aware fill, but better because it also fixes unwanted effects caused by the visual you’re trying to remove. For example, if fireworks in the background cause a few seconds of your shot to be overexposed, Clean Machine will ensure that the colors and lighting are consistent throughout the video, even if you remove the flash itself.
The tools will be announced at Adobe’s MAX conference as “Sneaks,” what the company calls an in-development project aimed at introducing new technology and gauging public interest. While there’s no guarantee that Sneak will ever be fully released, many features, such as Photoshop’s Distraction Removal and After Effects’ Content-Aware Fill, have their roots in these projects.
We got an early glimpse of these ahead of the announcement, and you’ll get a closer look later today during a demonstration. None of these tools are publicly available yet, but that may change in the coming months.
