"The AI model analyzed the video and broke it down into scenes, applying emotional tags and a description of each scene. Then, the sound effects came. The AI model picked up on a scene with an alarm clock, for instance, and automatically created a sound effect. It identified a scene where the main character (an octopus, in this case) was driving a car, and it added a sound effect of a door closing."
"It wasn't perfect. The alarm sound wasn't realistic, and in a scene where two characters were hugging, the AI model added an unnatural rustling of clothes that didn't work. Instead of manually editing, Adobe used a conversational interface (like ChatGPT) to describe changes. In the car scene, there was no ambient sound from the car. Rather than manually selecting the scene, Adobe used the conversational interface and asked the AI model to add a car sound effect to the scene."
"Harmonize, a feature in Photoshop that automatically places assets with accurate color and lighting in a scene, was shown at Sneaks last year. Now, it's in Photoshop. Expect them to pop up sometime in 2026. Adobe's announcement comes mere months after video game voice actors ended a nearly year-long strike to secure protections around AI-companies are required to get consent and provide disclosure agreements when game developers want to re-create a voice actor's voice or likeness through AI."
An AI system analyzed a short video, segmented scenes, applied emotional tags, and generated matching sound effects such as alarms and door closings. The system produced imperfect results—an unrealistic alarm and an unnatural clothing rustle—but a conversational interface allowed users to describe fixes and have the AI locate scenes and add specific ambient sounds like car noise. Experimental features commonly migrate into Adobe's suite; Harmonize moved from demo to Photoshop, and similar audio tools are expected around 2026. The feature timeline aligns with new protections for game voice actors requiring consent and disclosure for AI recreations.
Read at WIRED
Unable to calculate read time
Collection
[
|
...
]