Vidu Q1 offers generative tools for cinematic visual effects and audio generation, signaling ambitions in the VFX industry

Is the VFX industry the next to get transformed by generative video? ShengShu Technology’s Vidu Q1, a new generative video model, has its sights set on assisting both amateur and experienced creators with visual effects – and it’s associated with higher costs. Vidu Q1 is getting closer to Hollywood-like production, with a few firsts that the company is rolling out starting today from major improvements to higher quality visuals, but also the introduction of audio generation and editing. 

It’s no surprise as many (if not most) generative video platforms are evolving into an end-to-end solution, and Vidu is no different. And to add credence to ShengShu Technology’s efforts, Vidu is now in first spot in VBench’s generative video benchmark, managing to outrank Google Gemini and OpenAI’s Sora. The company with the momentum to cement itself in the film industry, is inking deals with studios – the latest of which includes a sci-fi series by Aura Productions that’ll span 50 episodes of shorts and will use Vidu.

When it comes to video editing, sometimes the hardest or most complex editing is involved in coming up with video transitions. Transitions you can download online, even royalty-free, are a dime a dozen, but they never feel or seem quite right. Of course there’s always the option to manually edit a transition, but it might require visual effects, which doesn’t come cheap for budding filmmakers and content creators. This is where Vidu Q1 is coming in with a hero feature, “First-to-Last Frame,” which does exactly as you’d expect. On Vidu Q1, you can upload two images that you want to create transitions between, and let the platform take care of the rest. Even if the images are not related in any way, Vidu Q1’s claim to fame is its “semantic understanding” capability which can find a highly believable transition that connects the two images together into a video clip. 

Moreover, Vidu Q1 is also landing a major new feature that includes music and soundtrack generation and the ability to edit and timestamp music simply with text inputs. The “AI Sound Effects” feature, as Vidu calls it, offers high-fidelity audio in up to 48 kHz, which is a first within the generative video space. With text prompts you can create sound effects for your film or even background music that’s generated to suit the mood of the video. And simply adjusting where and when the audio comes in and out can be edited with text. For instance typing out, “between 0-2 seconds add a wind sound,” achieves exactly that. 

“Vidu Q1 marks a pivotal step forward in making video generation smarter, more expressive, and more accessible,” said Yihang Luo, CEO of ShengShu Technology. “This new generative video model brings us closer to our vision of building the next-generation content creation platform – one that empowers anyone to turn imagination into reality with unprecedented ease, creative freedom and cinematic precision.”

And along with this update, Vidu Q1 is also introducing high definition 5 second clips that will output up to 1080p. The company is also offering major improvements to animations. This time, you’ll find that the transitions within the movements of animated characters are more seamless or fluid, and less choppier than before. 

The post Vidu Q1 offers generative tools for cinematic visual effects and audio generation, signaling ambitions in the VFX industry appeared first on Phandroid.