ByteDance’s next-gen AI model can generate clips based on text, images, audio, and video

An AI-generated image showing a person putting laundry on a clothesline

ByteDance says its new AI video model can more accurately follow prompts. | Image: ByteDance

Big Tech’s race to leapfrog the latest AI models continues with the launch of ByteDance’s next-gen video generator. In a blog post, ByteDance – the China-based company behind TikTok – says Seedance 2.0 supports prompts that combine text, images, video, and audio.

The company claims it “delivers a substantial leap in generation quality,” offering improvements in generating complex scenes with multiple subjects and its ability to follow instructions. Users can refine their text prompts by feeding Seedance 2.0 up to nine images, three video clips, and three audio clips.

The model can generate up to 15-second clips with audio, while taking cam …

Read the full story at The Verge.

Read more @ TheVerge

Latest posts

The cute and cursed story of Furby

The hottest toy of 1998 was sort of adorable, and sort of annoying. It couldn't do much - couldn't do anything, really - but...

The best Switch 2 controller just got better (and a little worse)

The pink option is one of the prettiest controllers I’ve used. | Image: Cameron Faulkner / The Verge Crowning the EasySMX S10 the best Switch...

What we’re listening to, watching, and reading right now.

There is so much art out there that it’s absolutely impossible to keep up. Whether it’s a slept-on post-punk album from the ‘80s, a...

Listen to this: Mabe Fratti’s experimental cello pop

The opening notes of "Kravitz", which kicks off Mabe Fratti's 2024 record Sentir Que No Sabes, are lodged in my brain permanently. It's not...