Meta unveils tool that creates 16 seconds of AI-generated video

Movie Gen has four capabilities: video generation, personalised video generation, precise video editing, and audio generation

By Jenny Priestley

Published: October 7, 2024 Updated: October 8, 2024

Movie Gen has four capabilities: video generation, personalised video generation, precise video editing, and audio generation

target=_blank title=Share on LinkedIn class=share-linkedin> Movie Gen has four capabilities: video generation, personalised video generation, precise video editing, and audio generation

https://www.tvbeurope.com/artificial-intelligence/meta-unveils-tool-that-creates-16-seconds-of-ai-generated-video title=Share via Email class=share-email>

Meta has announced Meta Movie Gen, a new tool that uses AI to create up to 16 seconds of video at 16 frames a second.

The tool uses text prompts to create video clips with synchronised AI-generated audio. According to the company, Movie Gen can generate personalised AI videos using a single photo.

Meta said the tool is still being tested before it launches publicly.

Screenshot from Meta video created using text input summary: A fluffy koala bear surfs. It has a grey and white coat and a round nose. The surfboard is yellow. The koala bear is holding onto the surfboard with its paws. The koala bear's facial expression is focused. The sun is shining. Movie Gen has four capabilities: video generation, personalised video generation, precise video editing, and audio generation.

In a blog post, Meta said the editing variant of Movie Gen performs localised edits like adding, removing, or replacing elements, and global changes such as background or style modifications. Unlike traditional tools that require specialised skills or generative ones that lack precision, Movie Gen preserves the original content, targeting only the relevant pixels, said the company.

For audio, Meta trained a 13B parameter audio generation model that can take a video and optional text prompts and generate audio up to 45 seconds, including ambient sound, Foley, and instrumental background music - all synced to the video content.

As we continue to improve our models and move toward a potential future release, we'll work closely with filmmakers and creators to integrate their feedback, said Meta.

By taking a collaborative approach, we want to ensure we're creating tools that help people enhance their inherent creativity in new ways they may have never dreamed would be possible.

Meta has released more technical details in a research paper.

LINK:	https://www.tvbeurope.com/artificial-intelligence/meta-unveils-tool-th...
	See more stories from tvb

More from TVB Europe