Meta, the parent company of Facebook and Instagram, has unveiled a new artificial intelligence model called Movie Gen. This cutting-edge technology can generate realistic-looking videos and audio clips based on user prompts, challenging the capabilities of leading AI companies like OpenAI and ElevenLabs.
Meta showcased samples of Movie Gen's impressive creations, including videos of animals engaging in activities like swimming and surfing, and clips that used real photos of people to depict them performing actions such as painting. The model can also generate synchronized background music and sound effects to complement the video content.
Movie Gen revolutionizes video editing with its ability to transform existing videos based on text inputs. From adjusting styles and transitions to making precise edits, Movie Gen empowers users to fine-tune their videos with unparalleled precision.
Create personalized videos with Movie Gen
Simply upload an image of yourself, and it's advanced model will transform it into a unique video that captures your likeness and natural movements.
The videos created by Movie Gen can be up to 16 seconds long, while the audio clips can extend to 45 seconds. Meta conducted blind tests comparing its model to offerings from other startups, including Runway, OpenAI, ElevenLabs, and Kling, and the results were favorable for Movie Gen.
The announcement of Movie Gen comes at a time when Hollywood is grappling with the potential benefits and challenges of generative AI video technology. While these tools can enhance and streamline filmmaking, concerns about copyright infringement and the misuse of deepfakes persist.
Meta's spokespeople indicated that the company is unlikely to make Movie Gen publicly available to developers, citing potential risks. However, they emphasized that Meta is actively collaborating with the entertainment industry and other content creators to explore potential applications for the model. Additionally, Meta plans to integrate Movie Gen into its own products sometime in the coming year.
Image Credit: Meta