Luma AI launched its artificial intelligence (AI) text-to-video generation model, Dream Machine, globally on Wednesday. The platform can generate up to five-second-long videos from simple or descriptive text prompts. The AI model can generate videos in various styles such as cinematic, animation, realistic, and more. The AI firm claims that Dream Machine was trained entirely on videos, and is capable of generating “physically accurate, consistent and eventful shots.” The platform is currently free to access and use, but it is likely to have a daily generation limit.
Usually, large language models (LLMs) are trained on text and images and then are moved to videos, as they require a deeper spatial and motion understanding. “Dream Machine is our first step towards building a universal imagination engine,” the company added.
[wp-rss-aggregator limit=”2″]
Dream Machine joins video generation platforms such as Runway AI and Pika 1.0 which are also available in the public domain and offer video generation between three to five seconds.
The AI platform takes 120 seconds to generate a video which the company claims will have 120 different frames. Dream Machine is also said to understand how people, animals, and objects interact with the physical world and create videos with accurate physics and character consistency.
[wp-rss-aggregator limit=”2″]
AI also highlighted several limitations in the current mode such as movement, text, morphing, and the famous Janus problem, where instead of showing a consistent 3D output, the AI model shows multiple canonical views of an object in different directions.
[wp-rss-aggregator limit=”3″]