Google Lumiere Joins The AI Video Generation Race, Can Add Animation To Images

Main Image
  • Like
  • Comment
  • Share

Google has revealed its AI-based video generation model called Lumiere. It is a multimodal video generation tool that generates five-second-long videos based on text or image prompts. Currently, there are very few models out there that can create videos based on a given description, including Runway Gen-2. Even though the platform isn’t publicly available, here’s everything we know about it.

Lumiere Uses STUNet Architecture For Creating Videos

Lumiere Uses STUNet Architecture For Creating Videos

A research paper mentions that Lumiere uses STUNet architecture to create videos as a whole instead of generating multiple frames and combining them. Due to the new technology, both the objects in the video and the movement appear natural. Even so, Lumiere generates 80 frames per second instead of 25 frames by Stable Diffusion.

As mentioned earlier, one can’t try Lumiere and create videos with it. However, a landing page showcases several videos created by using the tool. The website contains several videos made on the original video but in a different style. Further, the tool can animate a certain video part based on the prompt.

Last but not least, the tool can also generate and fill areas of a video that aren’t available in the source file, which looks both impressive and slightly worrisome at the same time. Moreover, the tool looks impressive. However, there’s no word on when it will be available publicly.

You can follow Smartprix on TwitterFacebookInstagram, and Google News. Visit smartprix.com for the most recent newsreviews, and tech guides.

Shikhar MehrotraShikhar Mehrotra
A tech enthusiast at heart, Shikhar Mehrotra has been writing news since college for an undergraduate degree in Journalism and Mass Communication. Over the last four years, he has worked with several national and international publications, including Republic World, and ScreenRant, writing news, how-to explainers, smartphone comparisons, reviews, and list-type articles. When he is not working, Shikhar likes to click pictures, make videos for his YouTube channel, and watch the American sitcom Friends.

Related Articles

ImageExclusive: Samsung Galaxy Z Fold 6 360-Degree Video And 5K Renders; Say Hello to Boxy Aesthetics

The Galaxy Z Fold 6, leaks and rumors about the device have been floating around for a while now and yesterday we reported that Samsung might launch the next-generation foldables, Galaxy Ring & Galaxy XR in July. The Galaxy Z Fold 5 was an incremental upgrade over its predecessor and fans now have their fingers …

ImageGoogle Gemini API Is Now Available For Developers

Recently, Google introduced the Gemini language model with advanced multimodal capabilities. On December 13, the company announced that it is making one of the three Gemini models, i.e., Gemini Pro, available to developers and organizations, along with a range of other AI tools, models, and infrastructure. Developers looking to try Gemini Pro can use the …

ImageGoogle Pixel 8 Pro gets first-ever AI Core Update

Google Pixel 8 Pro phones are now getting one-of-a-kind updates. Dubbed as the first-ever official update on the AI Core app, it app enhances the AI functionalities. As reported by 9to5Google, the update bumps the app version from 0.release.539035001 to 0.release.58265226 and is available across Android 14 builds (stable and beta QR1 and QPR2) builds. …

ImageElevenLabs’ AI Sound Generator Adds Background Score To Sora’s Mute Videos

A few days ago, OpenAI released Sora, a breakthrough text-to-video generator tool capable of generating extremely high-quality videos. The tool sent a shockwave down the industry. The samples shared by OpenAI are nothing like any competing company has achieved. However, just days later, ElevenLabs has showcased a new AI-based tool capable of text-to-sound generation. Here’s …

ImageGoogle AI Video Generator Phenaki could revolutionize the industry

Google is coming up with new inventions every now and then for the masses. Now, the Alphabet-owned organization is back with AI-backed elements to compete with other AI products in the industry. Recently, Google’s AI video generator has joined the race of AI-backed applications. It is pretty similar to other AI image generators that work …

Discuss

Be the first to leave a comment.