ElevenLabs’ AI Sound Generator Adds Background Score To Sora’s Mute Videos

Main Image
  • Like
  • Comment
  • Share

A few days ago, OpenAI released Sora, a breakthrough text-to-video generator tool capable of generating extremely high-quality videos. The tool sent a shockwave down the industry. The samples shared by OpenAI are nothing like any competing company has achieved. However, just days later, ElevenLabs has showcased a new AI-based tool capable of text-to-sound generation.

Here’s How ElevenLabs Showcased Its AI Sound Generator

In a post on the microblogging platform X (formerly known as Twitter), ElevenLabs showcased its AI Sound Generator. However, this announcement was unique because the company used some video-only sample shots created using OpenAI’s Sora and added some sound effects or background scores to them. It is important to mention that Sora can only generate videos, as can other elementary text-to-video platforms like Runway.

ElevenLabs claims that its AI Sound Generator can create any sound effect as long as users can describe it with the help of a short description. For instance, the second shot in the company’s video contains a jeep riding on a mountainous terrain, the same shot on OpenAI’s website. However, the ElevenLabs tool adds intricate sounds of gear changing in a heavy engine.

The Results “Sound” Promising

The tool has also added sound to the iconic shot created by Sora, where a woman is walking down a busy metropolitan street. In the video, we can hear the sound of footsteps, along with some vehicles honking in the background. The distinct chatter of the pedestrians is also audible. Moreover, the teaser looks promising and excites users for the final product’s arrival. For now, ElevenLabs is asking users to join a waiting list.

The AI Sound Generator Could Find Use In Several Industries

There are several use cases where the ElevenLabs AI sound generator can be handy. The first scenario that comes to mind is video editing, where editors can use the tool to add background sound effects to increase a scene’s impact. Instead of paying for licensed audio, sound engineers can use the tool to help create some samples to play around with. The audio created could be used by video creators, movie directors, music producers, etc.

Google Is Also Working On Its Text-To-Video Generator

While OpenAI and ElevenLabs are making significant leaps in the AI content generation industry, Google is also pacing the development of its first AI-based video generator called VideoPoet. The Alphabet-owned company announced VideoPoet some time ago. However, what’s interesting is that this tool should also be able to generate sound based on the video.

You can follow Smartprix on TwitterFacebookInstagram, and Google News. Visit smartprix.com for the most recent newsreviews, and tech guides.

Shikhar MehrotraShikhar Mehrotra
A tech enthusiast at heart, Shikhar Mehrotra has been writing news since college for an undergraduate degree in Journalism and Mass Communication. Over the last four years, he has worked with several national and international publications, including Republic World, and ScreenRant, writing news, how-to explainers, smartphone comparisons, reviews, and list-type articles. When he is not working, Shikhar likes to click pictures, make videos for his YouTube channel, and watch the American sitcom Friends.

Related Articles

ImageApple iPhone 16 Review: Feels And Handles Like A Pro, Minus The Price Tag

It’s that time of the year again when thousands of people are standing in a queue outside Apple Stores to get their hands on a new iPhone. While we would have credited that to Apple’s loyal customers who rush to upgrade every year, we managed to procure an iPhone 16 in the new, eye-catching Ultramarine …

ImageOpenAI Sora Text-to-Video AI Model: Generate 1-Minute Videos from Text Prompt and results are impressive

After transforming the world with text-based generative AI, OpenAI is back and now, it can generate videos. OpenAI introduced Sora, its AI text-to-video diffusion model, earlier on Thursday that can generate photo-realistic videos based on user prompts. It is currently available for red teams and a group of experts and visual designers who can use …

ImageOpenAI Text Classifier To Flag Content Written By AI

The popular ChatGPT reached a million users in just five days of its launch. You might have seen countless examples of how text-generating AI offers impeccable performance and it continues to be the case. Its maker OpenAI has released an AI text classifier that helps users detect whether the text submitted was written by a …

ImageGoogle Unveils Veo, an AI Video Generator Rivaling OpenAI’s Sora

At its annual developer conference, Google I/O 2024, Google made a splash by introducing Veo, its most advanced video generation model yet. Veo promises to revolutionize video creation by generating high-definition videos in various cinematic and visual styles. This unveiling comes amid stiff competition in the AI video generation, with rivals like OpenAI‘s Sora and …

ImageGoogle Lumiere Joins The AI Video Generation Race, Can Add Animation To Images

Google has revealed its AI-based video generation model called Lumiere. It is a multimodal video generation tool that generates five-second-long videos based on text or image prompts. Currently, there are very few models out there that can create videos based on a given description, including Runway Gen-2. Even though the platform isn’t publicly available, here’s …

Discuss

Be the first to leave a comment.