Meta’s AudioCraft AI Can Generate Music And Sound Effects From Text Prompts: How It Works – News18

Reported By: Shaurya Sharma

Last Updated: August 03, 2023, 12:29 IST

Menlo Park, California, USA

Meta AudioCraft needs text-based prompts to create music. (Image: Meta)

Meta AudioCraft wants text-based prompts to create music. (Image: Meta)

Ever considered a ChatGPT-like instrument, however for producing music? Meta has achieved precisely that with its AudioCraft generative AI instrument. Read on to know the way it works.

Creating unique soundtracks for tasks of all types is a time-consuming and costly course of that requires the experience and abilities of an artist. But what if an AI-powered instrument may create a customized soundtrack suited to your venture with just some prompts? Meta has achieved precisely that with its AudioCraft generative AI instrument. Meta guarantees that customers can create “high-quality, realistic audio and music from text” with the instrument household.

Meta notes that whereas AI generated photographs have taken off—AI-generated audio remains to be lagging behind, however with the brand new AudioCraft instrument household, customers will have the ability to create “music, sound, compression, and generation—all in the same place.”

Image: Meta

The instrument is split into three fashions: AudioGen, MusicGen, and EnCodec. AudioGen generates audio from textual content prompts primarily based on public sound results, whereas MusicGen does the identical factor however with music licensed by Meta. The EnCodec decoder—however—permits for greater high quality music era with fewer artifacts.

Users Can Generate a Slew of Sound Effects 

Meta additionally claims to be releasing pre-trained AudioGen fashions, which can let customers create environmental sounds and sound results—equivalent to a canine barking, vehicles honking, or footsteps on a wood flooring.

“The AudioCraft family of models are capable of producing high-quality audio with long-term consistency, and they’re easy to use,” Meta mentioned.

“With AudioCraft, we simplify the overall design of generative models for audio compared to prior work in the field—giving people the full recipe to play with the existing models that Meta has been developing over the past several years while also empowering them to push the limits and develop their own models,” it added.

Meta Has Made AudioCraft Tool Family Models Open Source

Meta can be making its audio era instruments open supply, like its Llama 2 LLM, in order that researchers and builders can create their very own fashions. Meta claims that by open sourcing the fashions, it could possibly assist advance the sphere of AI-generated audio.

Source web site: www.news18.com

Rating
( No ratings yet )
Loading...