Make music from words! Meta unveils AI tool AudioCraft

Meta has unveiled AudioCraft, the revolutionary AI tool that brings high-quality audio and music generation right to your fingertips. AudioCraft empowers users to effortlessly create captivating audio and music from simple text prompts, opening up a realm of possibilities for musicians, content creators, and sound enthusiasts like never before.

With AudioCraft, users can explore new musical compositions without needing to play a single note on an instrument. Picture yourself easily enhancing your video ads on platforms like Instagram with mesmerizing soundtracks. This cutting-edge technology makes AI-generated audio and music accessible to you, putting the power of creativity in your hands.

Unleash your imagination with AudioCraft's three powerful models: MusicGen, AudioGen, and EnCodec. Simply provide text prompts, and MusicGen, trained on specially licensed music, will generate exceptional melodies for you. Meanwhile, AudioGen, trained on public sound effects, delivers lifelike audio from your textual inputs. Excitingly, Meta is introducing an enhanced version of its EnCodec decoder, ensuring higher-quality music generation with minimal artifacts. Meta is making its pre-trained AudioGen models available, allowing you to create various environmental sounds and effects, from barking dogs to honking cars and footsteps on different surfaces. Meta is also sharing the entire AudioCraft model weights and code, giving you access to these models for research purposes through open-source.

AI-generated audio has been a relatively untapped domain compared to images, videos, and text. That's why AudioCraft was designed to overcome these challenges, providing you with easy-to-use models capable of producing high-quality audio consistently. Meta has simplified the design of generative audio models, so you can make the most of our years of research and development while also encouraging you to experiment and create your own groundbreaking audio experiences.

AudioCraft users have the freedom to explore various audio tasks, from generating music to crafting sound effects and compression algorithms—all within the same code base. Meta says it believes in fostering a collaborative community, and that's why it is open-sourcing AudioCraft, empowering users to innovate and redefine how we produce and enjoy audio content.

With AudioCraft, users hold not just a tool but a platform to shape the future of AI-generated audio. MusicGen could become a new type of instrument, transforming the way music is composed, just like the impact synthesizers had when they first emerged.