AI effects have arrived for one of the most popular open-source audio editors available. In a recent blog post, it was announced that Audacity would be getting OpenVINO AI effects built by Intel (h/t NotebookCheck). The new AI plug-ins for Audacity are expected to appeal to both music makers and podcasters alike. In brief, OpenVINO tools are being made available for Audacity users who would appreciate AI-enhanced music generation, music style remixing, music separation, noise suppression, and voice-to-text transcription. All these AI features “run 100% locally on your PC,” asserts the Audacity team.
Generative AI has proven to be one of the most show-stopping aspects of this new era. With Audacity's new Music Generation and Music Style Remix features, users will be able to generate new music from a text prompt, or generate new compositions based on pre-existing audio soundscapes. It is explained that this plugin leverages Stable Diffusion - and Riffusion in particular.
Another audio skill that suits the abilities of AI is Music Separation. Using this new tool, Audacity users will be able to break apart the separate instruments in any music track. This could be a boon for those wishing to learn a particular instrument or for creating backing tracks.
The other new OpenVINO-based AI tools that have been released for Audacity will be welcome among podcasters – as the blog states. Audacity devs admit that the new Noise Suppression tool “behaves similar to Audacity’s built-in Noise Removal effect.” However, if you aren’t happy with the current noise suppression features available, this will surely be worth a try. It should be ‘smarter’…
Last but not least, Audacity has gained a Transcription tool powered by the well-known Whisper.cpp. This is useful for podcasters as it can “both transcribe and translate words and outputs to a label track,” says the Audacity team. It is also a boon to anyone wishing to take notes during a meeting, lecture, presentation, and so on.
Intel, the developer of the open-source OpenVINO, has made the new Audacity plug-ins available on GitHub. Potential users are warned that the release available at the time of writing (v3.4.2-R1) is only compatible with the Audacity 3.4.2 64-bit release for Windows. Step-by-step installation instructions are provided, and there is even a video available showing how to add them and check that they have been made available in the application’s ‘Effect’ menu.
The newly available OpenVINO AI plugins are for Windows only. However, the makers of Audacity seem to be happy for tinkerers to make them available for other Audacity platforms. “The project may be compiled on Linux and macOS, though no instructions are available for the latter yet,” says the Audacity blog.