[REQ] "AI" audio tools to integrate & more

[MarcoRavich]

Hi there, thanks for this very interesting set of free audio plugins !

It would be extremely useful to have more "AI" functions - such as multitrack synching, automixing, guitar sim, DRC, etc. - available (and not only for audacity).

We're collecting some in our HyMPS project (under the AUDIO section \ AI-based page), but here's some so-called "awesome" resources list to carefully check:

• https://github.com/ybayle/awesome-deep-learning-music
• https://github.com/skirdey/awesome-deep-audio
• https://github.com/archinetai/audio-ai-timeline
• https://github.com/EmulationAI/awesome-large-audio-models

Last but not least, it would be great to have a more "generic" version (exploiting JUCE maybe ?) of this plugins pack to allow its use in users' favorite editing softwares.

Hope that inspires !

[RyanMetcalfeInt8]

Hi @forart,

Thank you for your interest in this project! And also, thanks for posting all of those great resources -- I've already started to go through some of the lists -- they are quite comprehensive.

I'll take a look at JUCE -- it would certainly be advantageous to somehow encapsulate these plugins such that they are compatible with more frameworks. The trouble that I typically have with more 'generic' plugin frameworks is that somehow limit some of the capabilities, but certainly open to take another look.

Best Regards!
Ryan

[MarcoRavich]

Hi @forart,
I'll take a look at JUCE -- it would certainly be advantageous to somehow encapsulate these plugins such that they are compatible with more frameworks.

Well, @leomccormack's SPARTA is a good example to have an idea of what is possible to "manage" with JUCE:

Hope that inspires.

[MarcoRavich]

Just mentioned this discussion in Audacity's Real-time-capable limiter issue: what about "porting" @jamesnapierstuart's AI Compressor within OV plugins?

note: I've also created a specific Effects subsection in HyMPS's AI-based page, where this project is listed too.

[MarcoRavich]

Bump.

Just found an interesting open project that may help/inspire: @hazenluk's Real-time Modeling of Nonlinear Dynamical Systems for Analog Audio Emulation, a Neural Network Based Modelling of Audio Effects, Using JUCE.

Its Youtube Demo shows the model being used in a VST environment:

[MarcoRavich]

Bump.

Well, the most popular and discussed AI-based audio tool these days is undoubtedly @sdatkinson's Neural Amp Modeler / Plug-in (VST3/AU built with iPlug2) even if it uses G-Colab service for training.

It would be interesting for Intel-based PC owners to have an offline OpenVINO-based version too.

Hope that inspires.

[MarcoRavich]

Bump.

This might be the "columbus egg":
@yeeking's ai-enhanced-audio-book - A repository of AI-enhanced audio plugins written using C++, JUCE, libtorch, RTNeural and other libraries