Max generation time 30 seconds

[gitfabianmeyer]

Hi, first of all, great work! Saw this on reddit. Is the 30 seconds limitation due to the model behind it or what is the reason? Is it planned to increase this? Or even possible?

[gabotechs]

It's a bit involved, the current models only generate up to 30 seconds, this is a hard limitation of the models used (https://audiocraft.metademolab.com/musicgen.html)

There's a way of overcoming this limitation using a variation of the model that can be conditioned not only by text prompts but also by music samples (https://huggingface.co/facebook/musicgen-melody), my plan is to implement this.

[freetoad]

does musicgen-melody allow users to generate vocals?

[gabotechs]

I don't think so, musicgen-melody just allows conditioning the music generating based on other music samples, but it's still not trained to generate vocals

[Nurb4000]

Looking forward to this, as 30 seconds is not overly useful beyond "hey, it works" ( and i realize its not your fault, appreciate what you have done.. ). Its too bad they 'hard limit' to such a small time.

It's a bit involved, the current models only generate up to 30 seconds, this is a hard limitation of the models used (https://audiocraft.metademolab.com/musicgen.html)

There's a way of overcoming this limitation using a variation of the model that can be conditioned not only by text prompts but also by music samples (https://huggingface.co/facebook/musicgen-melody), my plan is to implement this.

[adamperez]

There's a section on the MusicGen site titled "Long generation", where they reference having a sliding window to make a longer track. Is that something that is surfaced with this tool?

[George3d6]

Also curious about what @adamperez mentioned? And, if not surfaced, how easy would it be to add? I'd be interested in contributing it

[rubeniskov]

To support these features, the ONNX export models need to be available for melody models.

huggingface/optimum#2095

[designspin]

This is super impressive and lightning quick on my m1 Mac studio... Overcoming the 30 second limit would be awesome, this would be a super time saver for my indie game music. It takes me weeks to come up with something myself, this is churning out better results in minutes!