Support for new frontier TTS model

[bachittle]

If architecture is different, could be its own repository. Just thought I'd mention that this open source TTS is pretty cool. https://github.com/SWivid/F5-TTS. It is also designed to be efficient already, so it can be improved even further if switched to a ggml model. Someone already did an mlx implementation: https://github.com/lucasnewman/f5-tts-mlx.

[PABannier]

@bachittle Interesting, thanks! I'll add it to my (already very long list :D ) of my models we should have a look into.

[bachittle]

I know there are a lot of TTS models out there, curious to know what other models you were considering to look at. This one seems the most promising for compromising efficiency and performance, and came out recently. I know coqui tts was the only other one that was as good as this one but they went defunct.

Anyways understandable if you don't have the time, I will update this issue if I find any implementations or end up trying to do it myself (I may use this repo as reference 😉)

[bachittle]

seems like another model came out that the llama.cpp team is interested in 👀 ggml-org/llama.cpp#10173

[bachittle]

Even more models worth exploring. I haven't had time to translate any new models either, maybe I will make it a christmas project. Now there are a lot of options to work with that are even more promising, mostly due to generating coherent text that exceeds 1 minute and excelling in leaderboards.

• fish speech: https://huggingface.co/fishaudio/fish-speech-1.5
• OuteTTS: https://huggingface.co/OuteAI/OuteTTS-0.1-350M

[verynicecode]

Hello bachittle, Please can make mlx model Fish speech 1.5?

[bachittle]

I'm just waiting for more and more better models to show up, seems like this year might be a good one!

https://huggingface.co/Zyphra/Zonos-v0.1-hybrid