How F5-TTS works (the model)
At a high level, F5-TTS is reference-audio-driven synthesis: your clip teaches the model what the voice sounds like; your text tells it what to say.
Step 1
Reference audio in
You provide a short WAV, MP3, M4A, or similar clip of one speaker. Vocalove strips long silences before synthesis so the model focuses on actual speech.
Step 2
Voice characteristics extracted
F5-TTS uses a diffusion-style architecture to learn timbre and speaking style from that single sample — pitch contour, rhythm, and vocal color — without a separate training step for each person.
Step 3
New text synthesized
You pass the words to speak as your script. The model generates fresh audio that follows your script while staying close to the reference voice. Output is typically a WAV file you can download or pipe into a talking-photo video step.