TTS datasets · LLM Evaluation
TTS Training Data for LLM Evaluation
Single-speaker and multi-speaker text-to-speech corpora with phonetically balanced scripts, consistent prosody, and studio-grade capture suitable for neural TTS. Applied to llm evaluation, the specification is driven by one thing: rubric scores with confidence intervals.
- Service
- TTS datasets
- Use case
- LLM Evaluation
- Primary metric
- Rubric scores with confidence intervals
Required data profile
- Native-speaker rater panels per language
- Rubric-based scoring with calibration
- Overlapping assignments for agreement
Technical specification
| Parameter | Standard |
|---|---|
| Sample rate | 48 kHz, 24-bit |
| Speaker consistency | Same booth, mic, distance and time-of-day banding across sessions |
| Script | Phonetically balanced, diphone-covering, domain-extended |
| Prosody | Neutral base set plus optional expressive styles |
| Alignment | Text-audio alignment verified per utterance |
| Silence | Leading/trailing silence trimmed to a fixed window |
Process
- Script generation with phoneme and diphone coverage analysis
- Voice casting with client shortlisting from audition samples
- Multi-session recording with drift monitoring between sessions
- Alignment verification and mispronunciation review by a linguist
- Delivery with a coverage report
Metrics this feeds
- Rubric scores with confidence intervals
- Inter-rater agreement
- Failure-mode distribution
Failure modes to design out
- Raters who are fluent but not native in the variety
- Rubrics written in English and applied to non-English output without localisation
Session drift is the main TTS killer. Every session is compared acoustically against the reference session and re-recorded if it drifts.
Deliverables
- Studio WAV per utterance
- Verified transcripts and pronunciation notes
- Phoneme coverage report
- Voice talent licence and consent documentation
Frequently asked
Is tts datasets the right service for llm evaluation?
It covers native-speaker rater panels per language. Most llm evaluation programmes combine it with at least one other service; we will say so in the scope rather than selling one line item.
What languages are available?
All 14 languages in the network plus Indian English accent bands.
How is the evaluation set handled?
Collected first, from speakers disjoint from the training cohort, so improvement is measurable.
Scope tts datasets for llm evaluation
Send the metric you need to move.