Voice evaluation · मराठी
Marathi AI Voice Evaluation
Human evaluation of your speech models: MOS and preference testing for TTS, WER-in-context review for ASR, and native-speaker judgement on naturalness and intelligibility. This page covers how that works specifically for Marathi, where retains the retroflex lateral ळ, which has no hindi or english equivalent and is frequently substituted with ल by non-native transcribers.
- Language
- Marathi (mr-IN)
- Dialects covered
- 6
- Typical programme
- 500-2,000 hours
- Cities
- Mumbai, Pune, Nagpur
What changes when the language is Marathi
The service specification stays constant across languages; the linguistics do not. For Marathi, three things drive the design of a voice evaluation programme.
- Retains the retroflex lateral ळ, which has no Hindi or English equivalent and is frequently substituted with ल by non-native transcribers
- Dialect spread: Standard (Puneri), Varhadi (Vidarbha), Marathwadi, Konkani-influenced coastal Marathi
- Mumbai and Pune speech mixes Marathi, Hindi, and English in the same sentence. Marathi-only recordings collected in Pune under-represent the Mumbai reality of tri-lingual switching.
Technical specification
| Parameter | Standard |
|---|---|
| TTS | MOS (1-5), MUSHRA, and A/B preference protocols |
| ASR | Error typing: substitution, deletion, insertion, code-switch failure |
| Panel | Native speakers of the target variety, screened and calibrated |
| Sample size | Powered per the effect size you need to detect |
| Reporting | Per-item scores plus aggregate with confidence intervals |
Marathi cohort design
A representative Marathi cohort should be split roughly 40% western Maharashtra, 25% Vidarbha, 20% Marathwada, 15% Konkan rather than concentrated in Pune.
| Dimension | Typical split | Why it matters for Marathi |
|---|---|---|
| Gender | 50 / 50 | Pitch range differences change acoustic model behaviour; unbalanced cohorts bias recognition |
| Age | 18-25: 30%, 26-40: 40%, 41-60: 30% | Older speakers retain conservative Marathi forms that younger urban speakers have lost |
| Region | Maharashtra / Goa / parts of Karnataka and others | Dialect spread across 6 recognised varieties |
| Education | Mixed, including below-graduate | Prompt-reading fluency correlates with education and skews prosody |
| Condition | Studio / quiet room / field | Match the noise profile of your deployment |
Process
- Protocol design and sample-size calculation
- Panel recruitment and calibration on reference items
- Blind evaluation with attention checks
- Statistical analysis
- Report with per-error-type breakdown
Marathi-specific quality rules
- ळ vs ल substitution by Hindi-trained transcribers
- Anusvara placement varies between conservative and modern orthography
- Varhadi verb endings get 'corrected' to standard forms unless the guide explicitly requires verbatim dialect transcription
Attention checks and reference anchors are embedded so unreliable raters are detected and excluded before analysis.
Deliverables
- Raw per-rater scores
- Aggregated results with confidence intervals
- Error-type analysis
- Recommended fix priorities
Worked example
A representative Marathi voice evaluation engagement: 500 hours from 1,000 speakers, 50/50 gender, ages 18-45, spread across Mumbai, Pune, Nagpur, recorded to the specification above and delivered in WAV with a per-utterance manifest.
Timeline: 1-3 weeks per evaluation round.
Where this data is missing today
Available Marathi speech data is dominated by standard Puneri read speech. Vidarbha, Marathwada, and coastal Konkan varieties are severely under-collected, which is exactly where deployed voice products lose accuracy.
Frequently asked
How much does Marathi voice evaluation cost?
Priced per delivered hour or unit against a written spec. The cost drivers for Marathi are dialect spread, demographic narrowness and recording condition, in that order.
Which Marathi dialects are included?
By default Standard (Puneri), Varhadi (Vidarbha), Marathwadi, Konkani-influenced coastal Marathi and others, tagged per speaker. You can also commission a single-dialect corpus if you are targeting one region.
Can you deliver Marathi data in our format?
Yes. Raw per-rater scores is the default, but naming, schema and directory structure follow your pipeline.
How long does a Marathi programme take?
1-3 weeks per evaluation round.
Request a Marathi voice evaluation quote
Hours, speakers, dialects, deadline. Send what you have.