Dataset specification · Evaluation scale
100 hours of Punjabi Scripted Speech
An evaluation scale build of 100 hours of Punjabi scripted speech. Building a benchmark or evaluation set that is large enough to trust, or fine-tuning a narrow domain. Speakers read prompts from a phonetically balanced script shown one line at a time, with retakes on any flubbed or misread line.

- Volume
- 100 hours
- Scale
- Evaluation scale
- Per speaker
- 20–30 minutes of accepted audio per speaker
- Accepted yield
- 85–90% of recorded time is accepted
How Punjabi scripted speech is captured
Speakers read prompts from a phonetically balanced script shown one line at a time, with retakes on any flubbed or misread line.
A 45-minute booth session yields roughly 300–400 prompts. One file per utterance, cut at the prompt boundary, so alignment is exact before any forced-alignment pass runs.
Yield at this style: 85–90% of recorded time is accepted. Prompt-level retakes catch problems inside the session, so very little is discarded afterwards. This is the highest-yield style we run.
The specification
| Field | Value |
|---|---|
| Language | Punjabi (pa-IN, Gurmukhi) |
| Volume | 100 hours |
| Equivalent | 200 speakers at 30 minutes each, or 100 speakers at one hour each |
| Speech type | Scripted Speech |
| Per speaker | 20–30 minutes of accepted audio per speaker |
| File granularity | One WAV per prompt, named by prompt ID and speaker ID |
| Prompt coverage | Triphone-balanced script with digit, date, name and domain-lexicon blocks |
| Leading/trailing silence | 200 ms padded, verified automatically on every file |
| Alignment | Prompt text is ground truth; deviations are flagged rather than silently corrected |
| Dialects | Majhi (standard), Malwai, Doabi, Puadhi |
| Transcription | Verbatim, native-speaker, second-pass reviewed |

Designing the script for Punjabi
- Script built for triphone coverage rather than word coverage, so rare phone contexts appear often enough to train on
- Digit strings, dates, currency and person names blocked separately, because these are where deployed ASR actually fails
- Domain lexicon injected from your product vocabulary when you supply one
- Sentence-length distribution spread deliberately, since all-short prompts produce a model that cannot handle long utterances
- Built against Punjabi specifically: Punjabi is tonal: high, low and level tones distinguish words, and tone is not marked in Gurmukhi orthography
- Code-mixing handled explicitly rather than edited out — Punjabi speech mixes Hindi and English freely, with strong diaspora influence in urban registers.
Running an evaluation scale Punjabi build
Four to six weeks. Two cities running in parallel means recruitment and recording overlap rather than queue behind each other.
Three batches at roughly two-week intervals, each one a self-contained, speaker-disjoint slice you can evaluate independently.
Cover all three historic regions (Majha, Malwa, Doaba); tone realisation differs measurably between them.
| Parameter | At this volume |
|---|---|
| Cities | Two, chosen for dialect contrast — Amritsar, Ludhiana |
| Studios | Two rooms running in parallel |
| Recruiters | Two coordinators |
| Speakers | ~200–240 |
| Sessions per day | 12–16 across both cities |
| Team | 2 coordinators, 4 engineers, 6 transcribers, 1 QA lead |
Cohort design
At 100 hours the cohort is deliberately simplified: two or three dialect groups rather than the full spread, with quotas enforced in aggregate. A build this size cannot support per-cell targets and should not claim to.
Requires literate speakers comfortable reading aloud in the target script, which is the main constraint on cohort breadth and has to be actively counterweighted.
| Dimension | Typical split | Why it matters for Punjabi |
|---|---|---|
| Gender | 50 / 50 | Pitch range differences change acoustic model behaviour; unbalanced cohorts bias recognition |
| Age | 18-25: 30%, 26-40: 40%, 41-60: 30% | Older speakers retain conservative Punjabi forms that younger urban speakers have lost |
| Region | Punjab / Haryana / Delhi and others | Dialect spread across 5 recognised varieties |
| Education | Mixed, including below-graduate | Prompt-reading fluency correlates with education and skews prosody |
| Condition | Studio / quiet room / field | Match the noise profile of your deployment |
Punjabi-specific considerations
- Punjabi is tonal: high, low and level tones distinguish words, and tone is not marked in Gurmukhi orthography
- Punjabi speech mixes Hindi and English freely, with strong diaspora influence in urban registers.
- Tonal variation is essentially unmodelled in public Punjabi data, and Malwai/Doabi rural speech is scarce.
Quality gates for scripted speech
- Prompt-to-audio match verified by a native reviewer; a misread line is a rejected file, not an edited transcript
- Hyperarticulation flagged — a speaker over-enunciating because they are reading produces audio that does not match deployment
- Clipping and truncation checked at both utterance boundaries
- Per-speaker prompt coverage confirmed, so no speaker silently skips a block
- Tone is unrepresented in text, so pronunciation lexicons must be built from audio, not from spelling
- Shahmukhi vs Gurmukhi script decisions must be fixed per project
100% technical QA, 25% content QA, escalating to full review on any batch that fails the agreed error threshold.
What goes wrong on scripted speech sessions
- Reading voice: flat prosody and unnatural stress that trains a model on speech nobody actually produces
- Prompt fatigue in the back half of long sessions, where accuracy drops and pace flattens
- Speakers who are not fluent readers, which quietly biases the cohort toward higher education bands
- Script leakage across speakers, producing a corpus that memorises sentences instead of covering sounds
Risks at evaluation scale in Punjabi
Cost at this band is driven by: Dialect spread is the main driver at this band — two contrasting cities cost more than two convenient ones; Turnaround compression, if you need it inside four weeks.
- Two-city cohorts can hide a dialect gap that only appears when the model meets a third region
- Transcription consistency between two city teams needs an explicit convention document or the batches will not match
- Punjabi carries 5 recognised varieties across Punjab, Haryana, Delhi, so the quota matrix is wider than the headline volume suggests
- Tonal variation is essentially unmodelled in public Punjabi data, and Malwai/Doabi rural speech is scarce.
Deliverables
- WAV audio to your naming convention, with the per-file manifest
- Verbatim Gurmukhi transcripts with utterance-level timestamps
- Prompt ID mapped to every utterance
- Verbatim deviation flags where the speaker departed from the script
- Per-utterance SNR and duration in the manifest
- Per-speaker metadata: age band, gender, region, dialect, education band
- Consent records mapped to speaker IDs
- QA report with pass rates, rejection reasons and agreement statistics
- Speaker-disjoint train / dev / test splits on request
What this trains, and what it does not
- ASR acoustic model baselines
- TTS voice building where a single speaker is recorded at depth
- Pronunciation lexicon and G2P validation
- Forced-alignment and phone-boundary work
Scripted audio contains no disfluencies, no false starts and no natural turn-taking. A model trained on it alone degrades sharply on real spontaneous input, so it is a baseline layer rather than a complete training set.
Frequently asked
Is 100 hours of Punjabi enough?
A solid evaluation set, and enough to fine-tune an existing multilingual model on a narrow domain. Still short of what a general production model needs.
Why scripted speech rather than another speech type?
ASR acoustic model baselines, TTS voice building where a single speaker is recorded at depth, Pronunciation lexicon and G2P validation are what this style is the right input for. Scripted audio contains no disfluencies, no false starts and no natural turn-taking. A model trained on it alone degrades sharply on real spontaneous input, so it is a baseline layer rather than a complete training set.
How long does an evaluation scale Punjabi build take?
Four to six weeks. Two cities running in parallel means recruitment and recording overlap rather than queue behind each other. Three batches at roughly two-week intervals, each one a self-contained, speaker-disjoint slice you can evaluate independently.
What does 100 hours of Punjabi scripted speech cost?
Quoted per delivered hour against this specification. At this band the drivers are dialect spread is the main driver at this band — two contrasting cities cost more than two convenient ones and turnaround compression, if you need it inside four weeks. Send the spec and you get one fixed figure.
How much QA is applied at this volume?
100% technical QA, 25% content QA, escalating to full review on any batch that fails the agreed error threshold.
Quote this Punjabi dataset
100 hours, scripted speech, Punjabi — evaluation scale. Adjust anything and send it.