aidataservices.inAI data collection · India

Dataset specification · Flagship cohort

2,000 speakers of Punjabi Scripted Speech

A flagship cohort build of 2,000 speakers of Punjabi scripted speech. Maximum speaker diversity, for foundation work or a reference corpus where per-cell statistics must hold. Speakers read prompts from a phonetically balanced script shown one line at a time, with retakes on any flubbed or misread line.

Request a dataset quoteReply within one working day
Structured dataset packages ready for delivery — 2,000 speakers of Punjabi Scripted Speech
Volume
2,000 speakers
Scale
Flagship cohort
Per speaker
20–30 minutes of accepted audio per speaker
Accepted yield
85–90% of recorded time is accepted
01

How Punjabi scripted speech is captured

Speakers read prompts from a phonetically balanced script shown one line at a time, with retakes on any flubbed or misread line.

A 45-minute booth session yields roughly 300–400 prompts. One file per utterance, cut at the prompt boundary, so alignment is exact before any forced-alignment pass runs.

Yield at this style: 85–90% of recorded time is accepted. Prompt-level retakes catch problems inside the session, so very little is discarded afterwards. This is the highest-yield style we run.

Flagship cohort — what the build is actually made ofCitiesTwelve or more, includi…StudiosTwelve rooms plus five …RecruitersFourteen coordinators, …Audio yield~1,000 hours at 30 minu…Sessions per day90–110Team1 programme director, 3…
02

The specification

FieldValue
LanguagePunjabi (pa-IN, Gurmukhi)
Volume2,000 speakers
Equivalent1,000 hours at 30 minutes per speaker
Speech typeScripted Speech
Per speaker20–30 minutes of accepted audio per speaker
File granularityOne WAV per prompt, named by prompt ID and speaker ID
Prompt coverageTriphone-balanced script with digit, date, name and domain-lexicon blocks
Leading/trailing silence200 ms padded, verified automatically on every file
AlignmentPrompt text is ground truth; deviations are flagged rather than silently corrected
DialectsMajhi (standard), Malwai, Doabi, Puadhi
TranscriptionVerbatim, native-speaker, second-pass reviewed
Audio QC engineer inspecting waveforms and spectrograms — supporting 2,000 speakers of punjabi scripted speech
Audio QC engineer inspecting waveforms and spectrograms
03

Designing the script for Punjabi

  • Script built for triphone coverage rather than word coverage, so rare phone contexts appear often enough to train on
  • Digit strings, dates, currency and person names blocked separately, because these are where deployed ASR actually fails
  • Domain lexicon injected from your product vocabulary when you supply one
  • Sentence-length distribution spread deliberately, since all-short prompts produce a model that cannot handle long utterances
  • Built against Punjabi specifically: Punjabi is tonal: high, low and level tones distinguish words, and tone is not marked in Gurmukhi orthography
  • Code-mixing handled explicitly rather than edited out — Punjabi speech mixes Hindi and English freely, with strong diaspora influence in urban registers.
04

Running a flagship cohort Punjabi build

Sixteen to twenty-two weeks, run in waves so that recruitment in the harder catchments starts early rather than being left to the end.

Ten to twelve batches with rolling demographic reconciliation, since a quota gap discovered in week eighteen is very expensive to close.

Cover all three historic regions (Majha, Malwa, Doaba); tone realisation differs measurably between them.

ParameterAt this volume
CitiesTwelve or more, including rural catchments — Amritsar, Ludhiana, Jalandhar, Chandigarh, Patiala
StudiosTwelve rooms plus five mobile rigs
RecruitersFourteen coordinators, three regional managers, one programme director
Audio yield~1,000 hours at 30 minutes per speaker
Sessions per day90–110
Team1 programme director, 3 regional managers, 14 coordinators, 24 engineers, 45 transcribers, 6 QA leads
05

Cohort design

At 2,000 speakers the quota matrix is enforced per cell, not in aggregate. Every dialect, age and gender combination carries its own target and is signed off individually before final acceptance, because an aggregate 50/50 split can hide a cell that was never filled at all.

Requires literate speakers comfortable reading aloud in the target script, which is the main constraint on cohort breadth and has to be actively counterweighted.

DimensionTypical splitWhy it matters for Punjabi
Gender50 / 50Pitch range differences change acoustic model behaviour; unbalanced cohorts bias recognition
Age18-25: 30%, 26-40: 40%, 41-60: 30%Older speakers retain conservative Punjabi forms that younger urban speakers have lost
RegionPunjab / Haryana / Delhi and othersDialect spread across 5 recognised varieties
EducationMixed, including below-graduatePrompt-reading fluency correlates with education and skews prosody
ConditionStudio / quiet room / fieldMatch the noise profile of your deployment
06

Punjabi-specific considerations

  • Punjabi is tonal: high, low and level tones distinguish words, and tone is not marked in Gurmukhi orthography
  • Punjabi speech mixes Hindi and English freely, with strong diaspora influence in urban registers.
  • Tonal variation is essentially unmodelled in public Punjabi data, and Malwai/Doabi rural speech is scarce.
07

Quality gates for scripted speech

  • Prompt-to-audio match verified by a native reviewer; a misread line is a rejected file, not an edited transcript
  • Hyperarticulation flagged — a speaker over-enunciating because they are reading produces audio that does not match deployment
  • Clipping and truncation checked at both utterance boundaries
  • Per-speaker prompt coverage confirmed, so no speaker silently skips a block
  • Tone is unrepresented in text, so pronunciation lexicons must be built from audio, not from spelling
  • Shahmukhi vs Gurmukhi script decisions must be fixed per project

100% technical QA, 7% content QA stratified across every axis, blind re-transcription audit, and per-cell demographic sign-off before final acceptance.

08

What goes wrong on scripted speech sessions

  • Reading voice: flat prosody and unnatural stress that trains a model on speech nobody actually produces
  • Prompt fatigue in the back half of long sessions, where accuracy drops and pace flattens
  • Speakers who are not fluent readers, which quietly biases the cohort toward higher education bands
  • Script leakage across speakers, producing a corpus that memorises sentences instead of covering sounds
09

Risks at flagship cohort in Punjabi

Cost at this band is driven by: Long-tail demographic cells, which dominate both cost and schedule at this size.

  • The final 15% of the cohort — the rarest demographic cells — routinely takes as long as the first half and should be scheduled first, not last
  • Speaker pool exhaustion is a hard constraint in all but the largest languages
  • Voice-based duplicate detection across 2,000 speakers is a genuine engineering task, not a spreadsheet check
  • Punjabi carries 5 recognised varieties across Punjab, Haryana, Delhi, so the quota matrix is wider than the headline volume suggests
  • Tonal variation is essentially unmodelled in public Punjabi data, and Malwai/Doabi rural speech is scarce.
10

Deliverables

  • WAV audio to your naming convention, with the per-file manifest
  • Verbatim Gurmukhi transcripts with utterance-level timestamps
  • Prompt ID mapped to every utterance
  • Verbatim deviation flags where the speaker departed from the script
  • Per-utterance SNR and duration in the manifest
  • Per-speaker metadata: age band, gender, region, dialect, education band
  • Consent records mapped to speaker IDs
  • QA report with pass rates, rejection reasons and agreement statistics
  • Speaker-disjoint train / dev / test splits on request
11

What this trains, and what it does not

  • ASR acoustic model baselines
  • TTS voice building where a single speaker is recorded at depth
  • Pronunciation lexicon and G2P validation
  • Forced-alignment and phone-boundary work

Scripted audio contains no disfluencies, no false starts and no natural turn-taking. A model trained on it alone degrades sharply on real spontaneous input, so it is a baseline layer rather than a complete training set.

Frequently asked

Is 2,000 speakers of Punjabi enough?

Enough for foundation-scale speaker diversity and for a reference cohort with statistically meaningful per-dialect and per-demographic cells.

Why scripted speech rather than another speech type?

ASR acoustic model baselines, TTS voice building where a single speaker is recorded at depth, Pronunciation lexicon and G2P validation are what this style is the right input for. Scripted audio contains no disfluencies, no false starts and no natural turn-taking. A model trained on it alone degrades sharply on real spontaneous input, so it is a baseline layer rather than a complete training set.

How long does a flagship cohort Punjabi build take?

Sixteen to twenty-two weeks, run in waves so that recruitment in the harder catchments starts early rather than being left to the end. Ten to twelve batches with rolling demographic reconciliation, since a quota gap discovered in week eighteen is very expensive to close.

What does 2,000 speakers of Punjabi scripted speech cost?

Quoted per delivered hour against this specification. At this band the drivers are long-tail demographic cells, which dominate both cost and schedule at this size. Send the spec and you get one fixed figure.

How much QA is applied at this volume?

100% technical QA, 7% content QA stratified across every axis, blind re-transcription audit, and per-cell demographic sign-off before final acceptance.

Quote this Punjabi dataset

2,000 speakers, scripted speech, Punjabi — flagship cohort. Adjust anything and send it.

Request a dataset quote