aidataservices.inAI data collection · India

Dataset specification · Programme scale

1,000 hours of Punjabi Scripted Speech

A programme scale build of 1,000 hours of Punjabi scripted speech. Training from scratch in a language where no adequate public corpus exists. Speakers read prompts from a phonetically balanced script shown one line at a time, with retakes on any flubbed or misread line.

Request a dataset quoteReply within one working day
Structured dataset packages ready for delivery — 1,000 hours of Punjabi Scripted Speech
Volume
1,000 hours
Scale
Programme scale
Per speaker
20–30 minutes of accepted audio per speaker
Accepted yield
85–90% of recorded time is accepted
01

How Punjabi scripted speech is captured

Speakers read prompts from a phonetically balanced script shown one line at a time, with retakes on any flubbed or misread line.

A 45-minute booth session yields roughly 300–400 prompts. One file per utterance, cut at the prompt boundary, so alignment is exact before any forced-alignment pass runs.

Yield at this style: 85–90% of recorded time is accepted. Prompt-level retakes catch problems inside the session, so very little is discarded afterwards. This is the highest-yield style we run.

Programme scale — what the build is actually made ofCitiesEight to tenStudiosTen rooms plus four mob…RecruitersTen coordinators, two r…Speakers~2,000–2,400Sessions per day70–90 nationallyTeam1 programme lead, 2 reg…
02

The specification

FieldValue
LanguagePunjabi (pa-IN, Gurmukhi)
Volume1,000 hours
Equivalent2,000 speakers at 30 minutes each, or 1,000 speakers at one hour each
Speech typeScripted Speech
Per speaker20–30 minutes of accepted audio per speaker
File granularityOne WAV per prompt, named by prompt ID and speaker ID
Prompt coverageTriphone-balanced script with digit, date, name and domain-lexicon blocks
Leading/trailing silence200 ms padded, verified automatically on every file
AlignmentPrompt text is ground truth; deviations are flagged rather than silently corrected
DialectsMajhi (standard), Malwai, Doabi, Puadhi
TranscriptionVerbatim, native-speaker, second-pass reviewed
Annotator labelling audio segments and speaker turns — supporting 1,000 hours of punjabi scripted speech
Annotator labelling audio segments and speaker turns
03

Designing the script for Punjabi

  • Script built for triphone coverage rather than word coverage, so rare phone contexts appear often enough to train on
  • Digit strings, dates, currency and person names blocked separately, because these are where deployed ASR actually fails
  • Domain lexicon injected from your product vocabulary when you supply one
  • Sentence-length distribution spread deliberately, since all-short prompts produce a model that cannot handle long utterances
  • Built against Punjabi specifically: Punjabi is tonal: high, low and level tones distinguish words, and tone is not marked in Gurmukhi orthography
  • Code-mixing handled explicitly rather than edited out — Punjabi speech mixes Hindi and English freely, with strong diaspora influence in urban registers.
04

Running a programme scale Punjabi build

Twelve to sixteen weeks. This is a programme with its own governance rather than a project — weekly demographic reconciliation, a standing protocol review and a named counterpart on your side.

Ten to twelve batches, fortnightly, with a formal acceptance test per batch. Rejected batches are re-recorded rather than patched, so schedule contingency is built into the plan.

Cover all three historic regions (Majha, Malwa, Doaba); tone realisation differs measurably between them.

ParameterAt this volume
CitiesEight to ten — Amritsar, Ludhiana, Jalandhar, Chandigarh, Patiala
StudiosTen rooms plus four mobile rigs
RecruitersTen coordinators, two regional managers, one programme lead
Speakers~2,000–2,400
Sessions per day70–90 nationally
Team1 programme lead, 2 regional managers, 10 coordinators, 20 engineers, 45 transcribers, 5 QA leads
05

Cohort design

At 1,000 hours the quota matrix is enforced per cell, not in aggregate. Every dialect, age and gender combination carries its own target and is signed off individually before final acceptance, because an aggregate 50/50 split can hide a cell that was never filled at all.

Requires literate speakers comfortable reading aloud in the target script, which is the main constraint on cohort breadth and has to be actively counterweighted.

DimensionTypical splitWhy it matters for Punjabi
Gender50 / 50Pitch range differences change acoustic model behaviour; unbalanced cohorts bias recognition
Age18-25: 30%, 26-40: 40%, 41-60: 30%Older speakers retain conservative Punjabi forms that younger urban speakers have lost
RegionPunjab / Haryana / Delhi and othersDialect spread across 5 recognised varieties
EducationMixed, including below-graduatePrompt-reading fluency correlates with education and skews prosody
ConditionStudio / quiet room / fieldMatch the noise profile of your deployment
06

Punjabi-specific considerations

  • Punjabi is tonal: high, low and level tones distinguish words, and tone is not marked in Gurmukhi orthography
  • Punjabi speech mixes Hindi and English freely, with strong diaspora influence in urban registers.
  • Tonal variation is essentially unmodelled in public Punjabi data, and Malwai/Doabi rural speech is scarce.
07

Quality gates for scripted speech

  • Prompt-to-audio match verified by a native reviewer; a misread line is a rejected file, not an edited transcript
  • Hyperarticulation flagged — a speaker over-enunciating because they are reading produces audio that does not match deployment
  • Clipping and truncation checked at both utterance boundaries
  • Per-speaker prompt coverage confirmed, so no speaker silently skips a block
  • Tone is unrepresented in text, so pronunciation lexicons must be built from audio, not from spelling
  • Shahmukhi vs Gurmukhi script decisions must be fixed per project

100% technical QA, 7% content QA stratified across every axis, plus a blind 1% re-transcription audit measuring inter-annotator agreement across the whole programme.

08

What goes wrong on scripted speech sessions

  • Reading voice: flat prosody and unnatural stress that trains a model on speech nobody actually produces
  • Prompt fatigue in the back half of long sessions, where accuracy drops and pace flattens
  • Speakers who are not fluent readers, which quietly biases the cohort toward higher education bands
  • Script leakage across speakers, producing a corpus that memorises sentences instead of covering sounds
09

Risks at programme scale in Punjabi

Cost at this band is driven by: Programme management overhead, which is real at this scale and should be quoted explicitly rather than hidden in the hourly rate; The tail of rare dialect and demographic quotas.

  • Transcriber consistency across a 45-person team is the dominant quality risk and needs continuous calibration, not a one-time briefing
  • Speaker pool exhaustion in smaller cities, where the genuinely available cohort is finite
  • Specification drift over three months as your model team learns what it actually needs — build a change-control step in rather than pretending it will not happen
  • Punjabi carries 5 recognised varieties across Punjab, Haryana, Delhi, so the quota matrix is wider than the headline volume suggests
  • Tonal variation is essentially unmodelled in public Punjabi data, and Malwai/Doabi rural speech is scarce.
10

Deliverables

  • WAV audio to your naming convention, with the per-file manifest
  • Verbatim Gurmukhi transcripts with utterance-level timestamps
  • Prompt ID mapped to every utterance
  • Verbatim deviation flags where the speaker departed from the script
  • Per-utterance SNR and duration in the manifest
  • Per-speaker metadata: age band, gender, region, dialect, education band
  • Consent records mapped to speaker IDs
  • QA report with pass rates, rejection reasons and agreement statistics
  • Speaker-disjoint train / dev / test splits on request
11

What this trains, and what it does not

  • ASR acoustic model baselines
  • TTS voice building where a single speaker is recorded at depth
  • Pronunciation lexicon and G2P validation
  • Forced-alignment and phone-boundary work

Scripted audio contains no disfluencies, no false starts and no natural turn-taking. A model trained on it alone degrades sharply on real spontaneous input, so it is a baseline layer rather than a complete training set.

Frequently asked

Is 1,000 hours of Punjabi enough?

Enough to train from scratch in a single language, or to build a strong multilingual foundation across a language family.

Why scripted speech rather than another speech type?

ASR acoustic model baselines, TTS voice building where a single speaker is recorded at depth, Pronunciation lexicon and G2P validation are what this style is the right input for. Scripted audio contains no disfluencies, no false starts and no natural turn-taking. A model trained on it alone degrades sharply on real spontaneous input, so it is a baseline layer rather than a complete training set.

How long does a programme scale Punjabi build take?

Twelve to sixteen weeks. This is a programme with its own governance rather than a project — weekly demographic reconciliation, a standing protocol review and a named counterpart on your side. Ten to twelve batches, fortnightly, with a formal acceptance test per batch. Rejected batches are re-recorded rather than patched, so schedule contingency is built into the plan.

What does 1,000 hours of Punjabi scripted speech cost?

Quoted per delivered hour against this specification. At this band the drivers are programme management overhead, which is real at this scale and should be quoted explicitly rather than hidden in the hourly rate and the tail of rare dialect and demographic quotas. Send the spec and you get one fixed figure.

How much QA is applied at this volume?

100% technical QA, 7% content QA stratified across every axis, plus a blind 1% re-transcription audit measuring inter-annotator agreement across the whole programme.

Quote this Punjabi dataset

1,000 hours, scripted speech, Punjabi — programme scale. Adjust anything and send it.

Request a dataset quote