Technology

How the machines learn Thakk

The strategy in one line: capture with AI in the loop, govern under guardianship, fine-tune open models — never train from scratch — and ship every model inside a product that helps someone speak Thakk today. Depth below; the plain-language version is always the manifesto.

Part 1

The technology strategy


Capture · AI in the loop from clip one

The corpus engine

Every recording that enters the vault is worked by machines so humans only do what humans must: voice-activity detection trims silence, quality scoring flags unusable audio at upload time, speaker diarization separates voices in elder conversations, and duplicate detection keeps the corpus honest.

Once the first ASR exists, it pre-transcribes the entire backlog so the paid transcription team corrects drafts instead of typing from silence — the single biggest cost lever in low-resource language work (3–5× faster per hour of audio). Active learning then closes the loop: the models tell us which kinds of speech the corpus lacks, and the prompt engine asks contributors for exactly that.

Models · adapt giants, own the result

The transfer-learning stack

Kodava Takk's neighbours — Kannada, Tulu, Malayalam — are already inside today's open multilingual models. We fine-tune rather than pre-train, so tens of hours of Thakk go a very long way and costs stay in lakhs, not crores:

  • Hear — ASR: Whisper large-v3, Meta MMS / w2v-BERT, and AI4Bharat IndicASR checkpoints, LoRA-adapted on transcribed Thakk.
  • Speak — TTS: VITS / Indic-TTS fine-tuned on consenting voice donors only; elder voice cloning solely with family + council consent.
  • Translate — IndicTrans2 / NLLB for the Thakk–Kannada–English triangle, trained on sentence pairs produced during transcription.
  • Converse — an open Indic LLM adapted on the Thakk text corpus, chained ASR → LLM → TTS into the Ainmane companion.

Evaluation · the community is the benchmark

Measured against our own ears

Every model release is scored two ways: word error rate on a held-out test set balanced across dialect (Mendele / Kiggat), age group, and genre — and a standing panel of fluent listeners who grade naturalness and correctness. A model that impresses a benchmark but sounds wrong to a Kodava grandmother does not ship.

Data · sovereignty by design

The guardianship pipeline

Consent tiers are enforced in code, not policy documents: an archive-only clip physically never enters a training run. Corpus releases are versioned like software, deposited to ELAR-standard archives and an Indian institutional mirror, and any model weights released publicly carry the Kodava data guardianship licence — usable for the community's benefit, never sellable. This is the Te Hiku Media doctrine, applied to Kodagu.

Part 2

The platform strategy


One platform, four surfaces, each feeding the next. The rule that binds them: open models in, guardianship-licensed intelligence out.

SurfaceWhat it isStack today → tomorrow
1 · CaptureThis site's recorder, sentence-prompt drives, WhatsApp voice-note intake, field-recording kits for elder sessionsNext.js PWA + direct-to-vault uploads → offline-first capture app, WhatsApp Business API bot
2 · Data trustThe consent-aware corpus: metadata, tiered permissions, versioned releases, redundant archivesSupabase (Postgres + private object storage) → S3-compatible vault, ELAN/ELAR export, researcher portal
3 · Model hubFine-tuned Thakk models, evaluated by the community, released under the guardianship licenceCloud GPU fine-tune runs (LoRA) → Hugging Face releases; on-device inference via whisper.cpp for offline Kodagu
4 · ProductsThakk Archive, talking dictionary, classroom pack, Ainmane the speaking companionWeb-first, offline-capable; WhatsApp for the diaspora; every product loops users back into contribution

The flywheel: products create speakers → speakers contribute voice → the corpus improves the models → better models make better products. Preservation that loops back to transmission.

Part 3

Research we stand on


Nothing here is invented from zero — Kodava Thakk deliberately follows the proven path of the world's indigenous-AI movement, and aims to contribute Kodagu's chapter back to it.

UNESCO · International Decade of Indigenous Languages (2022–2032)

The UN system's global frame for indigenous language revitalization, including the Indigenous Language Data Commons Incubator (with The GovLab and Microsoft) for community-governed language data in the age of AI.

Why it matters to Thakk: Our guardianship model is designed to plug into this decade: community-led data commons, ethical AI norms, and international visibility for Kodava Takk.

Te Hiku Media · Papa Reo (Aotearoa NZ)

The Māori-led language platform that trained te reo Māori speech recognition to ~92% accuracy and pioneered the Kaitiakitanga (guardianship) data licence — data governed by the community, never sold.

Why it matters to Thakk: The single most important proof that a small community can out-build big tech for its own language. Our licence, consent tiers, and council model follow theirs.

Indigenous Protocol & AI Working Group

An international collective of indigenous technologists and scholars publishing position papers on how AI should be designed from indigenous epistemologies.

Why it matters to Thakk: The ethical playbook for every design decision where technology touches culture — from elder voice cloning to what 'consent' must mean.

Mila · First Languages AI Reality (FLAIR)

The Québec AI institute's initiative building speech recognition for 200+ endangered North American indigenous languages, starting with the Wakashan family.

Why it matters to Thakk: State-of-the-art research on ASR when recordings are scarce — exactly our regime. A model for academic partnership done respectfully.

Mozilla Common Voice

The world's largest open crowdsourced voice platform: 100+ languages built from 30-second clips, community validation loops, and public progress dashboards.

Why it matters to Thakk: Our Level 0 mechanics — tiny contribution units, validation by the community, visible counters — are the Common Voice playbook applied to Thakk.

AI4Bharat · IIT Madras

IndicVoices (7,300+ hours across 22 Indian languages, 400+ districts), IndicASR, Indic-TTS, IndicTrans2 — open models and a district-by-district collection methodology, funded by Bhashini.

Why it matters to Thakk: Our nearest technical ancestors. Kodava Takk's Dravidian neighbours (Kannada, Tulu, Malayalam) live in these checkpoints — our fine-tunes start from them.

Project Vaani · IISc + ARTPARK + Google

District-anchored open speech corpus for India — including recordings from Kodagu district — published openly on Hugging Face.

Why it matters to Thakk: Phase 0 of our roadmap audits Vaani's Kodagu audio for usable Kodava speech, and their field methodology informs our elder-session protocol.

Bhashini · Government of India

MeitY's national language-AI mission funding open Indic datasets and models, with translation deployed at national scale.

Why it matters to Thakk: A funding and distribution channel: Kodava Thakk's corpus and models are designed to be Bhashini-compatible from day one.

Karya

The Microsoft Research India spin-out that pays rural Indians dignified wages (with royalties) for voice data and annotation work in their own languages.

Why it matters to Thakk: Our paid transcription and validation layer follows Karya's model: corpus building as a modest livelihood program for Kodagu, not extraction.

Meta AI · MMS & No Language Left Behind

Massively Multilingual Speech (ASR/TTS for 1,100+ languages) and NLLB (translation for 200 languages) — the open checkpoints UNESCO itself uses for its indigenous-language translator.

Why it matters to Thakk: Base models in our transfer-learning stack, alongside Whisper — we adapt giants, we never train from zero.

OpenAI Whisper (+ whisper.cpp)

The open speech-recognition family that fine-tunes remarkably well on small corpora, with on-device inference via whisper.cpp.

Why it matters to Thakk: Our Phase 0 ASR demo is a Whisper fine-tune; whisper.cpp keeps future tools working offline in Kodagu's patchy connectivity.

ELDP & the Endangered Languages Archive (ELAR)

Four decades of linguistic documentation standards: 48kHz WAV, time-aligned ELAN transcription, rich metadata, redundant archival deposit.

Why it matters to Thakk: AI models come and go; a properly archived corpus is forever. Everything we record is archived to these standards, mirrored beyond our own servers.

Google Arts & Culture · Woolaroo

An open-source photo-translation tool for endangered languages using image recognition, live for languages from Māori to Yugambeh.

Why it matters to Thakk: A pattern for lightweight, joyful learning products our talking dictionary can borrow once the lexicon layer exists.

Part 4

The product development strategy


North-star metric

Weekly consented minutes of Thakk recorded. Supporting: validated hours, transcribed hours, ASR word error rate, weekly Ainmane conversations. Vanity metrics (page views, followers) are never goals.

Who we build for

Four personas, in priority order: the elder (and their facilitator), the contributor at home or abroad, the transcriber earning from language work, and the learner the whole stack exists for.

Operating cadence

Ship product weekly. Release the corpus quarterly. Evaluate models each release with the listener panel. Review everything sensitive with the language council. Tie every big drive to a festival the community already loves.

Release train

v0.1 · Shipped · Aug 2026

Shipped

Level 0 — Capture

  • Browser recording + file upload, direct-to-vault storage
  • Speaker metadata: village, okka, dialect, age band, fluency
  • Four-tier guardianship consent enforced at intake
  • Live public dial, ticker, corpus tracker, contributor leaderboard with badges
  • Admin review queue (receive → review → reject)

North-star: weekly consented minutes recorded

v0.2 · Next · Sep–Oct 2026

In build

The Validation Loop

  • Listen-and-verify: community members grade clips (audible? Thakk? which dialect?)
  • Sentence-prompt mode: read-aloud drives fed from digitized Kodava text
  • Okka and village leaderboards; festival drive mode for Puthari and the Padayatra
  • WhatsApp voice-note intake for elders and the diaspora
  • AI at intake: voice-activity detection, quality scoring, duplicate detection on every upload

Target: 500 contributors · 100 validated hours

v0.3 · Q4 2026

Planned

The Data Trust

  • Consent ledger and versioned corpus releases (release v1.0 of the corpus)
  • Mirrored archival deposits: ELAR-standard packages + an Indian institutional mirror
  • First Whisper fine-tune: public demo of live Thakk transcription at a community event
  • Researcher access portal gated by the guardianship licence and council approval

Target: corpus release v1 · ASR demo word error rate < 40%

v0.4 · Q1 2027

Planned

Thakk Archive alpha

  • Public listening archive of consented recordings, credited to speaker, okka, and village
  • ASR-powered search: find recordings by what is said in them
  • ASR-in-the-loop transcription workbench — correctors, not typists (3–5× faster)
  • Paid transcription team onboarded Karya-style

Target: 50 transcribed hours · 8–10 paid transcribers

v1.0 · 2027

Planned

The Talking Dictionary

  • Master lexicon with real audio for every entry; offline-first PWA
  • TTS v1 from consenting voice donors (10–20 studio hours, VITS/Indic-TTS fine-tune)
  • ASR v2: word error rate under 25%, dialect-balanced evaluation
  • Kodava–Kannada–English translation v1 (IndicTrans2/NLLB fine-tune)

Target: WER < 25% · 5,000 dictionary sessions/month

v2.0 · 2027–2028

Planned

Ainmane — the speaking companion

  • Speech-to-speech loop: learner speaks imperfect Thakk → AI understands, replies in Thakk, gently corrects
  • Daily lessons, songs, family challenges; WhatsApp bot for the diaspora
  • Classroom pack with schools and the Mangalore University Kodava MA program
  • On-device inference (whisper.cpp) for offline Kodagu use

Target: 1,000 weekly conversations in Thakk

Product guardrails

  • Consent is a feature, not a checkbox: enforced in the pipeline, auditable by the council, revocable by the contributor.
  • Dialect quotas in every collection target and every evaluation set — Mendele and Kiggat on equal footing.
  • Offline-first always: Kodagu's connectivity is a design constraint, not an afterthought.
  • Open source by default; the entire stack (this site included) lives at github.com/kodagu-ai/kodavathakk.
  • Elder time is the scarcest resource in the project — technology schedules around elders, never the reverse.
  • Every product must loop its users back into contribution; a product that only consumes the corpus does not ship.

The strategy starts with your voice