# Kuku-Yalanji Synthetic Research Corpus v2

This is the complete public research release behind the Mob Translate Kuku-Yalanji corpus workbench. It contains
all 20,047 synthetic English-Kuku-Yalanji sentence pairs and the process evidence
needed to inspect how they were produced, reviewed, revised, split, and used in the v21.1 model experiment.

## Status

- Language: Kuku-Yalanji (ISO 639-3: `gvn`; Glottocode: `kuku1273`; NLLB token: `gvn_Latn`).
- Release: `2.0.0-research`, 2026-07-11T06:45:00Z.
- Corpus status: project-reviewed synthetic research material pending fluent-speaker and elder verification.
- This is not a speaker-certified dictionary or translation corpus.
- A database status such as `verified` means verified against this project's documented source and review
  procedure. It does not mean verified by a Kuku-Yalanji speaker.

## Contents

- `data/sentences.jsonl` and `data/sentences.csv`: every sentence with analysis, frame, lexical inventory,
  evidence, review state, rights state, authorship, and timestamps.
- `data/dictionary.yaml`, `dictionary.jsonl`, and `dictionary.csv`: 2,688
  source-preserving dictionary entries. The YAML file is canonical; JSONL and CSV are convenience views.
- `data/lexemes.*`: 1,870 scholarly working-lexeme records, including
  attestation, allomorphy, morphology, usage notes, watchlist, and retired-phantom state.
- `data/synthetic.db`: immutable SQLite snapshot containing all corpus and process tables.
- `data/reviews.jsonl`, `revisions.jsonl`, `lessons.jsonl`, `process_events.jsonl`, and related ledgers.
- `training/canonical-splits/`: the original deterministic 16,820/1,609/1,618 split.
- `training/v21.1-governed/`: the leakage-audited 16,642/1,609/1,606 split plus 190 quarantined rows.
- `documentation/`: the operator guide, production examples, grammar cheatsheet, and dictionary errata.
- `audits/`: the executable 20,000-sentence completion audit and its machine-readable result.
- `provenance/`: process logs, generation/closure scripts, core lexicon, linter, and export program.

## Recommended ML Input

Use `training/v21.1-governed/train.eng-gvn.jsonl` for the governed v21.1 treatment. Keep its validation, test,
and quarantine files separate. Do not train on `data/sentences.jsonl` and then report results on one of the
included held-out splits: that would invalidate the evaluation through leakage.

## Integrity

Run `sha256sum -c SHA256SUMS` from this directory. The release builder refuses to publish unless SQLite integrity,
foreign keys, the pinned dictionary hash, the 20,047-row count, and the
canonical corpus-content digest all match the completion audit.

## Rights and cultural responsibility

Read `DATA_USE.md` before use. Public download is not a blanket relicensing of community language knowledge,
the underlying dictionary, or third-party grammatical descriptions. External elder-shared and Bible controls,
audio, and model weights are deliberately excluded from this package.
