# Dataset schema

## Sentence record

The JSONL sentence record contains: `id`, `batch`, `sequence`, `english`, `kuku_yalanji`, `analysis`,
`frame`, `tier`, `words_used[]`, `loans_used[]`, `evidence`, `status`, `confidence`,
`rights_status`, `author`, `created_at`, and `updated_at`.

`analysis` preserves the project's morpheme segmentation/gloss string. It is an analytic claim, not an
independent gold annotation. `evidence` records the nearest project source anchor. `words_used` is a structured
inventory of dictionary or analyzed forms used in the row.

## Dictionary record

`dictionary.jsonl` adds a stable `entry_id` to each source YAML object without normalizing away duplicate
headwords, homophony, commentary, review flags, loanword records, derivation records, or source-specific fields.
`entry_json` in the CSV preserves the full source object.

## Lexeme record

The lexeme ledger contains project-level analyses and source tracking. `senses` and `attestation` are JSON
arrays. `status=verified` is project verification only; `watchlist` and `phantom-retired` must remain visible.

## Process tables

The full SQLite DDL is in `data/schema.sql`. JSONL exports retain the original snake_case database columns and
sort records by primary key.
