{
  "file": "/workspace/models/kuku-yalanji-nllb-lora/v20.0-full-candidate-corpus-gvn-3epoch-lr2e-5/eval_test_bible_direct_predictions_greedy.json",
  "metrics": {
    "bleu": 11.902008556232007,
    "chrf": 39.41441994560193,
    "rows": 2135,
    "num_beams": 1,
    "no_repeat_ngram_size": 0,
    "repetition_penalty": 1.0,
    "length_penalty": 1.0
  },
  "rows": 2135,
  "empty_predictions": 0,
  "length_ratio": {
    "mean": 1.0160772356245436,
    "median": 0.9090909090909091,
    "min": 0.08791208791208792,
    "max": 14.11111111111111
  },
  "max_token_repeat_share": {
    "mean": 0.1474362650921968,
    "median": 0.125,
    "min": 0.036585365853658534,
    "max": 1.0
  }
}

SAMPLES

REF: 1CO.10.15
SRC: <translate> I speak as to wise men. Judge what I say.
HYP: Ngayu yurranda balkalda, yurra binalmanka. Yurra binalmaka, ngayu wanyu balkal.
TGT: Yurra binal. Yurra junkaynjaku milkabu wukurril. Yurra binal ngayu junkaynjaku balkan-balkal.

REF: 1CO.10.15
SRC: <translate> I speak as to wise men; judge ye what I say.
HYP: Ngayu yurranda balkalda, yurra binalmanka. Yurra milka-janay, ngayu yurranda balkalda.
TGT: Yurra binal. Yurra junkaynjaku milkabu wukurril. Yurra binal ngayu junkaynjaku balkan-balkal.

REF: 1CO.10.16
SRC: <translate> The cup of blessing which we bless, isn’t it a sharing of the blood of Christ? The bread which we break, isn’t it a sharing of the body of Christ?
HYP: Ngana mayi breadmunbu nukanka, God thankim-bungal, nyulu ngananda dajin. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday. Ngana yalaku bunday.
TGT: Ngana communion nukal, ngana God thankim-bungal cupmunku. Ngana cupmun nukal, Christangka nyuluku mula dajil ngananga. Ngana mayi bread dumbarril, nukal, Christangka nyuluku bangkarr dajil ngananga. Yinyamundu ngana nyubunmal.

REF: 1CO.10.16
SRC: <translate> The cup of blessing which we bless, is it not the communion of the blood of Christ? The bread which we break, is it not the communion of the body of Christ?
HYP: Ngana God thankim-bungal, wine nukal, nyulu ngananda dajin, ngana nyungunji kunamanka. Ngana bread nukal, ngana nyungunji kunamanka, nyunguwundu bangkarrka. Ngana yalarrku nyunguwunku mulabu kunaman, Jesus Christamu mula.
TGT: Ngana communion nukal, ngana God thankim-bungal cupmunku. Ngana cupmun nukal, Christangka nyuluku mula dajil ngananga. Ngana mayi bread dumbarril, nukal, Christangka nyuluku bangkarr dajil ngananga. Yinyamundu ngana nyubunmal.

REF: ACT.18.26
SRC: <translate> And he began to speak boldly in the synagogue: Whom, when Aquila and Priscilla had heard, they took him to them , and expounded to him the way of God more perfectly.
HYP: Yinyamun nyulu Apolos munabuku balkawan Jew-warrandamunbu churchmunbu. Bula Aquila and Priscilla nyungun nyajin Godundumunku kukuku. Bula Priscilla and Aquila nyungun bayanbaku wundin, nyungun kukuji balkan Godundumunku kukuku.
TGT: Nyulu munabuku Godumu kuku balkan Jew-warrandamunbu churchmunbu. Aquilangka bula Priscillangka nyungun nyajin balkanya, bula nyungun wundin bulawunbu bayanba. Yinyaymba bula nyungun mumbarabuku binal-bungan Jesusanka, nyungundu milkanga-bungan kuku nyulu jakalbaku kari nyajin.

REF: 1JN.2.15
SRC: <translate> Love not the world, neither the things that are in the world. If any man loveth the world, the love of the Father is not in him.
HYP: Kari yindu-yinduynku bubuku wawumaka, yamba-yamba bubuku. Kaki bama yindu-yinduynku bubuku wawumaka, nyulu Godunku wawu kari.
TGT: Kari yamba-yamba-bakamaka. Kari jumbunmaka. Kari junjuy-junjuy jumbunduku milkabu wukurrika, kari milkanga yamba-yambajiku bundarika. Ngana Godunkuku wawumaka, nyunguku way wukurrika. Kaki yurra junjuy-junjuynku bubuku wawumal, yurra Nganjananka Godunku wawu kari, nyungu way kari wukurril.

REF: LUK.11.34
SRC: <translate> The light of the body is the eye: therefore when thy eye is single, thy whole body also is full of light; but when thy eye is evil, thy body also is full of darkness.
HYP: Yundu miyil dayirr bajaku, yala light. Kaki yunu miyil ngulkurr, yundu dayirr bajaku. Kaki yunu miyil buyun, yundu nguwul-nguwulbu bundanday.
TGT: Kaki yunu miyil ngulkurr, yundu ngulkurrduku nyajil, junkayku dunganka, kari daranka. Yunu miyil yala yunu wawu. Kaki yunu wawu lightmunji, yundu binal junkayku dunganka, buyun-buyunmun jurrkijinka. Kaki yunu miyil buyun, yunu wawu lightmunji kari. Yundu yala nguwul-nguwulbu bundandayda. Yundu kurru-kurruku dunganji, daranji. Kaki yunu wawu buyun, yinya yala miyil buyun, yundu kari junkayku dungay.

REF: JHN.3.15#s1
SRC: <translate> That whoever believeth in him should not perish, but have eternal life.
HYP: Godungku wawu bama nyungundu mambarriji, jananga wawu wuljaljiku juranku bundarinka. Jana kari wulay. Jana wuljaljiku juranku bundari.
TGT: Kaki bama ngaykundu milka-janay, and ngaykundu mambarriji, jana wuljaljiku juranku bundari wangkar-wangkar.