{
  "file": "/workspace/models/kuku-yalanji-nllb-lora/v20.0-full-candidate-corpus-gvn-3epoch-lr2e-5/eval_validation_bible_ref_predictions_greedy.json",
  "metrics": {
    "bleu": 11.934767061577693,
    "chrf": 39.093880392237715,
    "rows": 2153,
    "num_beams": 1,
    "no_repeat_ngram_size": 0,
    "repetition_penalty": 1.0,
    "length_penalty": 1.0
  },
  "rows": 2153,
  "empty_predictions": 0,
  "length_ratio": {
    "mean": 1.0114747554070926,
    "median": 0.9166666666666666,
    "min": 0.16981132075471697,
    "max": 18.666666666666668
  },
  "max_token_repeat_share": {
    "mean": 0.147683715377849,
    "median": 0.12698412698412698,
    "min": 0.03225806451612903,
    "max": 0.9767441860465116
  }
}

SAMPLES

REF: 1CO.10.12
SRC: <bible_ref> 1CO.10.12 <eng> Therefore let him who thinks he stands be careful that he doesn’t fall.
HYP: Kaki bama balu janaku bundanday, nyulu mumbarmaka. Nyulu kari daray, bubungu kaday.
TGT: Mumbarmaka! Yurra kanbalda wadu-wadubuku milkabu wukurrinji, yalamanji, “Ngayu yala kari. Ngayu kari yalaku buyun-damal.” Mumbarmaka! Kaki yurra yalaku wadu-wadubuku milkabu wukurril, daranji, buyun-damanji.

REF: 1CO.10.12
SRC: <bible_ref> 1CO.10.12 <eng> Wherefore let him that thinketh he standeth, take heed lest he fall.
HYP: Kaki bama balu janaku bundanday, nyulu must mumbarmaka, kari daray. Nyulu kari daray, kari badamaka.
TGT: Mumbarmaka! Yurra kanbalda wadu-wadubuku milkabu wukurrinji, yalamanji, “Ngayu yala kari. Ngayu kari yalaku buyun-damal.” Mumbarmaka! Kaki yurra yalaku wadu-wadubuku milkabu wukurril, daranji, buyun-damanji.

REF: 1CO.10.20
SRC: <bible_ref> 1CO.10.20 <eng> But I say that the things which the Gentiles sacrifice, they sacrifice to demons and not to God, and I don’t desire that you would have fellowship with demons.
HYP: Ngayu balkalda. Bamangka Gentile-warrangka junjuy-junjuy minya wayjun, jana dubu-dubundu dajil-dajil. Jana Godundu kari dajil. Ngayu wawu yurra dubu-dubunji muruku bunday.
TGT: Yala ngayu wanyurrinku balkan yinya junjuy bawanka? Kaki bamangka mayi dajil yinyamba junjuymbu, jana dubu-dubundukuda dajil. Godundu kari. Dubu-dubundu. Ngayu wawu kari yurra murubuku mayi nukanka, Dubundumunji bamanji. Wawu kari yurra yalaku Dubu buyay-maninka.

REF: 1CO.10.20
SRC: <bible_ref> 1CO.10.20 <eng> But I say , that the things which the Gentiles sacrifice, they sacrifice to demons, and not to God: and I would not that ye should have fellowship with demons.
HYP: Ngayu balkalda. Bamangka Gentile-warrangka junjuy-junjuy minya wayjun, jana dubu-dubundu dajil-dajil. Jana Godundu kari dajil. Ngayu wawu yurra dubu-dubunji muruku bunday.
TGT: Yala ngayu wanyurrinku balkan yinya junjuy bawanka? Kaki bamangka mayi dajil yinyamba junjuymbu, jana dubu-dubundukuda dajil. Godundu kari. Dubu-dubundu. Ngayu wawu kari yurra murubuku mayi nukanka, Dubundumunji bamanji. Wawu kari yurra yalaku Dubu buyay-maninka.

REF: ACT.22.2#s2
SRC: <bible_ref> ACT.22.2#s2 <eng> He said,
HYP: Nyulu yalaman,
TGT: Paulungku yalaman,

REF: 1JN.5.18
SRC: <bible_ref> 1JN.5.18 <eng> We know that whoever is born of God, sinneth not; but he that is begotten of God, keepeth himself, and that wicked one toucheth him not.
HYP: Ngana binal bama Godumukuda kangkalmal, nyulu kari buyunmal baja. Godumu kangkal nyungun ngulkurrduku kujil, Dubungku nyungun kari buyun-damal baja.
TGT: Ngana binal Godundumundu kangkal-kangkalangka kari yarbarrka buyun-damal baja, Godundumundu kangkalangka jananin ngulkurrduku kujinya. Dubungku jananin kari buyun-damal.

REF: JHN.8.3
SRC: <bible_ref> JHN.8.3 <eng> And the scribes and Pharisees brought to him a woman taken in adultery: and when they had set her in the midst,
HYP: Jana teacher-teacher lawmunku, and Pharisee-warra, jana jalbu Jesusanda wundin, nyulu jalbu kalngar-baka. Jana nyungun jakalba yijarrin.
TGT: Jana, Pharisee-warrangka, teacher-teacherangka Jew-warrandamunku lawmunku, jana jalbu wundin. Nyulu jalbu dingkaranji wunan, nyungu dunyu kari. Jana jalbu dindarra janay-manin.

REF: JHN.18.1
SRC: <bible_ref> JHN.18.1 <eng> When Jesus had spoken these words, he went out with his disciples over the brook Kidron, where there was a garden, into which he and his disciples entered.
HYP: Jesusangka yinya kuku kunban, nyulu, nyungu jawun-karra 12-bala, jana dungarin, bada burrirba Kidron. Yinyaymba garden, jana Jesus, nyungu jawun-karra dungarin.
TGT: Wawu kukumun, Jesus jawun-karranji 11-balanji dungan. Jana naka-naka yilkinga Kidron dungarin, yinyaymba dungarin jukungu olivemunbu wubulbu, bubungu yala park.