{
  "file": "/workspace/models/kuku-yalanji-nllb-lora/v20.0-full-candidate-corpus-gvn-3epoch-lr2e-5/eval_validation_bible_direct_predictions_greedy.json",
  "metrics": {
    "bleu": 11.980071379735055,
    "chrf": 39.30213095247043,
    "rows": 2153,
    "num_beams": 1,
    "no_repeat_ngram_size": 0,
    "repetition_penalty": 1.0,
    "length_penalty": 1.0
  },
  "rows": 2153,
  "empty_predictions": 1,
  "length_ratio": {
    "mean": 1.000728470567241,
    "median": 0.9047619047619048,
    "min": 0.0,
    "max": 20.0
  },
  "max_token_repeat_share": {
    "mean": 0.1485811698970536,
    "median": 0.1282051282051282,
    "min": 0.0,
    "max": 1.0
  }
}

SAMPLES

REF: 1CO.10.12
SRC: <translate> Therefore let him who thinks he stands be careful that he doesn’t fall.
HYP: Kaki bama balu janaku bundanday, nyulu mumbarmaka. Nyulu kari daray, nyulu kari daray.
TGT: Mumbarmaka! Yurra kanbalda wadu-wadubuku milkabu wukurrinji, yalamanji, “Ngayu yala kari. Ngayu kari yalaku buyun-damal.” Mumbarmaka! Kaki yurra yalaku wadu-wadubuku milkabu wukurril, daranji, buyun-damanji.

REF: 1CO.10.12
SRC: <translate> Wherefore let him that thinketh he standeth, take heed lest he fall.
HYP: Kaki bama balu janaku bundanday, nyulu must mumbarmaka, nyulu kari daray.
TGT: Mumbarmaka! Yurra kanbalda wadu-wadubuku milkabu wukurrinji, yalamanji, “Ngayu yala kari. Ngayu kari yalaku buyun-damal.” Mumbarmaka! Kaki yurra yalaku wadu-wadubuku milkabu wukurril, daranji, buyun-damanji.

REF: 1CO.10.20
SRC: <translate> But I say that the things which the Gentiles sacrifice, they sacrifice to demons and not to God, and I don’t desire that you would have fellowship with demons.
HYP: Ngayu balkalda. Bamangka Gentile-warrangka junjuy-junjuy minya wayjun, jana dubu-dubundu dajil-dajil. Jana Godundu kari dajil. Ngayu wawu yurra dubu-dubunji muruku bunday.
TGT: Yala ngayu wanyurrinku balkan yinya junjuy bawanka? Kaki bamangka mayi dajil yinyamba junjuymbu, jana dubu-dubundukuda dajil. Godundu kari. Dubu-dubundu. Ngayu wawu kari yurra murubuku mayi nukanka, Dubundumunji bamanji. Wawu kari yurra yalaku Dubu buyay-maninka.

REF: 1CO.10.20
SRC: <translate> But I say , that the things which the Gentiles sacrifice, they sacrifice to demons, and not to God: and I would not that ye should have fellowship with demons.
HYP: Ngayu balkalda. Bamangka Gentile-warrangka junjuy-junjuy minya wayjun, jana dubu-dubundu dajil-dajil. Jana Godundu kari dajil. Ngayu wawu yurra dubu-dubunji muruku bunday.
TGT: Yala ngayu wanyurrinku balkan yinya junjuy bawanka? Kaki bamangka mayi dajil yinyamba junjuymbu, jana dubu-dubundukuda dajil. Godundu kari. Dubu-dubundu. Ngayu wawu kari yurra murubuku mayi nukanka, Dubundumunji bamanji. Wawu kari yurra yalaku Dubu buyay-maninka.

REF: ACT.22.2#s2
SRC: <translate> He said,
HYP: Nyulu yalaman,
TGT: Paulungku yalaman,

REF: 1JN.5.18
SRC: <translate> We know that whoever is born of God, sinneth not; but he that is begotten of God, keepeth himself, and that wicked one toucheth him not.
HYP: Ngana binal bama Godumukuda kangkalmal, nyulu kari buyunmal baja. Godumu kangkal nyungun ngulkurrduku kujil, Dubungku nyungun kari buyun-damal baja.
TGT: Ngana binal Godundumundu kangkal-kangkalangka kari yarbarrka buyun-damal baja, Godundumundu kangkalangka jananin ngulkurrduku kujinya. Dubungku jananin kari buyun-damal.

REF: JHN.8.3
SRC: <translate> And the scribes and Pharisees brought to him a woman taken in adultery: and when they had set her in the midst,
HYP: Jana teacher-teacher lawmunku, and Pharisee-warra, jana jalbu wundin Jesusanda. Jana nyubun jalbu karrban, kalngarmanya. Jana nyungun jakalba yijarrin.
TGT: Jana, Pharisee-warrangka, teacher-teacherangka Jew-warrandamunku lawmunku, jana jalbu wundin. Nyulu jalbu dingkaranji wunan, nyungu dunyu kari. Jana jalbu dindarra janay-manin.

REF: JHN.18.1
SRC: <translate> When Jesus had spoken these words, he went out with his disciples over the brook Kidron, where there was a garden, into which he and his disciples entered.
HYP: Jesusangka yinya kuku kunban, nyulu, nyungu jawun-karra 12-bala dungan, naka bada burrir Kidron. Yinyaymba garden, jana Jesus, nyungu jawun-karra dungarin.
TGT: Wawu kukumun, Jesus jawun-karranji 11-balanji dungan. Jana naka-naka yilkinga Kidron dungarin, yinyaymba dungarin jukungu olivemunbu wubulbu, bubungu yala park.