{
  "file": "/workspace/models/kuku-yalanji-nllb-lora/v12.0-tagged-direct-plus-reference-bible-gvn-token-4096row-25epoch-batch16/eval_train_direct2048_predictions_greedy.json",
  "metrics": {
    "bleu": 92.0531143860032,
    "chrf": 97.3072898421998,
    "rows": 2048,
    "num_beams": 1,
    "no_repeat_ngram_size": 0,
    "repetition_penalty": 1.0,
    "length_penalty": 1.0
  },
  "rows": 2048,
  "empty_predictions": 0,
  "length_ratio": {
    "mean": 1.0003576275783104,
    "median": 1.0,
    "min": 0.7142857142857143,
    "max": 1.3888888888888888
  },
  "max_token_repeat_share": {
    "mean": 0.11519378828202805,
    "median": 0.10526315789473684,
    "min": 0.038461538461538464,
    "max": 0.5
  }
}

SAMPLES

REF: MAT.26.42
SRC: <translate> He went away again the second time, and prayed, saying, O my Father, if this cup may not pass away from me, except I drink it, thy will be done.
HYP: Jesus dungan baja, prayman, Godunji balkawan. Nyulu yalaman. Nganjan, kaki yundu nganya wantim-bal wulanka, ngayu wulayda. Ngayu yunun kuku nyajil.
TGT: Jesus dungan baja, prayman, Godunji balkawan. Nyulu yalaman. “Nganjan, kaki yundu nganya wantim-bal wulanka, ngayu wulayda. Ngayu yunun kuku nyajil.”

REF: LUK.5.15
SRC: <translate> But so much the more a fame of him went abroad: and great multitudes came together to hear and to be healed by him of their infirmities.
HYP: Yamba bamangka yinya kuku ngulkurr Jesusanka yiringkurrku balkan. Yinyaynka bama wubulku nyungundu kadarin, nyungu kuku nyajinka, bambaymun ngulkurrmanka.
TGT: Yamba bamangka yinya kuku ngulkurr Jesusanka yiringkurrku balkan. Yinyaynka bama wubulku nyungundu kadarin, nyungu kuku nyajinka, bambaymun ngulkurrmanka.

REF: MRK.14.22
SRC: <translate> And as they were eating, Jesus took bread, and blessed, and broke it , and gave to them, and said, Take, eat: this is my body.
HYP: Jana mayingada nukan-nukajin, Jesusangka bread manin, breadka God thankim-bungan, bread dumbarrin, jawun-karranda dajin, yalaman, Mana, nukada. Yanyu bread ngayku bangkarr.
TGT: Jana mayingada nukan-nukajin, Jesusangka bread manin, breadka God thankim-bungan, bread dumbarrin, jawun-karranda dajin, yalaman, “Mana, nukada. Yanyu bread ngayku bangkarr.”

REF: MAT.13.53
SRC: <translate> When Jesus had finished these parables, he departed from there.
HYP: Jesusangka story kunbay-manin, nyulu yinya bubu bawan.
TGT: Jesusangka story kunbay-manin, nyulu yinya bubu bawan.

REF: MRK.15.37
SRC: <translate> And Jesus cried with a loud voice, and expired.
HYP: Jesus kawal yirrkajin, wulaynkuda.
TGT: Jesus kawal yirrkajin, wulaynkuda.

REF: ACT.27.3
SRC: <translate> The next day, we touched at Sidon. Julius treated Paul kindly and gave him permission to go to his friends and refresh himself.
HYP: Warngku yindu nganjin townbu Sidon kadarin. Maja Julius Paulunku manun-manunman. Nyulu Paul yungan jawun-karranda, jana nyungun kujinka.
TGT: Warngku yindu nganjin townbu Sidon kadarin. Maja Julius Paulunku manun-manunman. Nyulu Paul yungan jawun-karranda, jana nyungun kujinka.

REF: LUK.10.8
SRC: <translate> Into whatever city you enter and they receive you, eat the things that are set before you.
HYP: Kaki jana yurranin yulmbarril townbu, yurra nuka wanyu mayi jana yurranda dajil.
TGT: Kaki jana yurranin yulmbarril townbu, yurra nuka wanyu mayi jana yurranda dajil.

REF: LUK.15.21
SRC: <translate> The son said to him, ‘Father, I have sinned against heaven and in your sight. I am no longer worthy to be called your son.’
HYP: Yabajungku yalaman, Nganjan, ngayu yunun buyun-daman, yalarrku ngayu God buyun-daman. Nganya karida kangkal bamba.
TGT: Yabajungku yalaman, ‘Nganjan, ngayu yunun buyun-daman, yalarrku ngayu God buyun-daman. Nganya karida kangkal bamba.’