{
  "file": "/workspace/models/kuku-yalanji-nllb-lora/v20.0-full-candidate-corpus-gvn-3epoch-lr2e-5/eval_test_all_predictions_greedy.json",
  "metrics": {
    "bleu": 11.923665737688653,
    "chrf": 39.39147030888842,
    "rows": 4397,
    "num_beams": 1,
    "no_repeat_ngram_size": 0,
    "repetition_penalty": 1.0,
    "length_penalty": 1.0
  },
  "rows": 4397,
  "empty_predictions": 0,
  "length_ratio": {
    "mean": 1.0234167592331507,
    "median": 0.9090909090909091,
    "min": 0.08791208791208792,
    "max": 34.0
  },
  "max_token_repeat_share": {
    "mean": 0.14992056573962373,
    "median": 0.125,
    "min": 0.036585365853658534,
    "max": 1.0
  }
}

SAMPLES

REF: MAT.3.2
SRC: <translate> “Repent, for the Kingdom of Heaven is at hand!”
HYP: Nyulu yalaman, Yurra buyun-buyunmun jurrkijika, Godungku yurranin nyungu jawun-karra ngulkurrduku kujinka.
TGT: Nyulu yalaman, “Yurra jurrkijika buyun-buyunmun. Bama nyikuku Godundumun kaday. Godungku nyungu bama ngulkurrduku kujinka. Nyulu majamal wubulkuku.”

REF: LUK.8.22#s1
SRC: <translate> Now on one of those days, he entered into a boat, himself and his disciples, and he said to them, “Let’s go over to the other side of the lake.”
HYP: Yala-yalaku Jesusangka jawun-karranji 12-bala boatbu walan. Nyulu jananda yalaman, Ngana ngubar-ngubar jalunbu dungarika.
TGT: Wawu yinyamun Jesus boatbu walan nyunguwunji jawun-karranji, yalaman, “Ngana naka-naka jalunbu dungarinka.”

REF: ROM.10.2
SRC: <translate> For I testify about them that they have a zeal for God, but not according to knowledge.
HYP: Ngayu binal jananka Godunku wawu jirray bajaku. Yamba jana Godunku wawu jirray bajaku, yamba jana Godunku binal kari.
TGT: Ngayu binal jana God wukurrinka, yamba jana nyunguwunku waymunku binal kari.

REF: 1TI.6.21
SRC: <translate> which some profess, and thus have wandered from the faith. Grace be with you. Amen.
HYP: Kanbalda bamangka yalamal, Ngayu binal-bungal, jana Godundumun jurrkijin. Godungku yurranin ngulkurrduku kujilkuda. Yalakubada.
TGT: Kanbal bama balu binal bajaku Godunku, yamba jana binal kari. Kanbalda jurril-bungal Godunku, yinyaynka jana nyungundumun jurrkiji, nyungun kari mumbarabuku believeim-bungal, kari mumbarku nyungundu mambarriji. Yala, Godungku yurranin ngulkurrduku kujil. Yalakubada.

REF: JHN.1.9
SRC: <translate> That was the true Light, which lighteth every man that cometh into the world.
HYP: Nyulu light jirray bajaku. Nyulu light jirray, bama wubulku balbal-balbal. Nyulu kaday, bamanda wubulbuku balbal-balbalbal.
TGT: Nyulu dingkar light manubaja, nyulu kadan Godundumun. Nyulu light bubungu kadan, balbanka bama wubulku Godunku, jana kari nguwul-nguwulbu dunganka, kari ngangkal-ngangkalmanka baralka Godundu.

REF: ACT.23.27
SRC: <bible_ref> ACT.23.27 <eng> “This man was seized by the Jews, and was about to be killed by them when I came with the soldiers and rescued him, having learned that he was a Roman.
HYP: Paulungku yalaman, Jana bamangka Jew-warrangka yinya dingkar karrban, yarkinkaku kuninka. Ngayu kuku nyajin nyulu bama Roman. Yinyaynka ngayu soldier-soldier wundin nyungundu, nyungun juran-bungan.
TGT: Jana Jew-warrangka yanyu dingkar Paul karrban, nyungun yarkinkaku kuninka. Ngayu binalman nyulu bama Roman, ngayu nyungun manin janandamun.

REF: LUK.1.35
SRC: <bible_ref> LUK.1.35 <eng> And the angel answered and said to her, The Holy Spirit will come upon thee, and the power of the Highest will overshadow thee: therefore also that holy thing which shall be born of thee shall be called the Son of God.
HYP: Angelangka nyungundu yalaman, Godumu Wawu dayirr bajaku yunundumun kadan. Godumu junkurr yunun jiringa-bungalkuda. Yinyaynka yundu wuljaljiku junkurrji bajaku. Yundu kangkal ngulkurr bajaku, nyulu Godumu kangkal.
TGT: Angelangka nyungundu yalaman, “Godumu Wawu ngulkurr yunundu kaday. Nyulu yunundu walal, Godundumundu junkurrdu yalbaynja yunun nandal. Yinyamun yundu kulngkulmalkuda. Nyulu kangkal Godumu, buyun kari bajaku. Bamangka nyungun bambal Godumu kangkal.”

REF: MRK.9.29
SRC: <bible_ref> MRK.9.29 <eng> And he said to them, This kind can come forth by nothing, but by prayer and fasting.
HYP: Jesusangka yalaman, Kaki bama mayi kari nukal, and praymanka, yinya bama yala dubu kari kangan.
TGT: Jesusangka jananda yalaman, “Yurra dubu kanganka, yurra Godunjingarr must balkawaka. Wawu yinyamun dubu kangada. Nyulu wandilda.”