{ "file": "/workspace/models/kuku-yalanji-nllb-lora/v20.0-full-candidate-corpus-gvn-3epoch-lr2e-5/eval_elder_sentence_pair_all_predictions_greedy.json", "metrics": { "bleu": 12.64480456889731, "chrf": 36.2399979835272, "rows": 43, "num_beams": 1, "no_repeat_ngram_size": 0, "repetition_penalty": 1.0, "length_penalty": 1.0 }, "rows": 43, "empty_predictions": 0, "length_ratio": { "mean": 0.8335912674879897, "median": 0.75, "min": 0.47058823529411764, "max": 3.6666666666666665 }, "max_token_repeat_share": { "mean": 0.17017310375003514, "median": 0.14285714285714285, "min": 0.07142857142857142, "max": 0.5 } } SAMPLES REF: None SRC: When Bama first came to the rainforest country of Manjal Dimbi, it was new and strange. They did not know the landscape or what was good to eat or what was poisonous. HYP: Jana Bama kadarin bubungu Manjal Dimbinya, jana binal kari yinyaynka bubungu, jana binal kari yinyaynka bubungu, binal kari wanjarr ngulkurr nukanka, wanjarr yarbarrka buyun. TGT: Yalayalaku Bama jakalba kadarin madjanga Manjal Dimbinga jana ngangkan ngangkarin bubuku, binal kari bubuku, binal kari wanyu mayi ngulkurr nukanka, wanyu mayi ngulkurr-kari nukanka. REF: None SRC: An old man holding his spear and woomera came to Bama. He had long grey hair and long fingernails. His body shone like lightning. HYP: Nyubun dingkar, nyulu yarraman, nyungu maral, nyungu minya, nyungu marra, nyungu mungka, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu mungka, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bangkarr, nyungu bang TGT: Nyubun mukul dingkar, kalka, milbayarr maranga kujil kujil, jananda kadan. Nyungu mungka kalbay, bingaji, nyungu biri maranga kalbay, nyungu bangkarr balbajin yala balbay balbajinya. REF: None SRC: That old man's name was Kubirri. He came to teach our Ancestors how to live in a good way in the rainforest country. HYP: Nyulu dingkar burri Kubirri, nyulu kadan, ngananga nganjan-karra binal-bunganka junkayku bundanka jungjungu. TGT: Yinya mukul dingkar burri Kubirri, nyulu kadan bama binal-bunganka, wanjarrku ngulkurrku juranku bundarinka madjanga. REF: None SRC: Kubirri taught Bama what was good to eat and how to make poisonous foods eatable. HYP: Kubirri binal-bungan Bama wanjarrku ngulkurr nukanka, wanjarrku mayi buyun-buyun maninka. TGT: Kubirringka Bama binal-bungan yinyarrin mayika ngulkurr nukanka yala wanjarrku buyun ngabanka yinyarrinmun mayimun ngulkurr-kari bamanka, ngulkurr-bungankada, bamanka nukajinka. REF: None SRC: For a long time Bama were living good healthy lives in the rainforest. But, some time later they began to hear strange noises at night. HYP: Jana bama ngadingka ngulkurrku bundandan, kari kuli-kadan. Yamba juma jana ngadingka kuku nyajin warngku yindu-yinduynju. TGT: Bama ngadingka ngulkurrku bundarin madjanga, yamba dayim kadan jana yanja walu-yindu nyajin wujurr wujurrbuku. Yinya yanja jana kari jakalba nyajin. REF: None SRC: One day it came time for Kubirri to leave. HYP: Nyubun day, Kubirrimu time kadanda, nyulu dunganka. TGT: Nyubun wungar dayim kadan nyungunku jananin bawanka. REF: None SRC: The Bama knew it was Wurrumbu, the flesh-eater. HYP: Bama binal yinya Wurrumbu, nyulu minya nukanya. TGT: Bama binalda yinya dubu Wurrumbu, nyulu minya nukanya. REF: None SRC: Bama all became frightened for that boy and were yelling out to him, "Yundu wanjabu, nganjinanda kaday, bayanba, bayanga." HYP: Jana bama wubulku yinyilmarinda, nyungundu yirrkan, Yundu wanjabu, nganjinanda kaday, bayanba, bayanga. TGT: Bama wubulku wawu-buyunmarin nyungunku, warruku. Jana nyungundu yirrkan baja, yirrkan baja, "Yundu wanjabu, nganjinanda kaday, bayanba, bayanga." Yamba nyulu jananda kari kadan baja.