Skip to content

Latest commit

 

History

History
107 lines (104 loc) · 30.3 KB

higher.md

File metadata and controls

107 lines (104 loc) · 30.3 KB

Tatoeba Challenge Data - v2023-09-26

This is the "higher" sub-set of the Tatoeba data. Download the data files from the link in the table below. There is a total of

  • 97 language pairs in this sub-set
lang-pair test dev train
Afrikaans - German afr-deu 1583 4 5216915
Afrikaans - Dutch afr-nld 1076 3814878
Afrikaans - Russian afr-rus 229 1565824
Afrikaans - Spanish afr-spa 452 1789277
Arabic - Esperanto ara-epo 793 94 1486572
Assamese - English asm-eng 233 64 5054766
Awadhi - English awa-eng 279 2197709
Azerbaijani - Turkish aze-tur 1150 52 2547741
Belarusian - German bel-deu 555 1 1306107
Belarusian - Polish bel-pol 288 2933330
Belarusian - Ukrainian bel-ukr 2355 1091 1811586
Bulgarian - Esperanto bul-epo 588 1 1436274
Bulgarian - Japanese bul-jpn 322 2 8599663
Catalan - German cat-deu 724 2 2173303
Catalan - Esperanto cat-epo 774 7 1173672
Catalan - Dutch cat-nld 579 2 1954790
Catalan - Ukrainian cat-ukr 459 2202310
Cebuano - German ceb-deu 903 1236155
Czech - Esperanto ces-epo 3471 1098 2097387
Czech - Ukrainian ces-ukr 1787 1196 9724513
Chuvash - Russian chv-rus 394 1046354
Danish - Esperanto dan-epo 13144 19236 1573951
Danish - Japanese dan-jpn 927 10 8467609
German - Esperanto deu-epo 20438 221683 5235762
German - Icelandic deu-isl 977 19 8816105
German - Tagalog deu-tgl 397 3244111
Modern Greek (1453-) - Modern Greek (1453-) ell-ell 534 2882959
Modern Greek (1453-) - Esperanto ell-epo 634 5 1589281
English - Faroese eng-fao 294 1 2895158
English - Scottish Gaelic eng-gla 957 6666533
English - Hausa eng-hau 256 9000508
English - Iloko eng-ilo 1093 1000 2017387
English - Kabyle eng-kab 15971 14439 2953417
English - Khmer eng-khm 778 6553202
English - Latin eng-lat 11821 14036 1100424
English - Maori eng-mri 367 3 5800311
English - Occitan (post 1500) eng-oci 858 1459964
English - Quechua eng-que 258 2853672
English - Rundi eng-run 1703 3 1024349
English - Tatar eng-tat 1451 22 9936650
English - Uighur eng-uig 3024 1011 8615783
English - Waray (Philippines) eng-war 1512 56 2757611
English - Yiddish eng-yid 2483 4311 7590007
Esperanto - Persian epo-fas 2530 7430 1119847
Esperanto - Finnish epo-fin 2862 1142 1493223
Esperanto - Serbo-Croatian epo-hbs 2500 2805 2406901
Esperanto - Hebrew epo-heb 10557 19607 1246765
Esperanto - Hungarian epo-hun 10197 28756 1591155
Esperanto - Italian epo-ita 11152 40619 2982182
Esperanto - Lithuanian epo-lit 13275 10429 1048143
Esperanto - Dutch epo-nld 17570 80837 2575360
Esperanto - Norwegian epo-nor 3158 1027 1546983
Esperanto - Romanian epo-ron 3820 1678 1710088
Esperanto - Slovenian epo-slv 310 1 1241511
Esperanto - Spanish epo-spa 11890 65096 6210974
Esperanto - Swedish epo-swe 1757 189 2174355
Esperanto - Ukrainian epo-ukr 2500 4732 1095329
Finnish - Japanese fin-jpn 12580 10954 8927609
Finnish - Korean fin-kor 422 5831657
French - French fra-fra 1000 2456 1985862
French - Occitan (post 1500) fra-oci 806 4421772
French - Rundi fra-run 1274 8 1420253
French - Tagalog fra-tgl 854 3382249
Hebrew - Ukrainian heb-ukr 969 10 3423678
Hindi - Marathi hin-mar 226 2 3106276
Hindi - Urdu hin-urd 240 2 3999092
Hindi - Chinese hin-zho 324 1 3161573
Hungarian - Japanese hun-jpn 2500 3769 9672524
Hungarian - Korean hun-kor 271 6567443
Hungarian - Ukrainian hun-ukr 486 3 7926430
Armenian - Russian hye-rus 257 5307481
Icelandic - Italian isl-ita 236 4018669
Icelandic - Russian isl-rus 426 1890993
Icelandic - Spanish isl-spa 241 5513480
Italian - Ukrainian ita-ukr 5000 8887 8180346
Javanese - Malay (macrolanguage) jav-msa 231 1008999
Japanese - Lithuanian jpn-lit 249 4866288
Japanese - Norwegian jpn-nor 1048 15 7197098
Japanese - Ukrainian jpn-ukr 465 21 4576692
Japanese - Vietnamese jpn-vie 1098 622 7083577
Georgian - Russian kat-rus 660 6 3847285
Korean - Chinese kor-zho 417 8226696
Macedonian - Spanish mkd-spa 217 3 8901426
Dutch - Dutch nld-nld 1000 1147 1361554
Dutch - Ukrainian nld-ukr 10000 5162 8915052
Norwegian - Ukrainian nor-ukr 674 6189378
Norwegian - Chinese nor-zho 204 8925891
Polish - Polish pol-pol 206 1940940
Portuguese - Tagalog por-tgl 1777 3 2296650
Russian - Tatar rus-tat 2138 1159 1067949
Slovenian - Ukrainian slv-ukr 926 49 7719805
Spanish - Spanish spa-spa 2500 3069 4835216
Spanish - Tagalog spa-tgl 1000 342 2536684
Turkish - Turkish tur-tur 2500 1494 1976047
Turkish - Ukrainian tur-ukr 2540 6722 5543716
Ukrainian - Chinese ukr-zho 1575 1 4090645
Chinese - Chinese zho-zho 3246 5810 8858051