This is the "higher" sub-set of the Tatoeba data. Download the data files from the link in the table below. There is a total of
- 97 language pairs in this sub-set
lang-pair | test | dev | train |
---|---|---|---|
Afrikaans - German afr-deu | 1583 | 4 | 5216915 |
Afrikaans - Dutch afr-nld | 1076 | 3814878 | |
Afrikaans - Russian afr-rus | 229 | 1565824 | |
Afrikaans - Spanish afr-spa | 452 | 1789277 | |
Arabic - Esperanto ara-epo | 793 | 94 | 1486572 |
Assamese - English asm-eng | 233 | 64 | 5054766 |
Awadhi - English awa-eng | 279 | 2197709 | |
Azerbaijani - Turkish aze-tur | 1150 | 52 | 2547741 |
Belarusian - German bel-deu | 555 | 1 | 1306107 |
Belarusian - Polish bel-pol | 288 | 2933330 | |
Belarusian - Ukrainian bel-ukr | 2355 | 1091 | 1811586 |
Bulgarian - Esperanto bul-epo | 588 | 1 | 1436274 |
Bulgarian - Japanese bul-jpn | 322 | 2 | 8599663 |
Catalan - German cat-deu | 724 | 2 | 2173303 |
Catalan - Esperanto cat-epo | 774 | 7 | 1173672 |
Catalan - Dutch cat-nld | 579 | 2 | 1954790 |
Catalan - Ukrainian cat-ukr | 459 | 2202310 | |
Cebuano - German ceb-deu | 903 | 1236155 | |
Czech - Esperanto ces-epo | 3471 | 1098 | 2097387 |
Czech - Ukrainian ces-ukr | 1787 | 1196 | 9724513 |
Chuvash - Russian chv-rus | 394 | 1046354 | |
Danish - Esperanto dan-epo | 13144 | 19236 | 1573951 |
Danish - Japanese dan-jpn | 927 | 10 | 8467609 |
German - Esperanto deu-epo | 20438 | 221683 | 5235762 |
German - Icelandic deu-isl | 977 | 19 | 8816105 |
German - Tagalog deu-tgl | 397 | 3244111 | |
Modern Greek (1453-) - Modern Greek (1453-) ell-ell | 534 | 2882959 | |
Modern Greek (1453-) - Esperanto ell-epo | 634 | 5 | 1589281 |
English - Faroese eng-fao | 294 | 1 | 2895158 |
English - Scottish Gaelic eng-gla | 957 | 6666533 | |
English - Hausa eng-hau | 256 | 9000508 | |
English - Iloko eng-ilo | 1093 | 1000 | 2017387 |
English - Kabyle eng-kab | 15971 | 14439 | 2953417 |
English - Khmer eng-khm | 778 | 6553202 | |
English - Latin eng-lat | 11821 | 14036 | 1100424 |
English - Maori eng-mri | 367 | 3 | 5800311 |
English - Occitan (post 1500) eng-oci | 858 | 1459964 | |
English - Quechua eng-que | 258 | 2853672 | |
English - Rundi eng-run | 1703 | 3 | 1024349 |
English - Tatar eng-tat | 1451 | 22 | 9936650 |
English - Uighur eng-uig | 3024 | 1011 | 8615783 |
English - Waray (Philippines) eng-war | 1512 | 56 | 2757611 |
English - Yiddish eng-yid | 2483 | 4311 | 7590007 |
Esperanto - Persian epo-fas | 2530 | 7430 | 1119847 |
Esperanto - Finnish epo-fin | 2862 | 1142 | 1493223 |
Esperanto - Serbo-Croatian epo-hbs | 2500 | 2805 | 2406901 |
Esperanto - Hebrew epo-heb | 10557 | 19607 | 1246765 |
Esperanto - Hungarian epo-hun | 10197 | 28756 | 1591155 |
Esperanto - Italian epo-ita | 11152 | 40619 | 2982182 |
Esperanto - Lithuanian epo-lit | 13275 | 10429 | 1048143 |
Esperanto - Dutch epo-nld | 17570 | 80837 | 2575360 |
Esperanto - Norwegian epo-nor | 3158 | 1027 | 1546983 |
Esperanto - Romanian epo-ron | 3820 | 1678 | 1710088 |
Esperanto - Slovenian epo-slv | 310 | 1 | 1241511 |
Esperanto - Spanish epo-spa | 11890 | 65096 | 6210974 |
Esperanto - Swedish epo-swe | 1757 | 189 | 2174355 |
Esperanto - Ukrainian epo-ukr | 2500 | 4732 | 1095329 |
Finnish - Japanese fin-jpn | 12580 | 10954 | 8927609 |
Finnish - Korean fin-kor | 422 | 5831657 | |
French - French fra-fra | 1000 | 2456 | 1985862 |
French - Occitan (post 1500) fra-oci | 806 | 4421772 | |
French - Rundi fra-run | 1274 | 8 | 1420253 |
French - Tagalog fra-tgl | 854 | 3382249 | |
Hebrew - Ukrainian heb-ukr | 969 | 10 | 3423678 |
Hindi - Marathi hin-mar | 226 | 2 | 3106276 |
Hindi - Urdu hin-urd | 240 | 2 | 3999092 |
Hindi - Chinese hin-zho | 324 | 1 | 3161573 |
Hungarian - Japanese hun-jpn | 2500 | 3769 | 9672524 |
Hungarian - Korean hun-kor | 271 | 6567443 | |
Hungarian - Ukrainian hun-ukr | 486 | 3 | 7926430 |
Armenian - Russian hye-rus | 257 | 5307481 | |
Icelandic - Italian isl-ita | 236 | 4018669 | |
Icelandic - Russian isl-rus | 426 | 1890993 | |
Icelandic - Spanish isl-spa | 241 | 5513480 | |
Italian - Ukrainian ita-ukr | 5000 | 8887 | 8180346 |
Javanese - Malay (macrolanguage) jav-msa | 231 | 1008999 | |
Japanese - Lithuanian jpn-lit | 249 | 4866288 | |
Japanese - Norwegian jpn-nor | 1048 | 15 | 7197098 |
Japanese - Ukrainian jpn-ukr | 465 | 21 | 4576692 |
Japanese - Vietnamese jpn-vie | 1098 | 622 | 7083577 |
Georgian - Russian kat-rus | 660 | 6 | 3847285 |
Korean - Chinese kor-zho | 417 | 8226696 | |
Macedonian - Spanish mkd-spa | 217 | 3 | 8901426 |
Dutch - Dutch nld-nld | 1000 | 1147 | 1361554 |
Dutch - Ukrainian nld-ukr | 10000 | 5162 | 8915052 |
Norwegian - Ukrainian nor-ukr | 674 | 6189378 | |
Norwegian - Chinese nor-zho | 204 | 8925891 | |
Polish - Polish pol-pol | 206 | 1940940 | |
Portuguese - Tagalog por-tgl | 1777 | 3 | 2296650 |
Russian - Tatar rus-tat | 2138 | 1159 | 1067949 |
Slovenian - Ukrainian slv-ukr | 926 | 49 | 7719805 |
Spanish - Spanish spa-spa | 2500 | 3069 | 4835216 |
Spanish - Tagalog spa-tgl | 1000 | 342 | 2536684 |
Turkish - Turkish tur-tur | 2500 | 1494 | 1976047 |
Turkish - Ukrainian tur-ukr | 2540 | 6722 | 5543716 |
Ukrainian - Chinese ukr-zho | 1575 | 1 | 4090645 |
Chinese - Chinese zho-zho | 3246 | 5810 | 8858051 |