Recursive AI
onenlpDocs

Licences of the Universal Dependencies treebanks

OneNLP 1.0.0docs/ud-licences.md at 59bd14c Markdown

All onenlp docs

The first sections cover ZH, FR, ES, PT, DE, IT, TR, HI and NL in detail. The last section ("Every treebank of release 2.18", generated by tools/fetch/ud_docs.py) covers all 353 treebanks in 193 languages, with the summary counts, the per-language classification, the quotes behind every non-routine ruling and the named-entity data beyond UD.

Every UD treebank of these nine languages in release 2.18 (15 May 2026; each repository at tag r2.18), with the licence as the treebank states it and the verdict for training and evaluating OneNLP models. Read on 2026-11-05 from each treebank's README (the License: metadata line and its licence section) and LICENSE.txt.

Rule applied: CC BY-SA, CC BY and CC0 data may train models, with credit; non-commercial (NC), research-only, paid and platform-restricted text may not. A treebank inside a CC BY-SA release that is itself NC is out.

  • go: train and evaluate, with credit. Models trained on CC BY-SA data carry "SA lineage" in their provenance.
  • eval-only: test-only treebanks (they ship no training split) and treebanks kept for evaluation.
  • hold: unresolved terms or restricted source text; not used until the terms are resolved.
  • no-go: non-commercial or otherwise outside the rule; never fetched.
  • chosen: the treebank that trains (and gates) the language's fast-tier model.

The release-wide notice in each README that applies to the Google-originated treebanks (GSD for German, Spanish, French and Portuguese) and to the Parallel UD (PUD) treebanks reads: the underlying sentences are ones "Google asserts no ownership over and no copyright over", provided "AS IS"; the annotations are CC BY-SA 4.0 (GSD) or CC BY-SA 3.0 (PUD).

Chinese

TreebankLicence line (README)LICENSE.txtSplitsVerdict
GSDSimpCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo, chosen (Simplified script)
GSDCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo; the Traditional-script twin of GSDSimp (same sentences): never train on one and test on the other. Not fetched
PUDCC BY-SA 3.0CC BY-SA 3.0testeval-only (fetched as a second test set; Traditional script)
CFLCC BY-SA 4.0CC BY-SA 4.0testeval-only (learner essays); not fetched
HKCC BY-SA 4.0CC BY-SA 4.0testeval-only (subtitles, legislative proceedings, Traditional script); not fetched
BeginnerCC BY-NC-SA 3.0CC BY-NC-SA 3.0testno-go (NC)
PatentCharCC BY-NC-SA 3.0CC BY-SA 4.0 (contradicts the README)testno-go until the maintainers resolve the contradiction (the stricter line is taken)

Classical Chinese (lzh) is a different language and is not covered.

French

TreebankLicence lineLICENSE.txtSplitsVerdict
GSDCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo, chosen
PUDCC BY-SA 3.0CC BY-SA 3.0testeval-only (fetched)
RhapsodieCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo (spoken French, small); not used
ParisStoriesCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo (oral French); not used
SequoiaLGPL-LRnonetrain, dev, testgo: LGPL-LR is allowed with credit and treated like CC BY-SA (SA lineage). Not used for the baselines (not retrained)
FQBLGPL-LRnonetestgo, same ruling (test-only: eval)
ParTUTCC BY-NC-SA 4.0CC BY-NC-SA 4.0train, dev, testno-go (NC)
FTBnone in release 2.18nonenot in the releasenot available (last tagged r2.11)

Spanish

TreebankLicence lineLICENSE.txtSplitsVerdict
AnCoraCC BY 4.0CC BY 4.0train, dev, testgo, chosen. The README still carries an older sentence, "The GNU license is inherited from the original dataset", while its changelog says "The license changed to CC BY 4.0" in release 2.8 and LICENSE.txt and the metadata agree on CC BY 4.0. Recorded as a stale sentence, low risk
GSDCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo; not used
PUDCC BY-SA 3.0CC BY-SA 3.0testeval-only (fetched)
COSERCC BY-SA 4.0CC BY-SA 4.0testeval-only (spoken rural Spanish); not fetched
SVarT, Spanish-English Miaminot in release 2.18nonenonenot available

Spanish Sign Language (LSE) is not Spanish text and is not covered.

Portuguese

TreebankLicence lineLICENSE.txtSplitsVerdict
BosqueCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo, chosen (Universal NER annotates the same sentences)
GSDCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo (the changelog: Google dropped the "NC" restriction from the annotations); not used
PUDCC BY-SA 3.0CC BY-SA 3.0testeval-only (fetched)
PetroGoldCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo (oil and gas academic texts); not used
PorttinariCC BY 4.0CC BY 4.0train, dev, testgo on the authors' statement (newspaper text); not used
DANTEStocksCC BY 4.0CC BY 4.0train, dev, testno-go (ruled): tweets, platform terms apply to the text
CINTILCC BY-NC-ND 4.0CC BY-NC-ND 4.0train, dev, testno-go (NC, ND)
DHBBnot in release 2.18nonenonenot available

German

TreebankLicence lineLICENSE.txtSplitsVerdict
GSDCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo, chosen
PUDCC BY-SA 3.0CC BY-SA 3.0testeval-only (fetched)
HDTCC BY-SA 4.0 (annotation)"The annotation of the treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0"train (in parts), dev, testno-go (ruled): the README's licence section says "Heise gave permission to distribute the text for academic use", so the text is not cleared for commercial use; not used until resolved
LITCC BY-NC-SA 4.0CC BY-NC-SA 4.0testno-go (NC)

Italian

TreebankLicence lineLICENSE.txtSplitsVerdict
ISDTCC BY-NC-SA 3.0"released by the authors under the Creative Commons" NC-SA 3.0train, dev, testno-go (NC). The standard Italian treebank is not usable
VITCC BY-NC-SA 3.0NC-SA 3.0train, dev, testno-go (NC)
ParTUTCC BY-NC-SA 4.0NC-SA 4.0train, dev, testno-go (NC)
PoSTWITACC BY-NC-SA 4.0NC-SA 4.0train, dev, testno-go (NC; also tweets)
KIParlaForestCC BY-NC-SA 4.0NC-SA 4.0testno-go (NC)
ParlaMintCC BY-SA 4.0CC BY-SA 4.0train (326 sentences), test (375)go, chosen by default: modern text, but tiny and with no dev split
MarkITCC BY 4.0CC BY 4.0train, dev, testgo (611 grammar-example sentences), used with ParlaMint
OldCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo; Dante's Comedy (Old Italian), not used: not modern text
TWITTIROCC BY-SA 4.0CC BY-SA 4.0train, dev, testno-go (ruled): ironic tweets, platform terms apply to the text
ValicoCC BY-SA 4.0CC BY-SA 4.0testeval-only (learner essays); not fetched
PUDCC BY-SA 3.0CC BY-SA 3.0testeval-only (fetched)

Turkish

TreebankLicence lineLICENSE.txtSplitsVerdict
BOUNCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo, chosen
KenetCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo (dictionary examples); not used
TourismCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo (customer reviews); not used
FrameNetCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo (grammar examples); not used
AtisCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo on the maintainers' licence; the sentences translate the English ATIS corpus; not used
PennCC BY-SA 4.0CC BY-SA 4.0train, dev, testno-go (ruled): a Turkish version of the Penn Treebank, whose source sentences are LDC-licensed; not used
GBCC BY-SA 4.0CC BY-SA 4.0testeval-only (grammar-book examples); not fetched
PUDCC BY-SA 3.0CC BY-SA 3.0testeval-only (fetched)
IMSTCC BY-NC-SA 4.0CC BY-NC-SA 4.0train, dev, testno-go (NC). The standard Turkish treebank is not usable
ULUnot in release 2.18nonenonenot available

Turkish-German SAGT is a code-switching treebank under CC BY-NC-SA 4.0 and is out of scope.

Hindi

TreebankLicence lineLICENSE.txtSplitsVerdict
HDTBCC BY-NC-SA 4.0"licensed under the Creative Commons License Attribution-NonCommercial-ShareAlike 4.0"train, dev, testno-go (NC). It is Hindi's only sizeable treebank
PUDCC BY-SA 3.0CC BY-SA 3.0testeval-only (fetched)
Conversnot in release 2.18nonenonenot available
Hindi-English HIENCSnot in release 2.18nonenonenot available (code-mixed)

There is no allowed Hindi training treebank. Hindi-PUD has 1,000 test sentences and no training split, so no tagger, morphologizer, lemmatizer or parser baseline can be trained for Hindi from UD data, and our Hindi models would have to learn from other data. The Hindi fast-tier model is therefore trained on web text labelled by the accurate tier and by heads trained on the Marathi, Sindhi and Punjabi treebanks above (all CC BY-SA 4.0; recipes/hi/fast/README.md); no Hindi treebank or Hindi-derived annotation of HDTB enters the labeller or the student.

Dutch

TreebankLicence lineLICENSE.txtSplitsVerdict
AlpinoCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo, chosen (news)
LassySmallCC BY-SA 4.0CC BY-SA 4.0train, dev, testgo (Wikipedia; larger than Alpino); not used

Universal NER (v1)

UNER v1 (Mayhew et al., NAACL 2024) is released under CC BY-SA 4.0 as UniversalNER/UNER_<Language>-<Treebank> repositories; the PUD-based ones keep PUD's CC BY-SA 3.0. Listing of the organisation's repositories, 2026-11-05:

LanguageUNER datasetsVerdict
ChineseGSD, GSDSIMP (train, dev, test), PUD (test)go; PUD eval-only
PortugueseBosque (train, dev, test), PUD (test)go; PUD eval-only
GermanPUD (test)eval-only; no training data
French, Spanish, Italian, Turkish, Hindi, Dutchnonegap: other sources below

Each UNER dataset is a separate corpus from its treebank: it was cut from an older UD commit. Checked against r2.18 sentence by sentence: Portuguese-Bosque has identical tokens in every sentence of every split (7,018 / 1,172 / 1,167), so its entity labels sit on r2.18's tokens; Chinese-GSDSimp has identical texts, with different tokens in 2 train, 1 dev and 2 test sentences. Scheme: PER, ORG, LOC.

Named-entity corpora for the languages without UNER

Terms read 2026-11-05 from the dataset's own page or card. "Chosen" means fetched by tools/fetch/<lang>/fetch.sh and used for the baseline.

CorpusLanguagesTerms (as stated)Verdict
WikiNER (Nothman et al. 2013), wp3 files, figshare 5462500fr, es, it, nl (also de, en, pt, pl, ru)figshare record licence: CC BY 4.0. Silver labels projected from Wikipedia links; the underlying text is Wikipedia (CC BY-SA)go, chosen for fr, es, it, nl; SA lineage. No official split: we split by article (see the manifests)
GermEval 2014 NER (NoSta-D, Benikova et al. 2014)de"The data is released under the permissive CC-BY license" (LREC 2014 abstract); the shared-task page links the CC BY 4.0 text; HF card: cc-by-4.0go, chosen for de; gold labels, official split; 12 fine-grained types with embedded and derived spans
Turkish-WikiNER (Altinok 2023), turkish-nlp-suite/turkish-wikiNERtrHF card: license: cc-by-sa-4.0go, chosen for tr; SA lineage; 18 OntoNotes-style types
Naamapadam (Mhaske et al. 2023), ai4bharat/naamapadamhiCard: "We license the actual packaging of the mined data under the Creative Commons CC0 license"; "We do not own any of the text from which this data has been extracted." Source data: "Samanantar dataset", whose card says "Creative Commons Attribution-NonCommercial 4.0 International" (license: cc-by-nc-4.0)no-go the text comes from Samanantar, which is non-commercial, so the text sources are not permissive. Hindi NER is a logged gap
WikiANN / PAN-X (Pan et al. 2017), unimelb-nlp/wikiannall nineHF card: license: unknown, "[More Information Needed]"no-go: out
WikiNEuRal, MultiNERD (Babelscape)fr, es, it, de, nl, zh (MultiNERD)HF cards: cc-by-nc-sa-4.0no-go (NC)
MultiCoNER v1/v2hi, zh, tr, nl, de, es, fr, it, ptHF card: cc-by-4.0not examined: a fine-grained scheme that does not map onto PER/ORG/LOC; candidate for a later look
CoNLL-2002 (es, nl)es, nlHF card: license: unknown; newspaper text, no open terms statednot used (at most evaluation, through published baselines)
ctoraman/atis-ner-turkishtrHF: cc-by-nc-sa-4.0no-go (NC)
Smaller Turkish NER sets on the HF hub (e-commerce, clinical, privacy, synthetic)trassorted (mit, cc-by-4.0, cc0-1.0, cc-by-sa-4.0)not used: single narrow domains, not a general-purpose gold set

NER labels follow each corpus: the baselines map them to PER, ORG, LOC (and MISC where the corpus has it) as the manifests state; Turkish maps PERSON, ORG, GPE and LOC and drops the other types to O.

Rulings and data gaps (recorded 2026-11-05)

Rulings of the project; the owner may revisit them.

  • No-go by rule: German-HDT (text licensed for academic use only, i.e. research-only); Italian-TWITTIRO and Portuguese-DANTEStocks (tweet text, platform-restricted); Turkish-Penn (translated from an LDC corpus).
  • Ruled 2026-11-05: French Sequoia and FQB (LGPL-LR) are allowed with credit, treated like CC BY-SA (go; unused, French baselines not retrained). WikiANN is out. Naamapadam is out: its text comes from Samanantar (CC BY-NC 4.0), so the Hindi NER baseline trained on it is withdrawn and Hindi NER is a logged gap beside Hindi UD. AnCora: the LICENSE.txt (CC BY 4.0) governs; the README still carries a stale sentence ("The GNU license is inherited ..."), which is recorded and not relied on.
  • Hindi has no UD baseline and no UD-trained model. Its only sizeable treebank (HDTB) is non-commercial and Hindi-PUD is test-only. A Hindi tagger, parser or NER model waits for allowed data (Naamapadam is out, see the NER table).
  • Italian trains on 897 sentences (ParlaMint train plus MarkIT), because ISDT, VIT and ParTUT are non-commercial. Italian rows are reported as they come and compared with spaCy trained on the same small set; they are not hidden or compared with systems trained on ISDT.

Every treebank of release 2.18

Release 2.18 (15 May 2026) has 353 treebanks in 193 languages. Each repository was read at tag r2.18 on 2026-11-06 (tools/fetch/ud_survey.py): the License: line of the README, the whole of LICENSE.txt, and the README text for the source of the sentences. The full table with sizes is tools/fetch/ud/treebanks.tsv; the per-language classification is tools/fetch/ud/languages.tsv. The sections above give the nine languages' detail; this one covers all languages with the same rules.

Summary

VerdictTreebanks
go129
eval-only145
no-go79
total353
Language classLanguages
train+eval: at least one go treebank with training and test splits84 (of which 60 have 1,000 or more training sentences in the gating treebank and 20 fewer than 500)
eval-only: only test-only or evaluation data is allowed84
gap: every treebank is non-commercial, research-only or otherwise ruled out: the accurate tier has no UD data25
total193

The nine languages with fast-tier work (zh fr es pt de it tr nl, plus en) keep their treebanks and manifests; Hindi stays a recorded gap for training (HDTB is NC), with Hindi-PUD as its test set.

Rules applied

  • go: the README licence line is CC BY-SA, CC BY, CC0, PD, LGPL-LR or another permissive licence, LICENSE.txt does not contradict it, no README sentence restricts the text, and the treebank has a training split. SA lineage is recorded in provenance. Credit goes in THIRD-PARTY-NOTICES.
  • eval-only: allowed licence but no training split (PUD and other test-only treebanks).
  • no-go: non-commercial or no-derivatives licence (the README line and LICENSE.txt agree), research-only text, platform-restricted text (tweets, Reddit), LDC-derived text, or the rulings of 2026-11-05.
  • Rulings of 2026-11-07 on the 22 treebanks that were unclear: (1) the README says non-commercial and LICENSE.txt is the generic CC BY-SA template: no-go, the README statement wins; (2) CC BY-SA annotation over platform or terms-restricted text: no-go; (3) Polish-LFG (GNU GPL 3.0): no-go; (4) Ligurian-GLT (Computational Use of Data Agreement 1.0): go, credited. Nothing stays unclear.
  • The LICENSE.txt column abbreviates its first lines; own text means a bespoke document (read in full for the decision).

Languages

Gating treebank: among the go treebanks with training and test splits, the one the most published systems report (Stanza, UDPipe 2, Trankit), then the larger training set; the nine fast-tier languages keep theirs. Training sentences in brackets. Extra training are further go treebanks. Test-only are eval-only sets. Not usable lists no-go treebanks.

LanguageClassGating treebank (train sentences)Extra trainingTest-onlyNot usable
Abazaeval-onlyAbaza-ATB
Abkhazeval-onlyAbkhaz-AbNC
Afrikaanstrain+evalAfrikaans-AfriBooms (1,315)
Akkadianeval-onlyAkkadian-PISANDUB, Akkadian-RIAO
Akuntsueval-onlyAkuntsu-TuDeT
Albaniantrain+evalAlbanian-STAF (160)Albanian-TSA
Alemanniceval-onlyAlemannic-DIVITAL, Alemannic-UZH
Amhariceval-onlyAmharic-ATT
Ancient Greektrain+evalAncient_Greek-PTNK (727)no-go: Ancient_Greek-PROIEL, Ancient_Greek-Perseus
Ancient Hebrewgapno-go: Ancient_Hebrew-PTNK
Apurinaeval-onlyApurina-UFPA
Arabiceval-onlyArabic-PUDno-go: Arabic-NYUAD, Arabic-PADT
Armeniantrain+evalArmenian-ArmTDP (4,352)Armenian-BSUT
Assamesetrain+evalAssamese-AiW (51)
Assyrianeval-onlyAssyrian-AS
Azerbaijanieval-onlyAzerbaijani-TueCL
Bambaraeval-onlyBambara-CRB
Basquegapno-go: Basque-BDT
Bavarianeval-onlyBavarian-MaiBaam
Bejaeval-onlyBeja-Autogramm
Belarusiangapno-go: Belarusian-HSE
Bengalieval-onlyBengali-BRU
Bhojpurieval-onlyBhojpuri-BHTB
Bokotaeval-onlyBokota-ChibErgIS
Bororotrain+evalBororo-BDT (17,107)
Brahuieval-onlyBrahui-Kholum
Bretoneval-onlyBreton-KEB
Bulgariangapno-go: Bulgarian-BTB
Buryattrain+evalBuryat-BDT (20)
Cantoneseeval-onlyCantonese-HK
Cappadocianeval-onlyCappadocian-AMGiC, Cappadocian-TueCL
Catalantrain+evalCatalan-AnCora (13,123)
Cebuanoeval-onlyCebuano-GJA
Central Kurdishtrain+evalCentral_Kurdish-Mukri (92)
Chinesetrain+evalChinese-GSDSimp (3,997)Chinese-GSDChinese-CFL, Chinese-HK, Chinese-PUDno-go: Chinese-Beginner, Chinese-PatentChar
Chintanggapno-go: Chintang-CTNTB
Chukchieval-onlyChukchi-HSE
Classical Armeniangapno-go: Classical_Armenian-CAVaL
Classical Chinesetrain+evalClassical_Chinese-Kyoto (74,609)Classical_Chinese-TueCL
Coptictrain+evalCoptic-Scriptorium (1,467)Coptic-Bohairic
Croatiantrain+evalCroatian-SET (6,914)
Czechtrain+evalCzech-CAC (23,478)Czech-CLTTCzech-PUD, Czech-Poetryno-go: Czech-FicTree, Czech-PDTC
Danishtrain+evalDanish-DDT (4,383)
Dutchtrain+evalDutch-Alpino (12,289)Dutch-LassySmall
Egyptiantrain+evalEgyptian-PC (1,619)
Englishtrain+evalEnglish-EWT (12,544)English-Atis, English-CHILDES, English-ESLSpokEnglish-CTeTex, English-LittlePrince, English-PUD, English-Pronounsno-go: English-GENTLE, English-GUM, English-GUMReddit, English-LinES, English-ParTUT
Erzyatrain+evalErzya-JR (1,217)
Esperantoeval-onlyEsperanto-Cairo, Esperanto-Prago
Estoniangapno-go: Estonian-EDT, Estonian-EWT
Faroesetrain+evalFaroese-FarPaHC (1,020)Faroese-OFT
Finnishtrain+evalFinnish-FTB (14,981)Finnish-TDTFinnish-PUDno-go: Finnish-OOD
Frenchtrain+evalFrench-GSD (14,450)French-ALTS, French-ParisStories, French-Rhapsodie, French-SequoiaFrench-FQB, French-PUD, French-PoitevinDIVITALno-go: French-ParTUT
Frisian Dutcheval-onlyFrisian_Dutch-Fame
Galiciantrain+evalGalician-TreeGal (600)Galician-PUDno-go: Galician-CTG
Georgiantrain+evalGeorgian-GLC (2,214)Georgian-GNC
Germantrain+evalGerman-GSD (13,813)German-PUDno-go: German-HDT, German-LIT
Ghegeval-onlyGheg-GPS
Gorontaloeval-onlyGorontalo-BungoLoLombi
Gothicgapno-go: Gothic-PROIEL
Greektrain+evalGreek-GUD (1,071)Greek-Cretan, Greek-MessinianGreek-Lesbianno-go: Greek-GDT, Greek-GLCII
Guajajaraeval-onlyGuajajara-TuDeT
Guaranieval-onlyGuarani-OldTuDeT
Gujaratieval-onlyGujarati-GujTB
Gwichineval-onlyGwichin-TueCL
Haitian Creoletrain+evalHaitian_Creole-Adolphe (2,605)Haitian_Creole-Autogramm
Hausaeval-onlyHausa-EasternAutogramm, Hausa-NorthernAutogramm, Hausa-SouthernAutogramm, Hausa-WesternAutogramm
Hebrewtrain+evalHebrew-IAHLTwiki (4,298)Hebrew-IAHLTknessetHebrew-PostRabno-go: Hebrew-HTB
Highland Puebla Nahuatleval-onlyHighland_Puebla_Nahuatl-ITML
Hindieval-onlyHindi-PUDno-go: Hindi-HDTB
Hittiteeval-onlyHittite-HitTB
Hungariangapno-go: Hungarian-Szeged
Icelandictrain+evalIcelandic-IcePaHC (34,007)Icelandic-GC, Icelandic-ModernIcelandic-PUD
Ikaeval-onlyIka-ChibErgIS
Indonesiantrain+evalIndonesian-GSD (4,482)Indonesian-CSUIIndonesian-PUD
Irishtrain+evalIrish-IDT (4,005)Irish-Cadhanno-go: Irish-TwittIrish
Italiantrain+evalItalian-ParlaMint (326)Italian-MarkIT, Italian-OldItalian-PUD, Italian-Valicono-go: Italian-ISDT, Italian-KIParlaForest, Italian-ParTUT, Italian-PoSTWITA, Italian-TWITTIRO, Italian-VIT
Japanesetrain+evalJapanese-GSD (7,050)Japanese-GSDLUWJapanese-PUD, Japanese-PUDLUWno-go: Japanese-BCCWJ, Japanese-BCCWJLUW
Javaneseeval-onlyJavanese-CSUI
Kaaporeval-onlyKaapor-TuDeT
Kadiweugapno-go: Kadiweu-Unicamp
Kangrieval-onlyKangri-KDTB
Karelianeval-onlyKarelian-KKPP
Karoeval-onlyKaro-TuDeT
Kazakhtrain+evalKazakh-KTB (31)
Khoekhoegapno-go: Khoekhoe-KDT
Kicheeval-onlyKiche-IU
Komi Permyaktrain+evalKomi_Permyak-UH (34)
Komi Zyriantrain+evalKomi_Zyrian-Lattice (20)Komi_Zyrian-IKDP
Koreantrain+evalKorean-Kaist (23,010)Korean-GSD, Korean-KSLKorean-LittlePrince, Korean-PUD
Kyrgyztrain+evalKyrgyz-KTMU (1,308)Kyrgyz-TueCL
Latgalianeval-onlyLatgalian-Cairo
Latintrain+evalLatin-LLCT (7,289)Latin-CIRCSEno-go: Latin-ITTB, Latin-PROIEL, Latin-Perseus, Latin-UDante
Latviantrain+evalLatvian-LVTB (15,059)Latvian-Cairo
Liguriantrain+evalLigurian-GLT (20)
Lithuaniantrain+evalLithuanian-ALKSNIS (2,341)Lithuanian-HSE
Livvitrain+evalLivvi-KKPP (19)
Low Saxontrain+evalLow_Saxon-LSDC (500)
Luxembourgisheval-onlyLuxembourgish-LuxBank
Macedonianeval-onlyMacedonian-MTB
Madieval-onlyMadi-Jarawara
Maghrebi Arabic Frenchgapno-go: Maghrebi_Arabic_French-Arabizi
Makurapeval-onlyMakurap-TuDeT
Malayalameval-onlyMalayalam-UFAL
Maltesetrain+evalMaltese-MUDT (1,123)
Manxgapno-go: Manx-Cadhan
Marathitrain+evalMarathi-UFAL (373)Marathi-CMUPAN
Mbya Guaranigapno-go: Mbya_Guarani-Thomas
Middle Armenianeval-onlyMiddle_Armenian-ArmTDP
Middle Frencheval-onlyMiddle_French-ALTMno-go: Middle_French-PROFITEROLE
Mokshatrain+evalMoksha-JR (22)
Mundurukueval-onlyMunduruku-TuDeT
Nagagapno-go: Naga-Suansu
Naijatrain+evalNaija-NSC (7,279)
Neapolitaneval-onlyNeapolitan-RB
Nenetseval-onlyNenets-Tundra
Nepalieval-onlyNepali-BK
Nheengatugapno-go: Nheengatu-CompLin
North Samitrain+evalNorth_Sami-Giella (2,257)
Northern Kurdishtrain+evalNorthern_Kurdish-Kurmanji (20)
Northwest Gbayaeval-onlyNorthwest_Gbaya-Autogramm
Norwegiantrain+evalNorwegian-Bokmaal (15,696)Norwegian-Nynorsk
Occitangapno-go: Occitan-TTB
Odiaeval-onlyOdia-ODTB
Old Church Slavonicgapno-go: Old_Church_Slavonic-PROIEL
Old East Slavictrain+evalOld_East_Slavic-RNC (3,778)Old_East_Slavic-Birchbark, Old_East_Slavic-Ruthenianno-go: Old_East_Slavic-TOROT
Old Englisheval-onlyOld_English-Cairo
Old Frencheval-onlyOld_French-ALTMno-go: Old_French-PROFITEROLE
Old Georgianeval-onlyOld_Georgian-GLC
Old Irisheval-onlyOld_Irish-DipWBGno-go: Old_Irish-DipSGG
Old Occitantrain+evalOld_Occitan-CorAG (1,092)
Old Turkisheval-onlyOld_Turkish-Clausal
Ottoman Turkishtrain+evalOttoman_Turkish-BOUN (114)Ottoman_Turkish-DUDUOttoman_Turkish-TueCL
Pashtoeval-onlyPashto-Prince, Pashto-Sikaram
Paumarieval-onlyPaumari-TueCL
Persiantrain+evalPersian-Seraji (4,798)Persian-PerDT
Pesheval-onlyPesh-ChibErgIS
Phrygianeval-onlyPhrygian-KUL
Polishtrain+evalPolish-MPDT (1,433)Polish-PUDno-go: Polish-PDB, Polish-LFG
Pomakgapno-go: Pomak-Philotis
Portuguesetrain+evalPortuguese-Bosque (7,018)Portuguese-GSD, Portuguese-PetroGold, Portuguese-PorttinariPortuguese-PUDno-go: Portuguese-CINTIL, Portuguese-DANTEStocks
Punjabitrain+evalPunjabi-Rang (81)Punjabi-CS
Romaniantrain+evalRomanian-RRT (8,043)Romanian-SiMoNERoRomanian-ArT, Romanian-MolDoRono-go: Romanian-TueCL, Romanian-Nonstandard
Russiantrain+evalRussian-GSD (3,850)Russian-PoetryRussian-PUDno-go: Russian-SynTagRus, Russian-Taiga
Ruuligapno-go: Ruuli-RDT
Sanskrittrain+evalSanskrit-Vedic (21,477)Sanskrit-UFAL
Scottish Gaelictrain+evalScottish_Gaelic-ARCOSG (3,544)
Serbiantrain+evalSerbian-SET (3,328)
Shanghainesegapno-go: Shanghainese-ShUD
Sicilianeval-onlySicilian-STB
Sindhitrain+evalSindhi-Isra (4,096)
Sinhalaeval-onlySinhala-Appuwa, Sinhala-STB
Skolt Samitrain+evalSkolt_Sami-Giellagas (20)
Slovaktrain+evalSlovak-SNK (8,483)
Sloveniantrain+evalSlovenian-SSJ (10,903)Slovenian-SST
South Levantine Arabicgapno-go: South_Levantine_Arabic-MADAR
Southern Kurdishtrain+evalSouthern_Kurdish-Garrusi (152)
Spanishtrain+evalSpanish-AnCora (14,287)Spanish-GSDSpanish-COSER, Spanish-PUD
Spanish Sign Languageeval-onlySpanish_Sign_Language-LSE
Swedishtrain+evalSwedish-Talbanken (4,315)Swedish-Old, Swedish-PUD, Swedish-SweLLno-go: Swedish-LinES
Swedish Sign Languageeval-onlySwedish_Sign_Language-SSLC
Tagalogeval-onlyTagalog-TRGno-go: Tagalog-Ugnayan
Tamileval-onlyTamil-MWTTno-go: Tamil-TTB
Tatareval-onlyTatar-NMCTT
Tekoeval-onlyTeko-TuDeT
Telugutrain+evalTelugu-MTG (1,051)
Telugu Englishtrain+evalTelugu_English-TECT (61)
Thaitrain+evalThai-TUD (2,902)Thai-PUD
Tswanaeval-onlyTswana-Popapolelo
Tupinambaeval-onlyTupinamba-TuDeT
Turkishtrain+evalTurkish-BOUN (7,803)Turkish-Atis, Turkish-FrameNet, Turkish-Kenet, Turkish-TourismTurkish-GB, Turkish-PUD, Turkish-TueCLno-go: Turkish-IMST, Turkish-Penn
Turkish Englisheval-onlyTurkish_English-BUTR
Turkish Germangapno-go: Turkish_German-SAGT
Ukrainiantrain+evalUkrainian-ParlaMint (5,611)no-go: Ukrainian-IU
Umbrianeval-onlyUmbrian-IKUVINA
Upper Sorbianeval-onlyUpper_Sorbian-UFAL
Urdugapno-go: Urdu-UDTB
Uyghurtrain+evalUyghur-UDT (1,656)
Uzbektrain+evalUzbek-UzUDT (483)Uzbek-TueCL, Uzbek-UT
Vepseval-onlyVeps-VWT
Vietnamesetrain+evalVietnamese-VTB (1,400)Vietnamese-TueCL
Warlpirieval-onlyWarlpiri-UFAL
Welshtrain+evalWelsh-CCG (1,355)
Western Armeniantrain+evalWestern_Armenian-ArmTDP (5,274)
Western Sierra Puebla Nahuatleval-onlyWestern_Sierra_Puebla_Nahuatl-MesoTree
Woloftrain+evalWolof-WTB (1,188)
Xavanteeval-onlyXavante-XDT
Xibegapno-go: Xibe-XDT
Yakuteval-onlyYakut-YKTDT
Yiddishtrain+evalYiddish-YiTB (1,877)
Yorubaeval-onlyYoruba-YTB
Yupikeval-onlyYupik-SLI
Zaartrain+evalZaar-Autogramm (978)
Zazakitrain+evalZazaki-ZSD (138)

Languages without an accurate-tier model

Every treebank of these languages is ruled out, so there is no allowed training data. Hindi has UD data only in the test-only PUD set (HDTB is non-commercial); its fast-tier model is trained on labels from the accurate tier.

LanguageTreebanks and why they are out
Ancient HebrewAncient_Hebrew-PTNK: ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC 4.0, but LICENSE
BasqueBasque-BDT: README licence line CC BY-NC-SA 3.0; LICENSE.txt agrees
BelarusianBelarusian-HSE: ruled no-go (terms-restricted text): README: genre list includes "5) social media: messages from the Telegram
BulgarianBulgarian-BTB: README licence line CC BY-NC-SA 3.0; LICENSE.txt agrees
ChintangChintang-CTNTB: ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICE
Classical ArmenianClassical_Armenian-CAVaL: README licence line CC BY-NC-SA 4.0; LICENSE.txt agrees
EstonianEstonian-EDT: README licence line CC BY-NC-SA 4.0; LICENSE.txt agrees; Estonian-EWT: ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICE
GothicGothic-PROIEL: README licence line CC BY-NC-SA 3.0; LICENSE.txt agrees
HungarianHungarian-Szeged: README licence line CC BY-NC-SA 3.0; LICENSE.txt agrees
KadiweuKadiweu-Unicamp: README licence line CC BY-NC-SA 4.0; LICENSE.txt agrees
KhoekhoeKhoekhoe-KDT: ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICE
Maghrebi Arabic FrenchMaghrebi_Arabic_French-Arabizi: ruled no-go (terms-restricted text): README: sources include "Algerian newspaper’s web forums"; no statement a
ManxManx-Cadhan: ruled no-go (terms-restricted text): README: sentences "came from a large web-crawled corpus of Manx"; genres
Mbya GuaraniMbya_Guarani-Thomas: ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICE
NagaNaga-Suansu: ruled no-go (terms-restricted text): README: test set includes "film_Bridge: Begining of the subtitles from Br
NheengatuNheengatu-CompLin: README licence line CC BY-NC-SA 4.0; LICENSE.txt agrees
OccitanOccitan-TTB: ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICE
Old Church SlavonicOld_Church_Slavonic-PROIEL: README licence line CC BY-NC-SA 4.0; LICENSE.txt agrees
PomakPomak-Philotis: README licence line CC BY-NC-SA 3.0; LICENSE.txt agrees
RuuliRuuli-RDT: ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICE
ShanghaineseShanghainese-ShUD: README: the source corpus is "licensed under Creative Commons BY-NC-ND 4.0", with "additional permission for d
South Levantine ArabicSouth_Levantine_Arabic-MADAR: README: sentences come from the MADAR parallel corpus, built on BTEC; the MADAR corpus "is made available to t
Turkish GermanTurkish_German-SAGT: ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICE
UrduUrdu-UDTB: README licence line CC BY-NC-SA 4.0; LICENSE.txt agrees
XibeXibe-XDT: ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 3.0, but LICE

Treebanks

Splits are sentence counts (train/dev/test) from stats.xml. "Licence line" is the README's License: metadata; the quote for any other decision is in the Rulings section.

TreebankLicence lineLICENSE.txtSplitsVerdict
Abaza-ATBCC BY-SA 4.0CC BY-SA 4.0-/-/98eval-only
Abkhaz-AbNCCC BY-SA 4.0CC BY-SA 4.0-/-/1545eval-only
Afrikaans-AfriBoomsCC BY-SA 4.0CC BY-SA 4.01315/194/425go
Akkadian-PISANDUBCC BY-SA 4.0CC BY-SA 4.0-/-/101eval-only
Akkadian-RIAOCC BY-SA 3.0CC BY-SA 3.0-/-/1874eval-only
Akuntsu-TuDeTCC BY-SA 4.0CC BY-SA 4.0-/-/343eval-only
Albanian-STAFCC BY-SA 4.0CC BY-SA 4.0160/20/20go
Albanian-TSACC BY-SA 4.0CC BY-SA 4.0-/-/60eval-only
Alemannic-DIVITALCC BY-SA 4.0CC BY-SA 4.0-/-/977eval-only
Alemannic-UZHCC BY-SA 4.0CC BY-SA 4.0-/-/100eval-only
Amharic-ATTCC BY-SA 4.0CC BY-SA 4.0-/-/1074eval-only
Ancient_Greek-PROIELCC BY-NC-SA 3.0own text15016/1019/1047no-go
Ancient_Greek-PTNKCC BY-SA 4.0CC BY-SA 4.0727/439/410go
Ancient_Greek-PerseusCC BY-NC-SA 2.5own text11476/1137/1306no-go
Ancient_Hebrew-PTNKCC BY-NC 4.0CC BY-SA 4.04417/639/552no-go (conflict)
Apurina-UFPACC BY-SA 4.0CC BY-SA 4.0-/-/183eval-only
Arabic-NYUADCC BY-SA 4.0CC BY-SA 4.015789/1986/1963no-go
Arabic-PADTCC BY-NC-SA 3.0own text6075/909/680no-go
Arabic-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Armenian-ArmTDPCC BY-SA 4.0CC BY-SA 4.04352/575/600go
Armenian-BSUTCC BY-SA 4.0CC BY-SA 4.01451/479/593go
Assamese-AiWCC BY-SA 4.0CC BY-SA 4.051/14/8go
Assyrian-ASCC BY-SA 4.0CC BY-SA 4.0-/-/57eval-only
Azerbaijani-TueCLCC BY-SA 4.0CC BY-SA 4.0-/-/148eval-only
Bambara-CRBCC BY-SA 4.0CC BY-SA 4.0-/-/1026eval-only
Basque-BDTCC BY-NC-SA 3.0CC BY-NC-SA5396/1798/1799no-go
Bavarian-MaiBaamCC BY-SA 4.0CC BY-SA 4.0-/-/1070eval-only
Beja-AutogrammCC BY-SA 4.0CC BY-SA 4.0-/-/763eval-only
Belarusian-HSECC BY-SA 4.0CC BY-SA 4.022853/1301/1077no-go
Bengali-BRUCC BY-SA 4.0CC BY-SA 4.0-/-/56eval-only
Bhojpuri-BHTBCC BY-SA 4.0CC BY-SA 4.0-/-/357eval-only
Bokota-ChibErgISCC BY-SA 4.0CC BY-SA 4.0-/-/406eval-only
Bororo-BDTCC BY-SA 4.0CC BY-SA 4.017107/2138/2139go
Brahui-KholumCC BY-SA 4.0CC BY-SA 4.0-/-/64eval-only
Breton-KEBCC BY-SA 4.0CC BY-SA 4.0-/-/884eval-only
Bulgarian-BTBCC BY-NC-SA 3.0own text8907/1115/1116no-go
Buryat-BDTCC BY-SA 4.0CC BY-SA 4.020/-/907go
Cantonese-HKCC BY-SA 4.0CC BY-SA 4.0-/-/1004eval-only
Cappadocian-AMGiCCC BY-SA 4.0CC BY-SA 4.0-/-/70eval-only
Cappadocian-TueCLCC BY-SA 4.0CC BY-SA 4.0-/-/350eval-only
Catalan-AnCoraCC BY 4.0CC BY 4.013123/1709/1846go
Cebuano-GJACC BY-SA 4.0CC BY-SA 4.0-/-/198eval-only
Central_Kurdish-MukriCC BY-SA 4.0CC BY-SA 4.092/23/23go
Chinese-BeginnerCC BY-NC-SA 3.0CC BY-NC-SA-/-/2295no-go
Chinese-CFLCC BY-SA 4.0CC BY-SA 4.0-/-/451eval-only
Chinese-GSDCC BY-SA 4.0CC BY-SA 4.03997/500/500go
Chinese-GSDSimpCC BY-SA 4.0CC BY-SA 4.03997/500/500go
Chinese-HKCC BY-SA 4.0CC BY-SA 4.0-/-/1004eval-only
Chinese-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Chinese-PatentCharCC BY-NC-SA 3.0CC BY-SA 4.0-/-/200no-go (conflict)
Chintang-CTNTBCC BY-NC-SA 4.0CC BY-SA 4.0-/-/2289no-go (conflict)
Chukchi-HSECC BY-SA 4.0CC BY-SA 4.0-/-/1004eval-only
Classical_Armenian-CAVaLCC BY-NC-SA 4.0CC BY-NC-SA3795/423/563no-go
Classical_Chinese-KyotoPDCC BY-SA 4.074609/6102/5528go
Classical_Chinese-TueCLCC BY-SA 4.0CC BY-SA 4.0-/-/100eval-only
Coptic-BohairicCC BY 4.0CC BY 4.0477/166/358go
Coptic-ScriptoriumCC BY 4.0CC BY 4.01467/380/405go
Croatian-SETCC BY-SA 4.0CC BY-SA 4.06914/960/1136go
Czech-CACCC BY-SA 4.0CC BY-SA 4.023478/603/628go
Czech-CLTTCC BY-SA 4.0CC BY-SA 4.0467/316/338go
Czech-FicTreeCC BY-NC-SA 4.0CC BY-NC-SA10160/1309/1291no-go
Czech-PDTCCC BY-NC-SA 4.0own text171044/22666/20187no-go
Czech-PUDCC BY-SA 4.0CC BY-SA 4.0-/-/1000eval-only
Czech-PoetryCC BY-SA 4.0CC BY-SA 4.0-/-/297eval-only
Danish-DDTCC BY-SA 4.0CC BY-SA 4.04383/564/565go
Dutch-AlpinoCC BY-SA 4.0CC BY-SA 4.012289/718/596go
Dutch-LassySmallCC BY-SA 4.0own text13817/1542/1761go
Egyptian-PCCC BY-SA 4.0CC BY-SA 4.01619/230/1240go
English-AtisCC BY-SA 4.0CC BY-SA 4.04274/572/586go
English-CHILDESCC BY-SA 4.0CC BY-SA 4.034732/3860/9591go
English-CTeTexCC BY-SA 4.0CC BY-SA 4.0-/-/276eval-only
English-ESLSpokCC BY-SA 4.0CC BY-SA 4.01856/232/232go
English-EWTCC BY-SA 4.0CC BY-SA 4.012544/2001/2077go
English-GENTLECC BY-NC-SA 4.0CC BY-NC-SA-/-/1334no-go
English-GUMCC BY-NC-SA 4.0CC BY-NC-SA11314/1575/1464no-go
English-GUMRedditCC BY 4.0CC BY 4.0686/104/105no-go
English-LinESCC BY-NC-SA 4.0own text3457/1118/1121no-go
English-LittlePrinceCC BY-SA 4.0CC BY-SA 4.0-/-/500eval-only
English-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
English-ParTUTCC BY-NC-SA 4.0own text1781/156/153no-go
English-PronounsCC BY-SA 4.0CC BY-SA 4.0-/-/285eval-only
Erzya-JRCC BY-SA 4.0CC BY-SA 4.01217/-/935go
Esperanto-CairoCC BY-SA 4.0CC BY-SA 4.0-/-/20eval-only
Esperanto-PragoCC BY-SA 4.0CC BY-SA 4.0-/-/131eval-only
Estonian-EDTCC BY-NC-SA 4.0own text24601/3122/3207no-go
Estonian-EWTCC BY-NC-SA 4.0CC BY-SA 4.05444/833/913no-go (conflict)
Faroese-FarPaHCCC BY-SA 4.0CC BY-SA 4.01020/300/301go
Faroese-OFTCC BY-SA 4.0own text-/-/1208eval-only
Finnish-FTBCC BY 4.0own text14981/1875/1867go
Finnish-OODCC BY-SA 4.0CC BY-SA 4.0-/-/2122no-go
Finnish-PUDCC BY-SA 4.0CC BY-SA 4.0-/-/1000eval-only
Finnish-TDTCC BY-SA 4.0own text12217/1364/1555go
French-ALTSCC BY-SA 4.0CC BY-SA 4.01202/154/670go
French-FQBLGPL-LRLGPL-LR-/-/2289eval-only
French-GSDCC BY-SA 4.0CC BY-SA 4.014450/1476/416go
French-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
French-ParTUTCC BY-NC-SA 4.0own text803/107/110no-go
French-ParisStoriesCC BY-SA 4.0CC BY-SA 4.01387/692/697go
French-PoitevinDIVITALCC BY-SA 4.0CC BY-SA 4.0-/-/239eval-only
French-RhapsodieCC BY-SA 4.0CC BY-SA 4.01288/1081/840go
French-SequoiaLGPL-LRLGPL-LR2231/412/456go
Frisian_Dutch-FameCC BY-SA 4.0CC BY-SA 4.0-/-/400eval-only
Galician-CTGCC BY-NC-SA 3.0CC BY-NC-SA2272/860/861no-go
Galician-PUDCC BY-SA 4.0CC BY-SA 4.0-/-/1000eval-only
Galician-TreeGalLGPL-LRLGPL-LR600/-/400go
Georgian-GLCCC BY-SA 4.0CC BY-SA 4.02214/469/481go
Georgian-GNCCC BY-SA 4.0CC BY-SA 4.0918/130/830go
German-GSDCC BY-SA 4.0CC BY-SA 4.013813/799/977go
German-HDTCC BY-SA 4.0CC BY-SA 4.0153035/18434/18459no-go
German-LITCC BY-NC-SA 4.0CC BY-NC-SA-/-/1920no-go
German-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Gheg-GPSCC BY-SA 4.0CC BY-SA 4.0-/-/966eval-only
Gorontalo-BungoLoLombiCC BY-SA 4.0CC BY-SA 4.0-/-/39eval-only
Gothic-PROIELCC BY-NC-SA 3.0own text3387/985/1029no-go
Greek-CretanCC BY-SA 4.0CC BY-SA 4.0180/60/30go
Greek-GDTCC BY-NC-SA 3.0own text1662/403/456no-go
Greek-GLCIICC BY-NC-SA 4.0CC BY-SA 4.0-/-/671no-go (conflict)
Greek-GUDCC BY-SA 4.0CC BY-SA 4.01071/-/736go
Greek-LesbianCC BY-SA 4.0CC BY-SA 4.0-/-/625eval-only
Greek-MessinianCC BY-SA 4.0CC BY-SA 4.060/20/30go
Guajajara-TuDeTCC BY-SA 4.0CC BY-SA 4.0-/-/1182eval-only
Guarani-OldTuDeTCC BY-SA 4.0CC BY-SA 4.0-/-/59eval-only
Gujarati-GujTBCC BY-SA 4.0CC BY-SA 4.0-/-/187eval-only
Gwichin-TueCLCC BY-SA 4.0CC BY-SA 4.0-/-/313eval-only
Haitian_Creole-AdolpheCC BY-SA 4.0CC BY-SA 4.02605/265/444go
Haitian_Creole-AutogrammCC BY-SA 4.0CC BY-SA 4.0-/-/144eval-only
Hausa-EasternAutogrammCC BY-SA 4.0CC BY-SA 4.0-/-/335eval-only
Hausa-NorthernAutogrammCC BY-SA 4.0CC BY-SA 4.0-/-/1305eval-only
Hausa-SouthernAutogrammCC BY-SA 4.0CC BY-SA 4.0-/-/1927eval-only
Hausa-WesternAutogrammCC BY-SA 4.0CC BY-SA 4.0-/-/775eval-only
Hebrew-HTBCC BY-NC-SA 4.0CC BY-NC-SA5168/484/491no-go
Hebrew-IAHLTknessetCC BY-SA 4.0CC BY-SA 4.02362/253/268go
Hebrew-IAHLTwikiCC BY-SA 4.0CC BY-SA 4.04298/348/393go
Hebrew-PostRabCC BY-SA 4.0CC BY-SA 4.0-/-/296eval-only
Highland_Puebla_Nahuatl-ITMLCC BY-SA 4.0CC BY-SA 4.0-/-/1260eval-only
Hindi-HDTBCC BY-NC-SA 4.0CC BY-NC-SA13306/1659/1684no-go
Hindi-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Hittite-HitTBCC BY-SA 4.0CC BY-SA 4.0-/-/136eval-only
Hungarian-SzegedCC BY-NC-SA 3.0CC BY-NC-SA910/441/449no-go
Icelandic-GCCC BY-SA 4.0CC BY-SA 4.03960/500/540go
Icelandic-IcePaHCCC BY-SA 4.0CC BY-SA 4.034007/4865/5157go
Icelandic-ModernCC BY-SA 4.0CC BY-SA 4.02703/394/438go
Icelandic-PUDCC BY-SA 4.0CC BY-SA 4.0-/-/1000eval-only
Ika-ChibErgISCC BY-SA 4.0CC BY-SA 4.0-/-/628eval-only
Indonesian-CSUICC BY-SA 4.0CC BY-SA 4.0656/-/374go
Indonesian-GSDCC BY-SA 4.0CC BY-SA 4.04482/559/557go
Indonesian-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Irish-CadhanCC BY-SA 4.0CC BY-SA 4.0-/-/193eval-only
Irish-IDTCC BY-SA 3.0own text4005/451/454go
Irish-TwittIrishCC BY-SA 4.0CC BY-SA 4.0866/864/866no-go
Italian-ISDTCC BY-NC-SA 3.0own text13121/564/482no-go
Italian-KIParlaForestCC BY-NC-SA 4.0CC BY-NC-SA-/-/2221no-go
Italian-MarkITCC BY 4.0CC BY 4.0611/341/340go
Italian-OldCC BY-SA 4.0CC BY-SA 4.02774/308/337go
Italian-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Italian-ParTUTCC BY-NC-SA 4.0own text1781/156/153no-go
Italian-ParlaMintCC BY-SA 4.0CC BY-SA 4.0326/-/375go
Italian-PoSTWITACC BY-NC-SA 4.0CC BY-NC-SA5368/670/674no-go
Italian-TWITTIROCC BY-SA 4.0CC BY-SA 4.01138/144/142no-go
Italian-VITCC BY-NC-SA 3.0CC BY-NC-SA8277/743/1067no-go
Italian-ValicoCC BY-SA 4.0CC BY-SA 4.0-/-/398eval-only
Japanese-BCCWJCC BY-NC-SA 4.0own text40801/8427/7881no-go
Japanese-BCCWJLUWCC BY-NC-SA 4.0own text40801/8427/7881no-go
Japanese-GSDCC BY-SA 4.0CC BY-SA 4.07050/507/543go
Japanese-GSDLUWCC BY-SA 4.0CC BY-SA 4.07050/507/543go
Japanese-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Japanese-PUDLUWCC BY-SA 3.0CC BY-SA 4.0-/-/1000eval-only
Javanese-CSUICC BY-SA 4.0CC BY-SA 4.0-/-/1000eval-only
Kaapor-TuDeTCC BY-SA 4.0CC BY-SA 4.0-/-/83eval-only
Kadiweu-UnicampCC BY-NC-SA 4.0CC BY-NC-SA-/-/71no-go
Kangri-KDTBCC BY-SA 4.0CC BY-SA 4.0-/-/288eval-only
Karelian-KKPPCC BY-SA 4.0CC BY-SA 4.0-/-/228eval-only
Karo-TuDeTCC BY-SA 4.0CC BY-SA 4.0-/-/674eval-only
Kazakh-KTBCC BY-SA 4.0CC BY-SA 4.031/-/1047go
Khoekhoe-KDTCC BY-NC-SA 4.0CC BY-SA 4.02002/232/1355no-go (conflict)
Kiche-IUCC BY-SA 4.0CC BY-SA 4.0-/-/1435eval-only
Komi_Permyak-UHCC BY-SA 4.0CC BY-SA 4.034/-/106go
Komi_Zyrian-IKDPCC BY-SA 4.0CC BY-SA 4.0-/-/214eval-only
Komi_Zyrian-LatticeCC BY-SA 4.0CC BY-SA 4.020/-/653go
Korean-GSDCC BY-SA 4.0CC BY-SA 4.04400/950/989go
Korean-KSLCC BY-SA 4.0CC BY-SA 4.014076/1480/1813go
Korean-KaistCC BY-SA 4.0CC BY-SA 4.023010/2066/2287go
Korean-LittlePrinceCC BY-SA 4.0CC BY-SA 4.0-/-/1551eval-only
Korean-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Kyrgyz-KTMUCC BY-SA 4.0CC BY-SA 4.01308/-/1222go
Kyrgyz-TueCLCC BY-SA 4.0CC BY-SA 4.0-/-/173eval-only
Latgalian-CairoCC BY-SA 4.0CC BY-SA 4.0-/-/20eval-only
Latin-CIRCSECC BY-SA 4.0CC BY-SA 4.0918/161/893go
Latin-ITTBCC BY-NC-SA 3.0own text22775/2101/2101no-go
Latin-LLCTCC BY-SA 4.0CC BY-SA 4.07289/850/884go
Latin-PROIELCC BY-NC-SA 3.0own text16196/1233/1260no-go
Latin-PerseusCC BY-NC-SA 2.5own text1334/-/939no-go
Latin-UDanteCC BY-NC-SA 3.0CC BY-SA 4.0926/376/421no-go (conflict)
Latvian-CairoCC BY-SA 4.0CC BY-SA 4.0-/-/20eval-only
Latvian-LVTBCC BY-SA 4.0CC BY-SA 4.015059/2109/2412go
Ligurian-GLTC-UDA 1.0C-UDA 1.020/-/296go
Lithuanian-ALKSNISCC BY-SA 4.0CC BY-SA 4.02341/617/684go
Lithuanian-HSECC BY-SA 4.0CC BY-SA 4.0153/55/55go
Livvi-KKPPCC BY-SA 4.0CC BY-SA 4.019/-/106go
Low_Saxon-LSDCCC BY-SA 4.0CC BY-SA 4.0500/-/500go
Luxembourgish-LuxBankCC BY-SA 4.0CC BY-SA 4.0-/-/20eval-only
Macedonian-MTBCC BY-SA 4.0CC BY-SA 4.0-/-/155eval-only
Madi-JarawaraCC BY-SA 4.0CC BY-SA 4.0-/-/20eval-only
Maghrebi_Arabic_French-ArabiziCC BY-SA 4.0CC BY-SA 4.01003/139/145no-go
Makurap-TuDeTCC BY-SA 4.0CC BY-SA 4.0-/-/37eval-only
Malayalam-UFALCC BY-SA 4.0CC BY-SA 4.0-/-/218eval-only
Maltese-MUDTCC BY-SA 4.0CC BY-SA 4.01123/433/518go
Manx-CadhanCC BY-SA 4.0CC BY-SA 4.01172/-/1164no-go
Marathi-CMUPANCC BY-SA 4.0CC BY-SA 4.07616/987/1003go
Marathi-UFALCC BY-SA 4.0CC BY-SA 4.0373/46/47go
Mbya_Guarani-ThomasCC BY-NC-SA 4.0CC BY-SA 4.0-/-/98no-go (conflict)
Middle_Armenian-ArmTDPCC BY-SA 4.0CC BY-SA 4.0-/-/27eval-only
Middle_French-ALTMCC BY-SA 4.0CC BY-SA 4.0-/-/217eval-only
Middle_French-PROFITEROLECC BY-NC-SA 4.0CC BY-SA 4.04496/569/906no-go (conflict)
Moksha-JRCC BY-SA 4.0CC BY-SA 4.022/-/468go
Munduruku-TuDeTCC BY-SA 4.0CC BY-SA 4.0-/-/158eval-only
Naga-SuansuCC BY-SA 4.0CC BY-SA 4.020/-/564no-go
Naija-NSCCC BY-SA 4.0CC BY-SA 4.07279/990/972go
Neapolitan-RBCC BY-SA 4.0CC BY-SA 4.0-/-/20eval-only
Nenets-TundraCC BY-SA 4.0CC BY-SA 4.0-/-/170eval-only
Nepali-BKCC BY-SA 4.0CC BY-SA 4.0-/-/69eval-only
Nheengatu-CompLinCC BY-NC-SA 4.0CC BY-NC-SA1796/-/1043no-go
North_Sami-GiellaCC BY-SA 4.0CC BY-SA 4.02257/-/865go
Northern_Kurdish-KurmanjiCC BY-SA 4.0CC BY-SA 4.020/-/734go
Northwest_Gbaya-AutogrammCC BY-SA 4.0CC BY-SA 4.0-/-/403eval-only
Norwegian-BokmaalCC BY-SA 4.0CC BY-SA 4.015696/2409/1939go
Norwegian-NynorskCC BY-SA 4.0CC BY-SA 4.014174/1890/1511go
Occitan-TTBCC BY-NC-SA 4.0CC BY-SA 4.0830/79/613no-go (conflict)
Odia-ODTBCC BY-SA 4.0CC BY-SA 4.0-/-/456eval-only
Old_Church_Slavonic-PROIELCC BY-NC-SA 4.0CC BY-NC-SA18327/2205/2096no-go
Old_East_Slavic-BirchbarkCC BY-SA 4.0CC BY-SA 4.01113/1062/1009go
Old_East_Slavic-RNCCC BY-SA 4.0CC BY-SA 4.03778/1363/906go
Old_East_Slavic-RuthenianCC BY-SA 4.0CC BY-SA 4.04120/855/390go
Old_East_Slavic-TOROTCC BY-NC-SA 4.0CC BY-NC-SA20480/3061/2955no-go
Old_English-CairoCC BY-SA 4.0CC BY-SA 4.0-/-/20eval-only
Old_French-ALTMCC BY-SA 4.0CC BY-SA 4.0-/-/553eval-only
Old_French-PROFITEROLECC BY-NC-SA 3.0CC BY-SA 4.015955/2143/2252no-go (conflict)
Old_Georgian-GLCCC BY-SA 4.0CC BY-SA 4.0-/-/151eval-only
Old_Irish-DipSGGCC BY-NC-SA 4.0CC BY-NC-SA-/-/64no-go
Old_Irish-DipWBGCC BY-SA 4.0CC BY-SA 4.0-/-/34eval-only
Old_Occitan-CorAGCC BY-SA 4.0CC BY-SA 4.01092/118/276go
Old_Turkish-ClausalCC0 1.0CC0-/-/20eval-only
Ottoman_Turkish-BOUNCC BY-SA 4.0CC BY-SA 4.0114/-/400go
Ottoman_Turkish-DUDUCC BY-SA 4.0CC BY-SA 4.01117/121/1008go
Ottoman_Turkish-TueCLCC BY-SA 4.0CC BY-SA 4.0-/-/148eval-only
Pashto-PrinceCC BY-SA 4.0CC BY-SA 4.0-/-/64eval-only
Pashto-SikaramCC BY-SA 4.0CC BY-SA 4.0-/-/200eval-only
Paumari-TueCLCC BY-SA 4.0CC BY-SA 4.0-/-/101eval-only
Persian-PerDTCC BY-SA 4.0CC BY-SA 4.026196/1456/1455go
Persian-SerajiCC BY-SA 4.0CC BY-SA 4.04798/599/600go
Pesh-ChibErgISCC BY-SA 4.0CC BY-SA 4.0-/-/524eval-only
Phrygian-KULCC BY-SA 4.0CC BY-SA 4.0-/-/203eval-only
Polish-LFGGNU GPL 3.0GPL13774/1745/1727no-go
Polish-MPDTCC BY-SA 4.0CC BY-SA 4.01433/162/423go
Polish-PDBCC BY-NC-SA 4.0own text17722/2215/2215no-go
Polish-PUDCC BY-SA 4.0CC BY-SA 4.0-/-/1000eval-only
Pomak-PhilotisCC BY-NC-SA 3.0own text980/635/635no-go
Portuguese-BosqueCC BY-SA 4.0CC BY-SA 4.07018/1172/1167go
Portuguese-CINTILCC BY-NC-ND 4.0CC BY-NC-ND30720/3840/3840no-go
Portuguese-DANTEStocksCC BY 4.0CC BY 4.03040/501/501no-go
Portuguese-GSDCC BY-SA 4.0CC BY-SA 4.09616/1204/1200go
Portuguese-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Portuguese-PetroGoldCC BY-SA 4.0CC BY-SA 4.07170/737/1039go
Portuguese-PorttinariCC BY 4.0CC BY 4.05893/842/1683go
Punjabi-CSCC BY-SA 4.0CC BY-SA 4.073/21/19go
Punjabi-RangCC BY-SA 4.0CC BY-SA 4.081/30/26go
Romanian-ArTCC BY-SA 4.0CC BY-SA 4.0-/-/50eval-only
Romanian-MolDoRoCC BY-SA 4.0CC BY-SA 4.0-/-/30eval-only
Romanian-NonstandardCC BY-SA 4.0CC BY-SA 4.024121/1052/1052no-go
Romanian-RRTCC BY-SA 4.0CC BY-SA 4.08043/752/729go
Romanian-SiMoNERoCC BY-SA 4.0CC BY-SA 4.03747/443/491go
Romanian-TueCLCC BY-SA 4.0CC BY-SA 4.0-/-/210no-go
Russian-GSDCC BY-SA 4.0CC BY-SA 4.03850/579/601go
Russian-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Russian-PoetryCC BY-SA 4.0CC BY-SA 4.03568/789/728go
Russian-SynTagRusCC BY-NC-SA 4.0CC BY-NC-SA69631/8906/8800no-go
Russian-TaigaCC BY-SA 4.0CC BY-SA 4.0119490/1260/1217no-go
Ruuli-RDTCC BY-NC-SA 4.0CC BY-SA 4.0-/-/1234no-go (conflict)
Sanskrit-UFALCC BY-SA 4.0CC BY-SA 4.0-/-/230eval-only
Sanskrit-VedicCC BY-SA 4.0CC BY-SA 4.021477/2996/2709go
Scottish_Gaelic-ARCOSGCC BY-SA 4.0CC BY-SA 4.03544/656/548go
Serbian-SETCC BY-SA 4.0CC BY-SA 4.03328/536/520go
Shanghainese-ShUDCC BY-SA 4.0CC BY-SA 4.0786/98/99no-go
Sicilian-STBCC BY-SA 4.0CC BY-SA 4.0-/-/505eval-only
Sindhi-IsraCC BY-SA 4.0CC BY-SA 4.04096/773/887go
Sinhala-AppuwaCC BY-SA 4.0CC BY-SA 4.0-/-/69eval-only
Sinhala-STBCC BY-SA 4.0CC BY-SA 4.0-/-/100eval-only
Skolt_Sami-GiellagasCC BY-SA 4.0CC BY-SA 4.020/-/241go
Slovak-SNKCC BY-SA 4.0CC BY-SA 4.08483/1060/1061go
Slovenian-SSJCC BY-SA 4.0CC BY-SA 4.010903/1250/1282go
Slovenian-SSTCC BY-SA 4.0own text5094/595/432go
South_Levantine_Arabic-MADARCC BY-SA 4.0CC BY-SA 4.0-/-/100no-go
Southern_Kurdish-GarrusiCC BY-SA 4.0CC BY-SA 4.0152/49/20go
Spanish-AnCoraCC BY 4.0CC BY 4.014287/1654/1721go
Spanish-COSERCC BY-SA 4.0CC BY-SA 4.0-/-/539eval-only
Spanish-GSDCC BY-SA 4.0CC BY-SA 4.014186/1400/427go
Spanish-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Spanish_Sign_Language-LSECC BY-SA 4.0CC BY-SA 4.0-/-/488eval-only
Swedish-LinESCC BY-NC-SA 4.0own text3457/1118/1121no-go
Swedish-OldCC BY-SA 4.0CC BY-SA 4.0-/-/40eval-only
Swedish-PUDCC BY-SA 4.0CC BY-SA 4.0-/-/1000eval-only
Swedish-SweLLCC BY-SA 4.0CC BY-SA 4.0-/-/643eval-only
Swedish-TalbankenCC BY-SA 4.0own text4315/504/1219go
Swedish_Sign_Language-SSLCCC BY-SA 4.0CC BY-SA 4.0-/-/203eval-only
Tagalog-TRGCC BY-SA 4.0CC BY-SA 4.0-/-/128eval-only
Tagalog-UgnayanCC BY-NC-SA 4.0CC BY-NC-SA-/-/94no-go
Tamil-MWTTCC BY-SA 4.0CC BY-SA 4.0-/-/534eval-only
Tamil-TTBCC BY-NC-SA 3.0own text400/80/120no-go
Tatar-NMCTTCC BY-SA 4.0CC BY-SA 4.0-/-/148eval-only
Teko-TuDeTCC BY-SA 4.0CC BY-SA 4.0-/-/913eval-only
Telugu-MTGCC BY-SA 4.0CC BY-SA 4.01051/131/146go
Telugu_English-TECTCC BY-SA 4.0CC BY-SA 4.061/-/36go
Thai-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Thai-TUDCC BY-SA 4.0CC BY-SA 4.02902/362/363go
Tswana-PopapoleloCC BY-SA 4.0CC BY-SA 4.0-/-/20eval-only
Tupinamba-TuDeTCC BY-SA 4.0CC BY-SA 4.0-/-/581eval-only
Turkish-AtisCC BY-SA 4.0CC BY-SA 4.04126/572/586go
Turkish-BOUNCC BY-SA 4.0CC BY-SA 4.07803/979/979go
Turkish-FrameNetCC BY-SA 4.0CC BY-SA 4.02288/205/205go
Turkish-GBCC BY-SA 4.0CC BY-SA 4.0-/-/2880eval-only
Turkish-IMSTCC BY-NC-SA 4.0own text3435/1100/1100no-go
Turkish-KenetCC BY-SA 4.0CC BY-SA 4.015398/1646/1643go
Turkish-PUDCC BY-SA 3.0CC BY-SA 3.0-/-/1000eval-only
Turkish-PennCC BY-SA 4.0CC BY-SA 4.014849/622/924no-go
Turkish-TourismCC BY-SA 4.0CC BY-SA 4.015473/2166/2191go
Turkish-TueCLCC BY-SA 4.0CC BY-SA 4.0-/-/148eval-only
Turkish_English-BUTRCC BY-SA 4.0CC BY-SA 4.0-/-/58eval-only
Turkish_German-SAGTCC BY-NC-SA 4.0CC BY-SA 4.0578/801/805no-go (conflict)
Ukrainian-IUCC BY-NC-SA 4.0CC BY-NC-SA5521/673/898no-go
Ukrainian-ParlaMintCC BY-SA 4.0CC BY-SA 4.05611/739/792go
Umbrian-IKUVINACC BY-SA 4.0CC BY-SA 4.0-/-/202eval-only
Upper_Sorbian-UFALCC BY-SA 4.0CC BY-SA 4.0-/-/644eval-only
Urdu-UDTBCC BY-NC-SA 4.0CC BY-NC-SA4043/552/535no-go
Uyghur-UDTCC BY-SA 4.0CC BY-SA 4.01656/900/900go
Uzbek-TueCLCC BY-SA 4.0CC BY-SA 4.0-/-/148eval-only
Uzbek-UTCC BY-SA 4.0CC BY-SA 4.0-/-/500eval-only
Uzbek-UzUDTCC BY-SA 4.0CC BY-SA 4.0483/-/201go
Veps-VWTCC BY-SA 4.0CC BY-SA 4.0-/-/103eval-only
Vietnamese-TueCLCC BY-SA 4.0CC BY-SA 4.0-/-/100eval-only
Vietnamese-VTBCC BY-SA 4.0CC BY-SA 4.01400/1123/800go
Warlpiri-UFALCC BY-SA 4.0CC BY-SA 4.0-/-/55eval-only
Welsh-CCGCC BY-SA 4.0CC BY-SA 4.01355/409/953go
Western_Armenian-ArmTDPCC BY-SA 4.0CC BY-SA 4.05274/693/677go
Western_Sierra_Puebla_Nahuatl-MesoTreeCC BY-SA 4.0CC BY-SA 4.0-/-/3024eval-only
Wolof-WTBCC BY-SA 4.0CC BY-SA 4.01188/449/470go
Xavante-XDTCC BY-SA 4.0CC BY-SA 4.0-/-/248eval-only
Xibe-XDTCC BY-NC-SA 3.0CC BY-SA 4.0-/-/810no-go (conflict)
Yakut-YKTDTCC BY-SA 4.0CC BY-SA 4.0-/-/299eval-only
Yiddish-YiTBCC BY-SA 4.0CC BY-SA 4.01877/157/1079go
Yoruba-YTBCC BY-SA 4.0CC BY-SA 4.0-/-/317eval-only
Yupik-SLICC BY-SA 4.0CC BY-SA 4.0-/-/309eval-only
Zaar-AutogrammCC BY-SA 4.0CC BY-SA 4.0978/-/1127go
Zazaki-ZSDCC BY-SA 4.0CC BY-SA 4.0138/30/32go

Rulings and quotes

no-go on the text source or the sources of terms (licence line alone would pass):

  • Arabic-NYUAD: README: "Due to LDC licensing restrictions, the annotations are released without the data." (LDC text, not distributed)
  • English-GUMReddit: README: "This repository only contains annotations, without the underlying textual data from Reddit" (Reddit text; ToS-restricted)
  • German-HDT: README: "Heise gave permission to distribute the text for academic use" (research-only text; ruled)
  • Irish-TwittIrish: README: "A Universal Dependencies treebank of 2596 tweets in modern Irish." (platform text)
  • Italian-TWITTIRO: README: "a collection of ironic Italian tweets" (platform terms on the text; ruled)
  • Portuguese-DANTEStocks: tweets (platform terms on the text; ruled)
  • Romanian-TueCL: README: "It contains 210 annotated tweets selected from CoRoSeOf" (platform text)
  • Shanghainese-ShUD: README: the source corpus is "licensed under Creative Commons BY-NC-ND 4.0", with "additional permission for derivative research" (research-only)
  • South_Levantine_Arabic-MADAR: README: sentences come from the MADAR parallel corpus, built on BTEC; the MADAR corpus "is made available to the research community under a non-commercial license" (NYU Abu Dhabi CAMeL Lab resources page)
  • Turkish-Penn: sentences translated from the LDC Penn Treebank (ruled)

ruled no-go from unclear (not fetched; the quotes behind the rulings):

  • Ancient_Hebrew-PTNK (CC BY-NC 4.0; 4417 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC 4.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Belarusian-HSE (CC BY-SA 4.0; 22853 train sentences): ruled no-go (terms-restricted text): README: genre list includes "5) social media: messages from the Telegram channels"; annotations CC BY-SA 4.0, no statement about the channel text
  • Chinese-PatentChar (CC BY-NC-SA 3.0; 0 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 3.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Chintang-CTNTB (CC BY-NC-SA 4.0; 0 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Estonian-EWT (CC BY-NC-SA 4.0; 5444 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Finnish-OOD (CC BY-SA 4.0; 0 train sentences): ruled no-go (terms-restricted text): README: texts from "nursing narratives (hospital patient records), discussion forums, tweets, general web crawls and poetry"; "The underlying texts come from various sources collected from the Internet. These may hold different copyright owners."
  • Greek-GLCII (CC BY-NC-SA 4.0; 0 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Khoekhoe-KDT (CC BY-NC-SA 4.0; 2002 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Latin-UDante (CC BY-NC-SA 3.0; 926 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 3.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Maghrebi_Arabic_French-Arabizi (CC BY-SA 4.0; 1003 train sentences): ruled no-go (terms-restricted text): README: sources include "Algerian newspaper’s web forums"; no statement about the forum text
  • Manx-Cadhan (CC BY-SA 4.0; 1172 train sentences): ruled no-go (terms-restricted text): README: sentences "came from a large web-crawled corpus of Manx"; genres include blog and social
  • Mbya_Guarani-Thomas (CC BY-NC-SA 4.0; 0 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Middle_French-PROFITEROLE (CC BY-NC-SA 4.0; 4496 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Naga-Suansu (CC BY-SA 4.0; 20 train sentences): ruled no-go (terms-restricted text): README: test set includes "film_Bridge: Begining of the subtitles from Bridge of Spies (2015)" (a commercial film’s subtitles); the rest is grammar examples
  • Occitan-TTB (CC BY-NC-SA 4.0; 830 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Old_French-PROFITEROLE (CC BY-NC-SA 3.0; 15955 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 3.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Polish-LFG (GNU GPL 3.0; 13774 train sentences): ruled no-go (GNU GPL 3.0 on a treebank): licence line and LICENSE.txt: GNU GPL 3.0 on a treebank (copyleft terms for data, and for what is trained on it, are untested); 3% of the text is forums and chatrooms
  • Romanian-Nonstandard (CC BY-SA 4.0; 24121 train sentences): ruled no-go (terms-restricted text): README: nonstandard genres "Old Romanian, Chat, Folklore"; the chat source is not stated
  • Russian-Taiga (CC BY-SA 4.0; 119490 train sentences): ruled no-go (terms-restricted text): README: "source: vk.com, instagram, facebook, twitter, youtube comments, questions & answers (otvet.mail.ru), reviews (reviews.yandex.ru)"; annotations CC BY-SA 4.0, no statement about the platform text
  • Ruuli-RDT (CC BY-NC-SA 4.0; 0 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Turkish_German-SAGT (CC BY-NC-SA 4.0; 578 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 4.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"
  • Xibe-XDT (CC BY-NC-SA 3.0; 0 train sentences): ruled no-go (README statement over a template LICENSE.txt): README licence line says CC BY-NC-SA 3.0, but LICENSE.txt says: "The treebank is licensed under the Creative Commons License Attribution-ShareAlike 4.0 International. The complete"

go with a condition or note:

  • Bavarian-MaiBaam: Wikipedia (CC BY-SA) and Tatoeba sentences; per-sentence source URLs given
  • Cantonese-HK: film subtitles by students of the authors' university and legislative proceedings
  • Chinese-HK: film subtitles by students of the authors' university and legislative proceedings
  • Classical_Chinese-Kyoto: README licence line says PD; LICENSE.txt says CC BY-SA 4.0; either passes
  • Czech-CAC: built on a corpus the LDC distributes; the UD release is stated to be "made freely available under the CreativeCommons license"
  • Dutch-LassySmall: LICENSE.txt states "distributed under the Creative Commons Attribution-ShareAlike 4.0 International license (CC BY-SA 4.0)"; its informal-reference links point at the by-nc-sa URL, which is read as a typo
  • English-EWT: built on the LDC English Web Treebank; the UD release is CC BY-SA 4.0 (kept as in the English units)
  • Finnish-FTB: LICENSE.txt offers LGPLv3+ or, alternatively, "CC BY 4.0 ... even commercially"; the GPL text it appends has the word "noncommercially" in an unrelated clause
  • Indonesian-GSD: same as Japanese-GSD
  • Japanese-GSD: Google: "Google gave permission to drop the NC restriction from the license"
  • Japanese-GSDLUW: same as Japanese-GSD
  • Korean-GSD: same as Japanese-GSD
  • Ligurian-GLT: Computational Use of Data Agreement 1.0 (C-UDA): "You agree that you will use the Data solely for Computational Use"; training is Computational Use and "The C-UDA does not impose any restriction with respect to the use, modification, or distribution of Results". Redistributing the data would bind recipients; we do not redistribute it

Named-entity data beyond the nine languages

UNER v1 (github.com/UniversalNER, listing read 2026-11-06) holds 31 datasets. Each labels the sentences of one UD treebank, so a UNER set is usable only where that treebank is. Verdicts:

UNER repositoryUD treebankUD verdictUNER set
UNER_Cebuano-GJACebuano-GJAeval-onlyeval-only
UNER_Chinese-GSDChinese-GSDgogo (train, dev, eval; SA lineage)
UNER_Chinese-GSDSIMPChinese-GSDSimpgogo (train, dev, eval; SA lineage)
UNER_Chinese-PUDChinese-PUDeval-onlyeval-only
UNER_Croatian-SETCroatian-SETgogo (train, dev, eval; SA lineage)
UNER_Czech-PUDCzech-PUDeval-onlyeval-only
UNER_Danish-DDTDanish-DDTgogo (train, dev, eval; SA lineage)
UNER_English-EWTEnglish-EWTgogo (train, dev, eval; SA lineage)
UNER_English-PUDEnglish-PUDeval-onlyeval-only
UNER_German-PUDGerman-PUDeval-onlyeval-only
UNER_Greek-GDTGreek-GDTno-gono-go (its text is NC)
UNER_Hebrew-HTBHebrew-HTBno-gono-go (its text is NC)
UNER_Indonesian-CSUIIndonesian-CSUIgogo (train, dev, eval; SA lineage)
UNER_Indonesian-GSDIndonesian-GSDgogo (train, dev, eval; SA lineage)
UNER_Indonesian-PUDIndonesian-PUDeval-onlyeval-only
UNER_Japanese-PUDJapanese-PUDeval-onlyeval-only
UNER_Korean-PUDKorean-PUDeval-onlyeval-only
UNER_Maghrebi_Arabic_French-ArabiziMaghrebi_Arabic_French-Arabizino-gono-go (its text is NC)
UNER_Norwegian-NDTNorwegian-Bokmaalgogo (train, dev, eval; SA lineage)
UNER_Portuguese-BosquePortuguese-Bosquegogo (train, dev, eval; SA lineage)
UNER_Portuguese-PUDPortuguese-PUDeval-onlyeval-only
UNER_Romanian-LegalNERoRomanian-LegalNERonot in r2.18out (ruled 2026-11-07), unclear terms: the UNER README says "Initially, the LegalNERo dataset was made available under the license CC BY-NC-ND 4.0 ... The Zenodo version remains under that license. This UNER version of the work is provided under the license CC BY-SA 4.0"
UNER_Russian-PUDRussian-PUDeval-onlyeval-only
UNER_Serbian-SETSerbian-SETgogo (train, dev, eval; SA lineage)
UNER_Slovak-SNKSlovak-SNKgogo (train, dev, eval; SA lineage)
UNER_Slovenian-SSJSlovenian-SSJgogo (train, dev, eval; SA lineage)
UNER_Swedish-LinesSwedish-LinESno-gono-go (its text is NC)
UNER_Swedish-PUDSwedish-PUDeval-onlyeval-only
UNER_Swedish-TalbankenSwedish-Talbankengogo (train, dev, eval; SA lineage)
UNER_Tagalog-TRGTagalog-TRGeval-onlyeval-only
UNER_Tagalog-UgnayanTagalog-Ugnayanno-gono-go (its text is NC)

Languages with a usable UNER training set beyond the nine: Croatian, Danish, Indonesian (CSUI, GSD), Norwegian, Serbian, Slovak, Slovenian, Swedish (Talbanken); eval-only: Cebuano, Czech, Japanese, Korean, Russian, Swedish (PUD), Tagalog (TRG). UNER Chinese and Portuguese are the nine-language sets. Each UNER set was cut from an older UD commit, so its tokens must be checked against the r2.18 files before training (the English-EWT set is not aligned with r2.18; Portuguese-Bosque is). Hebrew, Greek and Swedish-LinES carry NC text; Tagalog-Ugnayan is NC-SA.

Other named-entity corpora checked at their cards (a card's licence is the dataset's, and the text source is read where the card states it):

CorpusLanguagesTerms (as stated)VerdictUse
UNER v1 repositories UniversalNER/UNER_* (Mayhew et al. 2024)see the UNER tablelabels CC BY-SA 4.0 (CC BY-SA 3.0 for PUD sets); a few repositories carry no LICENSE file and rely on the dataset card's "released under the terms of the Creative Commons Attribution-ShareAlike 4.0"go where the underlying UD treebank is go; the text keeps the treebank's own licencetrain and eval
WikiNER wp3 (Nothman et al. 2013)de en es fr it nl pl pt rufigshare record: CC BY 4.0; silver labels projected from Wikipedia links, text is Wikipedia (CC BY-SA)go (SA lineage)silver NER for es fr it nl pt (already fetched for fr es it nl); de en pl ru not fetched
DaNE alexandrainst/danedacard: cc-by-sa-4.0; text from Parole (the UD Danish-DDT text)go (SA lineage)Danish NER; the same sentences as UNER Danish-DDT
KPWr-NER clarin-pl/kpwr-nerplcard: "Creative Commons Attribution 3.0 Unported Licence"; "various sources, covering many domains and genres"go on the card's licence (text sources are not itemised on the card)Polish NER
hr500k classla/hr500khrcard: cc-by-sa-4.0; NER layer of the Croatian reference corpusgo (SA lineage)Croatian NER
RONEC community-datasets/ronecrocard: MIT; "sentences that are free of copyright" from SEETimes, Romanian Wikipedia and Common CrawlgoRomanian NER (15 classes)
SUCX 3.0 NER KBLab/sucx3_nersvcard: cc-by-4.0 (SUC 3.0, Språkbanken)goSwedish NER; the Swedish-Talbanken UNER set is the UD-aligned alternative
MasakhaNER 2.0 masakhane/masakhaner220 African languages (bm bbj ee fon ha ig rw lg luo mos ny pcm sn sw tn tw wo xh yo zu)card: afl-3.0; text from news outlets: "The data is sourced from newspaper source"out (ruled 2026-11-07), unclear terms: the annotations' licence is permissive, the news publishers' terms on the text are not statednone
MasakhaNER 1.0 masakhane/masakhaner10 African languagescard: license unknownout (ruled 2026-11-07), no stated termsnone
Hausa VOA NER UdS-LSV/hausa_voa_nerhacard: cc-by-4.0; "crawled from VOA Hausa news"out (ruled 2026-11-07), unclear terms: crawled news site; the site's terms are not stated on the cardnone
HiNER original cfilt/HiNER-originalhicard: cc-by-sa-4.0; "The dataset contains sentences from ILCI and other sources. ILCI dataset requires license from Indian Language Consortium due to which we do not distribute the ILCI portion of the data."out (ruled 2026-11-07), unclear terms: the remaining sources are not named on the card (would be the first Hindi NER candidate)none
KLUE-NER klue/kluekocard: cc-by-sa-4.0; the card's examples show news, review and other web textout (ruled 2026-11-07), unclear terms: the terms on those texts are not statednone
FiNER mpsilfve/finerficard: mit; the card is a blank template and names no text sourceout (ruled 2026-11-07), unclear terms: the text source is not statednone
Persian NER HaniehPoostchi/persian_nerfacard: cc-by-4.0out (ruled 2026-11-07), unclear terms: the card does not name the text sourcenone
Catalan NER Ugiat/ner-catcacard: apache-2.0; television transcriptionsout (ruled 2026-11-07), unclear terms: rights in the transcribed programmes are not statednone
fiNERweb whoisjones/fiNERweb91 languagescard: mit; "annotated text in multiple languages"; the card does not name the label generatorout (ruled 2026-11-07), unclear terms: the label generator (and so the labels' terms) is not statednone
Swedish NER corpus klintan/swedish_ner_corpussvcard: cc-by-4.0; "news from Swedish newspapers' websites"out (ruled 2026-11-07), unclear terms: newspaper text, terms not statednone
Europeana Newspapers community-datasets/euronewsde fr nlcard: cc0-1.0; historical newspapersgo (public-domain scans, CC0 card)silver-quality historical NER; not chosen (old orthography)
WikiANN / PAN-Xmany languagescard: license: unknownno-go [ruled]-
WikiNEuRal, MultiNERD (Babelscape)9 languagescards: cc-by-nc-sa-4.0no-go (NC)-
Naamapadam (ai4bharat)11 Indic languagestext from Samanantar, CC BY-NC 4.0no-go [ruled]-
MultiCoNER v1/v2several languagescards: cc-by-4.0; fine-grained scheme, web and search-query textnot examined (scheme does not map onto PER/ORG/LOC)-

NER gaps. Of the 84 train+eval languages, those with no allowed NER training data at all: Afrikaans, Albanian, Ancient Greek, Armenian, Assamese, Bororo, Buryat, Catalan, Central Kurdish, Classical Chinese, Coptic, Czech, Egyptian, Erzya, Faroese, Finnish, Galician, Georgian, Greek, Haitian Creole, Hebrew, Icelandic, Irish, Japanese, Kazakh, Komi Permyak, Komi Zyrian, Korean, Kyrgyz, Latin, Latvian, Ligurian, Lithuanian, Livvi, Low Saxon, Maltese, Marathi, Moksha, Naija, North Sami, Northern Kurdish, Old East Slavic, Old Occitan, Ottoman Turkish, Persian, Punjabi, Russian, Sanskrit, Scottish Gaelic, Sindhi, Skolt Sami, Southern Kurdish, Telugu, Telugu English, Thai, Ukrainian, Uyghur, Uzbek, Vietnamese, Welsh, Western Armenian, Wolof, Yiddish, Zaar, Zazaki. The nine languages are covered in the sections above (Hindi remains a gap). The base-size accurate tier has entity heads for the 19 languages with allowed entity training data. The other languages provide UD annotations only; a language without an entity head does not claim cross-lingual NER.