Distilled accurate tier: per-row results · onenlp docs

English (UD_English-EWT), gold input

Metric	Distilled tier	Fast tier	UDPipe 2
UPOS	94.56 [94.20, 94.90]	94.16 [93.79, 94.54]	97.61
XPOS	93.33 [92.93, 93.70]		97.13
UFeats	94.27 [93.93, 94.59]	95.15 [94.86, 95.47]	98.13
AllTags	90.51 [90.04, 90.93]		96.34
Lemmas	94.97 [94.64, 95.33]	96.11 [95.77, 96.44]	97.96
UAS	81.23 [80.40, 82.07]		94.09
LAS	77.33 [76.48, 78.20]	81.68 [80.82, 82.49]	92.36
CLAS	72.12 [71.11, 73.13]
MLAS	63.63 [62.52, 64.72]		86.29

English (UD_English-EWT), raw input

Metric	Distilled tier	Fast tier	Stanza 1.5.1	UDPipe 2	Trankit
Tokens	97.13 [96.83, 97.43]		99.17		98.48
Sentences	65.36 [63.39, 67.34]	76.15 [74.25, 78.08]	89.16	88.42	88.35
Words	98.68 [98.45, 98.90]		98.92	99.07	98.48
UPOS	93.71 [93.26, 94.11]	92.90 [92.42, 93.35]	96.20	96.75	95.95
XPOS	92.72 [92.27, 93.14]		95.75	96.27	95.71
UFeats	93.58 [93.19, 93.95]		96.39	97.21	96.26
AllTags	89.94 [89.43, 90.39]		94.64	95.51	94.62
Lemmas	94.14 [93.75, 94.55]	95.03 [94.61, 95.43]	96.63	97.13	96.84
UAS	76.95 [76.02, 77.90]		88.90	91.59	90.14
LAS	73.61 [72.66, 74.54]	77.76 [76.82, 78.70]	86.77	89.91	87.96
CLAS	68.17 [67.02, 69.30]		84.11		85.75
MLAS	60.63 [59.54, 61.80]	65.61 [64.46, 66.72]	80.27	83.87	81.02

German (UD_German-GSD), gold input

Metric	Distilled tier	Fast tier	UDPipe 2
UPOS	94.55 [94.15, 94.93]	94.56 [94.18, 94.94]	97.11
XPOS	94.11 [93.71, 94.49]		97.93
UFeats	80.50 [79.78, 81.16]	86.25 [85.60, 86.96]	91.53
AllTags	76.34 [75.53, 77.13]		89.21
Lemmas	92.55 [92.16, 92.92]	95.95 [95.67, 96.25]	97.37
UAS	78.02 [76.94, 78.96]		89.24
LAS	72.87 [71.79, 73.81]	78.25 [77.23, 79.26]	86.16
CLAS	65.24 [63.85, 66.47]
MLAS	43.66 [42.28, 44.84]		69.30

German (UD_German-GSD), raw input

Metric	Distilled tier	Fast tier	Stanza 1.5.1	UDPipe 2	Trankit
Tokens	97.40 [97.09, 97.69]		99.62		99.75
Sentences	78.22 [75.90, 80.83]		83.84	83.32	92.72
Words	97.06 [96.70, 97.39]		99.60	99.79	99.75
UPOS	91.75 [91.27, 92.23]	94.22 [93.83, 94.61]	95.61	96.87	95.04
XPOS	91.25 [90.75, 91.72]		97.36	97.71	97.57
UFeats	77.75 [77.00, 78.44]		89.78	91.17	91.51
AllTags	73.55 [72.75, 74.28]		87.19	88.82	86.86
Lemmas	89.50 [89.01, 90.00]		97.23	97.19	96.60
UAS	73.95 [72.91, 74.91]		85.80	87.44	88.73
LAS	69.03 [68.00, 70.01]	76.75 [75.74, 77.76]	81.80	84.36	84.77
CLAS	63.47 [62.19, 64.77]		77.08		80.78
MLAS	41.34 [40.09, 42.60]		62.81	67.63	64.76

French (UD_French-GSD), gold input

Metric	Distilled tier	Fast tier	UDPipe 2
UPOS	96.07 [95.61, 96.46]	96.77 [96.33, 97.19]	98.55
UFeats	94.38 [93.76, 94.92]	96.34 [95.89, 96.81]	98.30
Lemmas	95.19 [94.71, 95.61]	97.51 [97.16, 97.84]	98.85
UAS	83.49 [82.31, 84.73]		94.99
LAS	79.63 [78.37, 80.97]	86.69 [85.60, 87.81]	93.11
CLAS	71.21 [69.53, 72.85]
MLAS	64.08 [62.26, 65.75]		86.95

French (UD_French-GSD), raw input

Metric	Distilled tier	Fast tier	Stanza 1.5.1	UDPipe 2	Trankit
Tokens	99.88 [99.79, 99.96]		99.71		99.70
Sentences	92.65 [90.35, 94.87]		95.03	93.82	96.63
Words	99.48 [99.29, 99.65]		99.50	98.88	99.66
UPOS	95.56 [95.09, 95.97]	96.06 [95.60, 96.53]	97.63	97.43	97.85
UFeats	94.03 [93.41, 94.55]		97.74	97.15	97.16
Lemmas	94.54 [94.04, 95.03]		98.20	97.73	97.80
UAS	83.11 [81.88, 84.45]		93.27	93.26	94.00
LAS	79.17 [77.86, 80.50]	85.97 [84.73, 87.08]	91.28	91.21	92.34
CLAS	71.58 [69.86, 73.31]		87.44		88.66
MLAS	64.26 [62.40, 65.99]		84.45	85.02	84.76

Spanish (UD_Spanish-AnCora), gold input

Metric	Distilled tier	Fast tier	UDPipe 2
UPOS	97.34 [97.17, 97.49]	98.11 [97.98, 98.25]	99.09
XPOS	84.25 [83.80, 84.71]		96.12
UFeats	95.90 [95.73, 96.09]	97.71 [97.56, 97.86]	98.79
AllTags	83.20 [82.76, 83.64]		95.64
Lemmas	95.27 [95.07, 95.45]	98.84 [98.73, 98.95]	99.41
UAS	83.02 [82.46, 83.56]		94.01
LAS	79.36 [78.79, 79.94]	87.00 [86.50, 87.51]	92.26
CLAS	71.25 [70.52, 71.98]
MLAS	64.64 [63.89, 65.42]		87.03

Spanish (UD_Spanish-AnCora), raw input

Metric	Distilled tier	Fast tier	Stanza 1.5.1	UDPipe 2	Trankit
Tokens	99.84 [99.76, 99.90]		99.97		99.94
Sentences	95.61 [94.59, 96.55]		98.49	98.69	99.13
Words	99.83 [99.75, 99.89]		99.96	99.95	99.93
UPOS	97.24 [97.07, 97.40]	97.86 [97.71, 98.01]	98.96	99.05	99.02
XPOS	84.46 [84.02, 84.93]		96.10	96.08	98.94
UFeats	95.73 [95.53, 95.93]		98.54	98.74	98.80
AllTags	83.34 [82.90, 83.80]		95.65	95.61	98.27
Lemmas	95.28 [95.09, 95.50]		99.24	99.37	99.17
UAS	82.41 [81.83, 82.99]		93.09	93.81	94.11
LAS	78.74 [78.14, 79.35]	86.70 [86.15, 87.23]	91.30	92.07	92.41
CLAS	70.59 [69.87, 71.34]		87.80		89.66
MLAS	63.87 [63.10, 64.65]		85.49	86.86	87.60

Portuguese (UD_Portuguese-Bosque), gold input

Metric	Distilled tier	Fast tier	UDPipe 2
UPOS	95.10 [94.82, 95.38]	95.89 [95.62, 96.14]	98.09
UFeats	92.96 [92.62, 93.29]	94.51 [94.17, 94.80]	97.15
Lemmas	94.80 [94.52, 95.09]	97.30 [97.10, 97.51]	98.63
UAS	82.29 [81.62, 82.97]		93.31
LAS	77.78 [77.03, 78.52]	82.74 [82.07, 83.35]	90.93
CLAS	70.28 [69.38, 71.28]
MLAS	59.41 [58.45, 60.40]		81.55

Portuguese (UD_Portuguese-Bosque), raw input

Metric	Distilled tier	Fast tier	Stanza 1.5.1	UDPipe 2	Trankit
Tokens	99.86 [99.79, 99.92]		99.85		99.70
Sentences	89.57 [87.82, 91.21]		93.10	89.73	97.48
Words	99.26 [99.14, 99.38]		99.76	99.68	99.65
UPOS	94.91 [94.60, 95.23]	95.35 [95.05, 95.64]	97.45	97.77	97.27
UFeats	92.72 [92.35, 93.06]		96.44	96.89	96.50
Lemmas	94.31 [94.01, 94.61]		98.04	98.33	97.89
UAS	81.32 [80.58, 82.05]		90.59	92.16	92.76
LAS	77.41 [76.62, 78.16]	82.09 [81.38, 82.76]	87.75	89.84	90.25
CLAS	70.16 [69.22, 71.17]		82.66		86.96
MLAS	59.55 [58.52, 60.60]		77.07	80.52	80.03

Italian (UD_Italian-ParlaMint), gold input

Metric	Distilled tier	Fast tier	UDPipe 2
UPOS	92.14 [91.57, 92.72] (it_markit-ud-test)	94.44 [93.92, 94.96]	99.19
UPOS	94.71 [94.22, 95.19] (it_parlamint-ud-test)		99.19
XPOS	93.38 [92.87, 93.87] (it_markit-ud-test)		98.55
XPOS	94.35 [93.83, 94.87] (it_parlamint-ud-test)		98.55
UFeats	88.71 [87.90, 89.51] (it_markit-ud-test)	89.52 [88.85, 90.16]	98.49
UFeats	87.36 [86.54, 88.11] (it_parlamint-ud-test)		98.49
AllTags	84.34 [83.40, 85.26] (it_markit-ud-test)		97.61
AllTags	84.32 [83.48, 85.20] (it_parlamint-ud-test)		97.61
Lemmas	80.25 [79.27, 81.08] (it_markit-ud-test)	95.18 [94.73, 95.63]	99.20
Lemmas	89.49 [88.80, 90.14] (it_parlamint-ud-test)		99.20
UAS	71.17 [69.80, 72.37] (it_markit-ud-test)		93.24
UAS	76.09 [74.78, 77.45] (it_parlamint-ud-test)		93.24
LAS	64.54 [63.15, 65.74] (it_markit-ud-test)	72.57 [71.24, 74.06]	91.13
LAS	71.46 [70.08, 72.85] (it_parlamint-ud-test)		91.13
CLAS	53.59 [51.96, 55.19] (it_markit-ud-test)
CLAS	60.50 [58.78, 62.22] (it_parlamint-ud-test)
MLAS	39.60 [38.08, 41.14] (it_markit-ud-test)		85.52
MLAS	44.30 [42.65, 46.10] (it_parlamint-ud-test)		85.52

Italian (UD_Italian-ParlaMint), raw input

Metric	Distilled tier	Fast tier	Stanza 1.5.1	UDPipe 2
Tokens	99.93 [99.86, 99.98] (it_markit-ud-test)		99.59
Tokens	99.86 [99.76, 99.96] (it_parlamint-ud-test)		99.59
Sentences	90.41 [87.56, 93.19] (it_markit-ud-test)		95.83	94.12
Sentences	83.62 [79.88, 87.08] (it_parlamint-ud-test)		95.83	94.12
Words	99.73 [99.58, 99.86] (it_markit-ud-test)		99.01	99.42
Words	99.67 [99.52, 99.80] (it_parlamint-ud-test)		99.01	99.42
UPOS	93.43 [92.89, 93.91] (it_markit-ud-test)	94.01 [93.45, 94.51]	96.83	98.58
UPOS	94.73 [94.31, 95.16] (it_parlamint-ud-test)		96.83	98.58
XPOS	94.23 [93.75, 94.70] (it_markit-ud-test)		95.96	97.99
XPOS	94.75 [94.27, 95.25] (it_parlamint-ud-test)		95.96	97.99
UFeats	90.24 [89.54, 90.94] (it_markit-ud-test)		95.28	97.95
UFeats	88.14 [87.47, 88.83] (it_parlamint-ud-test)		95.28	97.95
AllTags	86.39 [85.62, 87.17] (it_markit-ud-test)		93.74	97.09
AllTags	85.14 [84.42, 85.94] (it_parlamint-ud-test)		93.74	97.09
Lemmas	81.77 [80.86, 82.58] (it_markit-ud-test)		95.64	98.69
Lemmas	90.48 [89.82, 91.11] (it_parlamint-ud-test)		95.64	98.69
UAS	74.20 [72.80, 75.50] (it_markit-ud-test)		85.19	91.79
UAS	74.63 [73.21, 76.04] (it_parlamint-ud-test)		85.19	91.79
LAS	68.64 [67.22, 69.91] (it_markit-ud-test)	72.77 [71.46, 74.16]	81.45	89.72
LAS	70.66 [69.25, 72.02] (it_parlamint-ud-test)		81.45	89.72
CLAS	59.56 [57.78, 61.13] (it_markit-ud-test)		74.76
CLAS	59.25 [57.31, 61.17] (it_parlamint-ud-test)		74.76
MLAS	45.47 [43.83, 47.16] (it_markit-ud-test)		68.88	83.94
MLAS	43.29 [41.49, 45.12] (it_parlamint-ud-test)		68.88	83.94

Dutch (UD_Dutch-Alpino), gold input

Metric	Distilled tier	Fast tier	UDPipe 2
UPOS	94.51 [93.84, 95.09]	93.83 [93.16, 94.49]	98.17
XPOS	91.45 [90.69, 92.15]		97.12
UFeats	93.62 [92.91, 94.22]	92.94 [92.24, 93.53]	97.75
AllTags	89.76 [88.97, 90.46]		96.73
Lemmas	87.76 [87.14, 88.41]	91.61 [90.99, 92.14]	96.20
UAS	78.13 [76.85, 79.38]		95.30
LAS	72.96 [71.59, 74.30]	80.28 [79.12, 81.51]	93.37
CLAS	64.11 [62.50, 65.76]
MLAS	54.34 [52.68, 56.13]		86.35

Dutch (UD_Dutch-Alpino), raw input

Metric	Distilled tier	Fast tier	Stanza 1.5.1	UDPipe 2	Trankit
Tokens	99.66 [99.46, 99.82]		99.87		99.22
Sentences	89.96 [87.08, 92.24]		90.08	91.16	89.88
Words	99.66 [99.46, 99.82]		99.87	99.78	99.22
UPOS	94.51 [93.95, 95.02]	93.09 [92.40, 93.77]	96.75	97.97	96.55
XPOS	91.06 [90.31, 91.79]		95.50	96.89	94.92
UFeats	93.36 [92.72, 93.95]		97.00	97.52	96.22
AllTags	89.60 [88.80, 90.32]		94.97	96.56	94.56
Lemmas	87.44 [86.77, 88.10]		95.33	95.99	96.23
UAS	78.33 [77.02, 79.60]		91.42	94.12	93.28
LAS	73.64 [72.28, 74.88]	79.48 [78.28, 80.78]	88.67	92.25	91.28
CLAS	65.33 [63.66, 66.86]		83.94		87.88
MLAS	55.76 [54.04, 57.43]		79.65	85.14	82.58

Turkish (UD_Turkish-BOUN), gold input

Metric	Distilled tier	Fast tier	UDPipe 2
UPOS	90.02 [89.50, 90.53]	88.97 [88.31, 89.58]	93.14
UFeats	79.95 [79.18, 80.72]	78.15 [77.40, 78.90]	83.03
Lemmas	78.58 [77.84, 79.34]	85.11 [84.38, 85.74]	93.62
UAS	66.63 [65.34, 67.91]		80.54
LAS	58.29 [57.07, 59.56]	62.80 [61.37, 64.19]	74.00
CLAS	54.17 [52.77, 55.54]
MLAS	37.91 [36.65, 39.17]		52.95

Turkish (UD_Turkish-BOUN), raw input

Metric	Distilled tier	Fast tier	Stanza 1.5.1	UDPipe 2
Tokens	98.03 [97.71, 98.33]		99.58
Sentences	74.99 [72.25, 77.87]		90.08	86.25
Words	96.55 [96.15, 96.92]		96.32	96.57
UPOS	87.01 [86.35, 87.66]	86.02 [85.28, 86.68]	89.92	90.01
UFeats	78.63 [77.87, 79.42]		81.66	81.08
Lemmas	77.22 [76.42, 77.96]		90.37	90.59
UAS	59.53 [58.08, 60.84]		71.53	73.16
LAS	52.31 [50.99, 53.62]	57.53 [56.08, 59.01]	65.17	67.27
CLAS	49.32 [47.89, 50.75]		63.79
MLAS	35.62 [34.29, 36.84]		48.49	49.26

Chinese (UD_Chinese-GSDSimp), gold input

Metric	Distilled tier	Fast tier	UDPipe 2
UPOS	85.56 [84.90, 86.24]	90.41 [89.70, 91.07]	95.73
XPOS	85.13 [84.47, 85.84]		95.97
UFeats	95.43 [95.03, 95.83]	98.38 [98.13, 98.59]	99.28
AllTags	81.86 [81.08, 82.64]		95.20
Lemmas	99.59 [99.46, 99.70]	99.87 [99.79, 99.94]	99.90
UAS	60.43 [59.02, 61.82]		86.76
LAS	54.05 [52.70, 55.43]	68.76 [67.12, 70.32]	83.60
CLAS	52.37 [50.78, 53.79]
MLAS	41.59 [40.14, 43.08]	56.94 [55.08, 58.69]	77.62

Chinese (UD_Chinese-GSDSimp), raw input

Metric	Distilled tier	Fast tier	Stanza 1.5.1	UDPipe 2	Trankit
Tokens	89.62 [88.81, 90.43]		92.14		96.94
Sentences	83.49 [80.00, 86.92]		99.10	98.80	99.70
Words	89.62 [88.81, 90.43]	89.62 [88.87, 90.42]	92.14	90.13	96.94
UPOS	77.69 [76.76, 78.59]	81.90 [80.99, 82.86]	88.82	86.67	94.17
XPOS	77.19 [76.29, 78.12]		88.61	86.83	93.98
UFeats	85.54 [84.70, 86.37]		91.47	89.52	96.51
AllTags	74.60 [73.61, 75.61]		87.95	86.16	93.52
Lemmas	89.32 [88.51, 90.11]		92.07	90.09	96.94
UAS	51.12 [49.71, 52.49]		73.41	71.74	84.64
LAS	46.49 [45.03, 47.91]	57.88 [56.21, 59.63]	70.65	69.52	81.96
CLAS	42.94 [41.24, 44.46]		67.39		80.14
MLAS	34.57 [33.00, 36.03]		63.96	62.23	76.30