| Percentage | Lines | ||
|---|---|---|---|
| IcuWordBoundaryTokenizer |
|
0 % | 121 |
| JaTinySegmenterTokenizer |
|
90 % | 244 |
| Sanitizer |
|
92 % | 163 |
| JaCompoundGroupTokenizer |
|
92 % | 216 |
| GenericRegExTokenizer |
|
92 % | 77 |
| PunctuationRegExTokenizer |
|
92 % | 75 |
| CdbStopwordAnalyzer |
|
93 % | 111 |
| SanitizerFactory |
|
95 % | 230 |
| CJKSimpleCharacterRegExTokenizer |
|
96 % | 74 |
| NGramTokenizer |
|
98 % | 119 |