| ⇢ | B | AbstractTokenizer added | |
| B | ↛ | BaseTokenizer removed |
| ⇢ | C | AbstractTokenizer::tokenizeOperator() added | |
| ⇢ | B | AbstractTokenizer::tokenize() added | |
| ⇢ | B | AbstractTokenizer::startsWithAnyLongest() added | |
| ⇢ | A | AbstractTokenizer::tokenizeDelimitedString() added | |
| ⇢ | A | AbstractTokenizer::substring() added | |
| ⇢ | A | AbstractTokenizer::indexAfter() added | |
| ⇢ | A | AbstractTokenizer::addTokenFromBuffer() added | |
| ⇢ | A | AbstractTokenizer::isEof() added | |
| ⇢ | A | AbstractTokenizer::__construct() added | |
| ⇢ | A | AbstractTokenizer::advance() added | |
| C | ↛ | BaseTokenizer::tokenizeOperator() removed | |
| B | ↛ | BaseTokenizer::tokenize() removed | |
| B | ↛ | BaseTokenizer::startsWithAnyLongest() removed | |
| A | ↛ | BaseTokenizer::tokenizeDelimitedString() removed | |
| A | ↛ | BaseTokenizer::substring() removed | |
| A | ↛ | BaseTokenizer::indexAfter() removed | |
| A | ↛ | BaseTokenizer::addTokenFromBuffer() removed | |
| A | ↛ | BaseTokenizer::__construct() removed | |
| A | ↛ | BaseTokenizer::isEof() removed | |
| A | ↛ | BaseTokenizer::advance() removed |