Dictionary keys description:
LEMMA - Base form of the token, with no inflectional suffixes.
POS - Coarse-grained part-of-speech from the Universal POS tag set.
TAG - Fine-grained part-of-speech.
SHAPE - Transform of the token’s string to show orthographic features. Alphabetic characters are replaced by x or X, and numeric characters are replaced by d, and sequences of the same character are truncated after length 4. For example,“Xxxx"or"dd”.
ALPHA - Does the token consist of alphabetic characters?
STOP - Is the token part of a “stop list”?
DIGIT - Does the token consist of digits?