Dictionary keys description:

LEMMA - Base form of the token, with no inflectional suffixes.

POS - Coarse-grained part-of-speech from the Universal POS tag set.

TAG - Fine-grained part-of-speech.

SHAPE - Transform of the token’s string to show orthographic features. Alphabetic characters are replaced by x or X, and numeric characters are replaced by d, and sequences of the same character are truncated after length 4. For example,“Xxxx"or"dd”.

ALPHA - Does the token consist of alphabetic characters?

STOP - Is the token part of a “stop list”?

DIGIT - Does the token consist of digits?