C tokens are of six types, They are,
- keyword
- identifier
- constant
- string-literal
- punctuator
preprocessing-token:
- head-name
- identifer
- pp-number
- character-constant
- string-literal
- punctuator
- each non-white-space character that cannot be one of the above
reference :
ISO/IEC 9899:201x
N1570
C11
[To be continued]