clang_tokenize

Tokenize the source code described by the given range into raw lexical tokens.

\param TU the translation unit whose text is being tokenized.

\param Range the source range in which text should be tokenized. All of the tokens produced by tokenization will fall within this source range,

\param Tokens this pointer will be set to point to the array of tokens that occur within the given source range. The returned pointer must be freed with clang_disposeTokens() before the translation unit is destroyed.

\param NumTokens will be set to the number of tokens in the \c *Tokens array.

extern (C)
void
clang_tokenize

Meta