Declaration

func nextToken(from r: TDReader!, startingWith cin: Int, tokenizer t: TDTokenizer!) -> TDToken!

Declaration

- (TDToken *) nextTokenFromReader:(TDReader *) r startingWith:(NSInteger) cin tokenizer:(TDTokenizer *) t;

Declaration

nextTokenFromReader_startingWith_tokenizer_(r: TDReader, cin: int, t: TDTokenizer) -> TDToken

Parameters

r

The reader from which to read additional characters

cin

The character that a tokenizer used to determine to use this state

t

The tokenizer currently powering the tokenization

Return Value

A token that represents a logical piece of the reader

Discussion

Return a token that represents a logical piece of a reader.