Declaration

func setTokenizerState(_ state: TDTokenizerState, from start: Int, to end: Int)

Declaration

- (void) setTokenizerState:(TDTokenizerState *) state from:(NSInteger) start to:(NSInteger) end;

Declaration

setTokenizerState_from_to_(state: TDTokenizerState, start: int, end: int)

Parameters

state

The state for this character range

start

The “start” character. e.g. ‘a’ or 65.

end

The “end” character. ‘z’ or 90.

Discussion

Change the state the tokenizer will enter upon reading any character between “start” and “end”.