# `TDTokenizerState`

*Class*

## Declaration

```swift
class TDTokenizerState
```

```objc
@interface TDTokenizerState : NSObject
```

```python
class TDTokenizerState(NSObject)
```

## Overview

A TDTokenizerState returns a token, given a reader, an initial character read from the reader, and a tokenizer that is conducting an overall tokenization of the reader.

## Topics

### Instance Methods

- [`TDTokenizerState bufferLength`](/Core/GlyphsKit/TDTokenizerState/bufferLength)
- [`TDTokenizerState nextTokenFromReader:startingWith:tokenizer:`](/Core/GlyphsKit/TDTokenizerState/nextTokenFromReader:startingWith:tokenizer:)

## Relationships

### Inherits From

- `NSObject`

### Inherited By

- [`TDQuoteState`](/Core/GlyphsKit/TDQuoteState)