Tokenizer parses input search query string into tokens sequence.
Inheritance Hierarchy
NReco.NLQuery.Tokenizer
Namespace: NReco.NLQuery
Assembly: NReco.NLQuery (in NReco.NLQuery.dll) Version: 1.0.0
Syntax
The Tokenizer type exposes the following members.
Constructors
| Name | Description | |
|---|---|---|
| Tokenizer | Initializes a new instance of the Tokenizer class |
Methods
| Name | Description | |
|---|---|---|
| Equals | (Inherited from Object.) | |
| Finalize | (Inherited from Object.) | |
| GetHashCode | (Inherited from Object.) | |
| GetType | (Inherited from Object.) | |
| IsArithmeticOp | ||
| IsBracket | ||
| IsCurrency | ||
| IsPunctuation | ||
| IsSeparator | ||
| MemberwiseClone | (Inherited from Object.) | |
| Parse(TextReader) |
Parses specified string.
| |
| Parse(String) |
Parses specified string.
| |
| ReadTokens | ||
| ToString | (Inherited from Object.) |
See Also
