Tokenizer parses input search query string into tokens sequence.
Inheritance Hierarchy
NReco.NLQueryTokenizer
Namespace: NReco.NLQuery
Assembly: NReco.NLQuery (in NReco.NLQuery.dll) Version: 1.0.0
Syntax
The Tokenizer type exposes the following members.
Constructors
Name | Description | |
---|---|---|
Tokenizer | Initializes a new instance of the Tokenizer class |
Methods
Name | Description | |
---|---|---|
Equals | (Inherited from Object.) | |
Finalize | (Inherited from Object.) | |
GetHashCode | (Inherited from Object.) | |
GetType | (Inherited from Object.) | |
IsArithmeticOp | ||
IsBracket | ||
IsCurrency | ||
IsPunctuation | ||
IsSeparator | ||
MemberwiseClone | (Inherited from Object.) | |
Parse(TextReader) |
Parses specified string.
| |
Parse(String) |
Parses specified string.
| |
ReadTokens | ||
ToString | (Inherited from Object.) |
See Also