Tokenizer Class

NReco.NLQuery Class Library Documentation
Tokenizer parses input search query string into tokens sequence.
Inheritance Hierarchy

SystemObject
  NReco.NLQueryTokenizer

Namespace:  NReco.NLQuery
Assembly:  NReco.NLQuery (in NReco.NLQuery.dll) Version: 1.0.0
Syntax

public class Tokenizer

The Tokenizer type exposes the following members.

Constructors

  NameDescription
Public methodTokenizer
Initializes a new instance of the Tokenizer class
Top
Methods

  NameDescription
Public methodEquals (Inherited from Object.)
Protected methodFinalize (Inherited from Object.)
Public methodGetHashCode (Inherited from Object.)
Public methodGetType (Inherited from Object.)
Protected methodIsArithmeticOp
Protected methodIsBracket
Protected methodIsCurrency
Protected methodIsPunctuation
Protected methodIsSeparator
Protected methodMemberwiseClone (Inherited from Object.)
Public methodParse(TextReader)
Parses specified string.
Public methodParse(String)
Parses specified string.
Protected methodReadTokens
Public methodToString (Inherited from Object.)
Top
See Also

Reference