Tanl::Tokenizer Class Reference

Inheritance diagram for Tanl::Tokenizer:

List of all members.

Public Member Functions
Enumerator< Token * > *	pipe (std::istream &is=std::cin)
	Connect to an input stream.
Enumerator< Token * > *	pipe (Enumerator< std::string * > &se)
	Create a pipe pulling from a string Enumerator se.
Enumerator< Token * > *	pipe (PyObject *pit)
	Create a pipe pulling from a Python iterator pit.

---

Member Function Documentation

Enumerator< Token * > * Tanl::Tokenizer::pipe

(

PyObject *

pit

)

Create a pipe pulling from a Python iterator pit.

Enumerator< Token * > * Tanl::Tokenizer::pipe

(

Enumerator< std::string * > &

se

)

[virtual]

Create a pipe pulling from a string Enumerator se.

Implements Tanl::IPipe< std::string *, Token * >.

---

The documentation for this class was generated from the following files:

• split/Tokenizer/Tokenizer.h
• split/Tokenizer/Tokenizer.cpp