| Tanl Linguistic Pipeline |
Public Member Functions | |
| SentenceReader (std::istream *is, Corpus *corpus) | |
Creates a new SentenceReader. | |
| virtual bool | MoveNext () |
| virtual Sentence * | Current () |
| the next sentence from the stream | |
| virtual void | reset () |
| Restart. | |
| SentenceReader (std::istream *is, Corpus *corpus) | |
Creates a new SentenceReader. | |
| virtual bool | MoveNext () |
| ------------------------------------------------------------ Enumerator<Sentence*> | |
| virtual Sentence * | Current () |
| the next sentence from the stream | |
| virtual void | Reset () |
| Restart. | |
| virtual | ~SentenceReader () |
| ------------------------------------------------------------ | |
Public Attributes | |
| Corpus * | corpus |
Protected Attributes | |
| Sentence * | sentence |
| the sentence read | |
| std::istream * | is |
| stream where to read from | |
| std::string | line |
| input line read | |
| Tanl::SentenceReader::SentenceReader | ( | std::istream * | is, | |
| Corpus * | corpus | |||
| ) |
Creates a new SentenceReader.
| is | the stream containing the annotated sentences. | |
| corpus | Corpus to which the sentences belong. |
| Tanl::SentenceReader::SentenceReader | ( | std::istream * | is, | |
| Corpus * | corpus | |||
| ) |
Creates a new SentenceReader.
| is | the stream containing the annotated sentences. | |
| corpus | Corpus to which the sentences belong. |
| virtual bool Tanl::SentenceReader::MoveNext | ( | ) | [virtual] |
------------------------------------------------------------ Enumerator<Sentence*>
Implements Tanl::Enumerator< Sentence * >.
Reimplemented in Tanl::ConllXSentenceReader, Tanl::DgaSentenceReader, Tanl::TokenSentenceReader, Tanl::TaggedSentenceReader, and Tanl::SplitSentenceReader.
| bool Tanl::SentenceReader::MoveNext | ( | ) | [virtual] |
Implements Tanl::Enumerator< Sentence * >.
Reimplemented in Tanl::ConllXSentenceReader, Tanl::DgaSentenceReader, Tanl::TokenSentenceReader, Tanl::TaggedSentenceReader, and Tanl::SplitSentenceReader.
References Tanl::TokenField::default_, Tanl::Corpus::index, is, Tanl::TokenField::label, line, Tanl::TokenField::link, Tanl::Text::RegExp::Pattern::match(), sentence, and Tanl::Corpus::tokenFields.
Referenced by Parser::ReviseContextStream::hasNext(), Tanl::TaggedSentenceReader::MoveNext(), Tanl::SST::SST::train(), and Tanl::NER::NER::train().