Tanl::SplitSentenceReader Class Reference
Read a plain text file, split into tokens and return one sentence at a time. More...
#include <SplitSentenceReader.h>
Inheritance diagram for Tanl::SplitSentenceReader:
Collaboration diagram for Tanl::SplitSentenceReader:
Classes | |
| struct | BoundarySet |
| Parameters defininig where to split a sentence. More... | |
Public Member Functions | |
| SplitSentenceReader (std::istream *is, Corpus *corpus=0, BoundarySet const *bs=&defaultBS) | |
Creates a new SplitSentenceReader. | |
| bool | MoveNext () |
| Return true if there is another sentence available. | |
| void | reset () |
| Restart. | |
Static Public Attributes | |
| static BoundarySet const | defaultBS |
Detailed Description
Read a plain text file, split into tokens and return one sentence at a time.Definition at line 44 of file SplitSentenceReader.h.
Constructor & Destructor Documentation
| Tanl::SplitSentenceReader::SplitSentenceReader | ( | std::istream * | is, | |
| Corpus * | corpus = 0, |
|||
| BoundarySet const * | bs = &defaultBS | |||
| ) |
Creates a new SplitSentenceReader.
- Parameters:
-
is the stream containing the sentence to read. lang the language of the document.
Definition at line 37 of file SplitSentenceReader.cpp.
Member Function Documentation
| bool Tanl::SplitSentenceReader::MoveNext | ( | ) | [virtual] |
Return true if there is another sentence available.
Implements Tanl::Enumerator< T >.
Definition at line 47 of file SplitSentenceReader.cpp.
References Parser::Tokenizer::Current(), Tanl::SplitSentenceReader::BoundarySet::ends(), and Parser::Tokenizer::MoveNext().
The documentation for this class was generated from the following files: