An improved tokenizer for strings. More...
#include <Bpp/Text/NestedStringTokenizer.h>
Inheritance diagram for bpp::NestedStringTokenizer:
Collaboration diagram for bpp::NestedStringTokenizer:
Public Member Functions | |
| NestedStringTokenizer (const std::string &s, const std::string &open, const std::string &end, const std::string &delimiters=" \\", bool solid=false) throw (Exception) | |
| Build a new StringTokenizer from a string. More... | |
| virtual | ~NestedStringTokenizer () |
| const std::string & | nextToken () throw (Exception) |
| Get the next available token. If no token is availbale, throw an Exception. More... | |
| std::string | unparseRemainingTokens () const |
| This function is not supported for nested tokenizers. More... | |
| bool | hasMoreToken () const |
| Tell if some tokens are still available. More... | |
| size_t | numberOfRemainingTokens () const |
| Tell how many tokens are available. More... | |
| const std::string & | getToken (size_t pos) const |
| Get a particular token. More... | |
| const std::deque< std::string > & | getTokens () const |
| Retrieve all tokens. More... | |
| void | removeEmptyTokens () |
| remove all empty token from the current position. More... | |
Protected Attributes | |
| std::deque< std::string > | tokens_ |
| Where the tokens are stored. More... | |
| std::deque< std::string > | splits_ |
| size_t | currentPosition_ |
| the current position in the token list. More... | |
Detailed Description
An improved tokenizer for strings.
Splits a string according to a given (set of) delimiter(s). Delimiters in certains blocks ({}, [], etc) are ignored.
Definition at line 59 of file NestedStringTokenizer.h.
Constructor & Destructor Documentation
◆ NestedStringTokenizer()
| NestedStringTokenizer::NestedStringTokenizer | ( | const std::string & | s, |
| const std::string & | open, | ||
| const std::string & | end, | ||
| const std::string & | delimiters = " \t\n\f\r", |
||
| bool | solid = false |
||
| ) | |||
| throw | ( | Exception | |
| ) | |||
Build a new StringTokenizer from a string.
- Parameters
-
s The string to parse. open Opening block. end Ending block. delimiters Chars that must be considered as delimiters. solid If true, delimiters is considered as a single bloc delimiter.
Definition at line 50 of file NestedStringTokenizer.cpp.
References bpp::TextTools::count().
◆ ~NestedStringTokenizer()
|
inlinevirtual |
Definition at line 75 of file NestedStringTokenizer.h.
Member Function Documentation
◆ getToken()
|
inlineinherited |
Get a particular token.
Do not move the iterator.
- Parameters
-
pos The index of the token.
- Returns
- the token at position 'pos'.
Definition at line 119 of file StringTokenizer.h.
References bpp::StringTokenizer::tokens_.
Referenced by bpp::NumCalcApplicationTools::seqFromString().
◆ getTokens()
|
inlineinherited |
Retrieve all tokens.
- Returns
- A reference toward the vector of tokens.
Definition at line 126 of file StringTokenizer.h.
References bpp::StringTokenizer::tokens_.
Referenced by bpp::DataTable::read().
◆ hasMoreToken()
|
inlineinherited |
Tell if some tokens are still available.
- Returns
- True if some tokens are still available.
Definition at line 100 of file StringTokenizer.h.
References bpp::StringTokenizer::currentPosition_, and bpp::StringTokenizer::tokens_.
Referenced by bpp::ParameterList::getMatchingParameterNames(), bpp::ApplicationTools::getMatrixParameter(), bpp::NumCalcApplicationTools::getVector(), bpp::ApplicationTools::matchingParameters(), bpp::KeyvalTools::multipleKeyvals(), bpp::StringTokenizer::nextToken(), bpp::BppODiscreteDistributionFormat::read(), and bpp::NumCalcApplicationTools::seqFromString().
◆ nextToken()
| const std::string & NestedStringTokenizer::nextToken | ( | ) | ||
| throw | ( | Exception | ||
| ) | ||||
Get the next available token. If no token is availbale, throw an Exception.
- Returns
- The next token if there is one.
Definition at line 148 of file NestedStringTokenizer.cpp.
Referenced by bpp::ApplicationTools::getVectorParameter().
◆ numberOfRemainingTokens()
|
inlineinherited |
Tell how many tokens are available.
- Returns
- the number of tokens available.
Definition at line 109 of file StringTokenizer.h.
References bpp::StringTokenizer::currentPosition_, and bpp::StringTokenizer::tokens_.
Referenced by bpp::ApplicationTools::getMatrixParameter(), bpp::ApplicationTools::getVectorParameter(), bpp::NumCalcApplicationTools::seqFromString(), and bpp::StringTokenizer::unparseRemainingTokens().
◆ removeEmptyTokens()
|
inherited |
remove all empty token from the current position.
Definition at line 104 of file StringTokenizer.cpp.
References bpp::StringTokenizer::currentPosition_, and bpp::StringTokenizer::tokens_.
◆ unparseRemainingTokens()
|
inline |
This function is not supported for nested tokenizers.
- Returns
- An empty string.
Definition at line 93 of file NestedStringTokenizer.h.
Member Data Documentation
◆ currentPosition_
|
protectedinherited |
the current position in the token list.
Definition at line 67 of file StringTokenizer.h.
Referenced by bpp::StringTokenizer::hasMoreToken(), bpp::StringTokenizer::nextToken(), bpp::StringTokenizer::numberOfRemainingTokens(), bpp::StringTokenizer::removeEmptyTokens(), and bpp::StringTokenizer::unparseRemainingTokens().
◆ splits_
|
protectedinherited |
Definition at line 64 of file StringTokenizer.h.
Referenced by bpp::StringTokenizer::StringTokenizer(), and bpp::StringTokenizer::unparseRemainingTokens().
◆ tokens_
|
protectedinherited |
Where the tokens are stored.
Definition at line 63 of file StringTokenizer.h.
Referenced by bpp::StringTokenizer::getToken(), bpp::StringTokenizer::getTokens(), bpp::StringTokenizer::hasMoreToken(), bpp::StringTokenizer::nextToken(), bpp::StringTokenizer::numberOfRemainingTokens(), bpp::StringTokenizer::removeEmptyTokens(), bpp::StringTokenizer::StringTokenizer(), and bpp::StringTokenizer::unparseRemainingTokens().
The documentation for this class was generated from the following files:
- Bpp/Text/NestedStringTokenizer.h
- Bpp/Text/NestedStringTokenizer.cpp
