Struct BasicTokenReader

pub struct BasicTokenReader<T>
where
    T: Read + Sized,
{ /* private fields */ }

Scans the provided input stream and outputs Tokens as it detects them.

Implementations

impl<T: Read + Sized> BasicTokenReader<T>

pub fn new(reader: T) -> Self

Creates a new Tokenizer using the default RFC4180 Dialect, consuming the underlying reader.

pub fn dialect(reader: T, dialect: Dialect) -> Self

Token reader using the specified dialect

Trait Implementations

impl<T: Read + Sized> TokenReader for BasicTokenReader<T>

fn next_tokens(&mut self) -> Result<Option<Vec<Token>>, CSVError>

Attempts to scan the line and return the immediate next set of Tokens it finds. The real brunt of the processing work is done here.