Struct CountVectorizer

pub struct CountVectorizer { /* private fields */ }

Counts the occurrences of each vocabulary entry, learned during fitting, in a sequence of documents. Each vocabulary entry is mapped to an integer value that is used to index the count in the result.

Implementations

impl CountVectorizer

pub fn params() -> CountVectorizerParams

Construct a new set of parameters

pub fn nentries(&self) -> usize

Number of vocabulary entries learned during fitting

pub fn force_tokenizer_function_redefinition( &mut self, tokenizer: fn(&str) -> Vec<&str>, )

pub fn transform<T: ToString, D: Data<Elem = T>>( &self, x: &ArrayBase<D, Ix1>, ) -> Result<CsMat<usize>>

Given a sequence of n documents, produces a sparse array of size (n, vocabulary_entries) where column j of row i is the number of occurrences of vocabulary entry j in the document of index i. Vocabulary entry j is the string at the j-th position in the vocabulary. If a vocabulary entry was not encountered in a document, then the relative cell in the sparse matrix will be set to None.

pub fn transform_files<P: AsRef<Path>>( &self, input: &[P], encoding: EncodingRef, trap: DecoderTrap, ) -> Result<CsMat<usize>>

Given a sequence of n file names, produces a sparse array of size (n, vocabulary_entries) where column j of row i is the number of occurrences of vocabulary entry j in the document contained in the file of index i. Vocabulary entry j is the string at the j-th position in the vocabulary. If a vocabulary entry was not encountered in a document, then the relative cell in the sparse matrix will be set to None.

The files will be read using the specified encoding, and any sequence unrecognized by the encoding will be handled according to trap.

pub fn vocabulary(&self) -> &Vec<String>

Contains all vocabulary entries, in the same order used by the transform methods.

Trait Implementations

impl Clone for CountVectorizer

fn clone(&self) -> CountVectorizer

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CountVectorizer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.