Risk-Aware AI Code Review for Business-Critical Systems
LiveReview LiveReview Explore LiveReview

Plucene::Analysis::WhitespaceTokenizer - white space tokenizer

Description

       A WhitespaceTokenizer is a tokenizer that divides text at whitespace.  Adjacent sequences of non-
       Whitespace characters form tokens.

Methods

perl v5.36.0                                       2022-12-04             Plucene::Analys...espaceTokenizer(3pm)

Name

       Plucene::Analysis::WhitespaceTokenizer - white space tokenizer

Synopsis

               # isa Plucene::Analysis::CharTokenizer

See Also