KinoSearch1::Analysis::Analyzer - base class for analyzers

       Copyright 2005-2010 Marvin Humphrey

       In KinoSearch1, an Analyzer is a filter which processes text, transforming it from one form into another.
       For instance, an analyzer might break up a long text into smaller pieces (Tokenizer), or it might convert
       text to lowercase (LCNormalizer).

       See KinoSearch1 version 1.01.

perl v5.40.0                                       2024-10-20               KinoSearch1::Analysis::Analyzer(3pm)

analyze(EXPERIMENTAL)
           $token_batch = $analyzer->analyze($token_batch);

       All Analyzer subclasses provide an "analyze" method.  analyze() takes a single TokenBatch as input, and
       it returns a TokenBatch, either the same one (probably transformed in some way), or a new one.

       KinoSearch1::Analysis::Analyzer - base class for analyzers

           # abstract base class -- you probably want PolyAnalyzer, not this.