logo
Free, unlimited AI code reviews that run on commit
git-lrc git-lrc GitHub Install Now We'd appreciate a star git-lrc - Free, unlimited AI code reviews that run on commit | Product Hunt git-lrc - Free, unlimited AI code reviews that run on commit | Product Hunt

ngrams - Compute the ngram frequencies and produce tables to the stdout.

Description

       This script produces n-grams tables of the input files to the standard output.

       Options:

       --normalize
           Prints  normalized n-gram frequencies; i.e., the n-gram counts divided by the total number of n-grams
           of the same size.

       --onlyfirst=NUMBER
           Prints only the first NUMBER n-grams for each n.  See Text::Ngrams module.

       --limit=NUMBER
           Limit the total number of distinct n-grams (for efficiency reasons, the counts may not be correct  at
           the end).

       --version
           Prints version.

       --help
           Prints help.

       --n=NUMBER
           N-gram size, produces 3-grams by default.

       --orderby=frequency|ngram
           The n-gram order.  See Text::Ngrams module.

       --type=character|byte|word|utf8
           Type of n-grams produces. See Text::Ngrams module.

Name

       ngrams - Compute the ngram frequencies and produce tables to the stdout.

Prerequisites

       Text::Ngrams, Getopt::Long

Readme

       N-gram  analysis for various kinds of n-grams (character, words, bytes, utf8, and user-defined). Based on
       Text::Ngrams module.

Script Categories

       Text::Statistics

See Also

       Text::Ngrams module.

Synopis

         ngram [--version] [--help] [--n=3] [--normalize] [--type=TYPE]
               [--orderby=ORD] [--onlyfirst=N] [input files]

See Also