cewl - custom word list generator
Contents
Bugs
Someone has reported that the spider misses some pages which are have querystrings on them. This issue
isn't confirmed.
Description
CeWL (Custom Word List generator) is a ruby app which spiders a given URL, up to a specified depth, and
returns a list of words which can then be used for password crackers such as John the Ripper. Optionally,
CeWL can follow external links.
CeWL can also create a list of email addresses found in mailto links. These email addresses can be used
as usernames in brute force actions.
CeWL is pronounced "cool".
Name
cewl - custom word list generator
Options
General options
-h,--help
Show help.
-k,--keep
Keep the downloaded file.
-d<x>,--depth<x>
Depth to spider to, default 2.
-m,--min_word_length
Minimum word length, default 3.
-o,--offsite
Let the spider visit other sites.
--exclude
A file containing a list of paths to exclude.
--allowed
A regex pattern that path must match to be followed.
-w,--write
Write the output to the file.
-u,--ua<agent>
User agent to send.
-n,--no-words
Don't output the wordlist.
-g<x>,--groups<x>
Return groups of words as well.
--lowercase
Lowercase all parsed words.
--with-numbers
Accept words with numbers in as well as just letters.
--convert-umlauts
Convert common ISO-8859-1 (Latin-1) umlauts (ä-ae, ö-oe, ü-ue, ß-ss).
-a,--meta
Include meta data.
--meta_filefile
Output file for meta data.
-e,--email
Include email addresses.
--email_file<file>
Output file for email addresses.
--meta-temp-dir<dir>
The temporary directory used by exiftool when parsing files, default /tmp.
-c,--count
Show the count for each word found.
-v,--verbose
Verbose.
--debug
Extra debug information.
Authentication
--auth_type
Digest or basic.
--auth_user
Authentication username.
--auth_pass
Authentication password.
Proxy Support
--proxy_host
Proxy host.
--proxy_port
Proxy port, default 8080.
--proxy_username
Username for proxy, if required.
--proxy_password
Password for proxy, if required.
Headers
--header,-H
In format name:value - can pass multiple.
<url> The site to spider.
See Also
fab-cewl(1)
Synopsis
cewl [OPTION] ... URL
Tip
Sometimes, CeWL will return nothing. Use -v option to see the issue causing no output. E.g.: if '$ cewlhttp://example.org' is redirected to https://example.org, cewl will keep a silent.
