Wordlist generator

You can use this page to generate a wordlist (or frequency list) of a text. This site was made by Alex Reuneker. For questions, see contact details at http://www.reuneker.nl. If you use this site for your research, please cite it as follows.

Steps

Copy a text (from a website, a book, a larger corpus, et cetera).
Paste the text into the input area below. You don't have to remove weird characters, tags, white spaces and new lines — the script does it for you.
Set the number of results wanted (or leave at 50). You can also set a minimal frequency for the words included in the list.
Click 'Generate wordlist' and wait a bit.

Input and settings

Choose preferred settings, or leave at default.

Top: Minimal frequency: Normalise to:
Remove numbers Remove non-ASCII characters

Paste a text to analyze below.

Results

Results will be presented here after you clicked 'generate wordlist'...

About

The worldlist function used was written using Vanilla Javascript, and your text is not uploaded to any server. Your computer itself does all the work. Small texts are processed very quickly. Longer texts take a bit longer, although getting the wordlist for the King James Bible (4.2MB; almost 800.000 words) took my laptop three seconds with multiple tabs and other applications open.

Pre-processing

Please take note of the pre-processing (i.e. before calculation) done here:

All punctuation (e.g. !?.,-) is removed, as are other non-standard characters (e.g. \/*, non-UTF-8 quotes).
All tabs, newlines (breaks) double spaces et cetera are removed. Remaining spaces are used as word boundaries and they are not counted.
All letters are converted to lower case (so 'Speak', 'SPEAK' and 'speak' are treated as one type and three tokens).

Updates

Added option to keep non-ASCII characters, such as diacritics. (2023-09-20)
Added relative frequencies and normalised frequency to results. (2020-04-14)
Created a sorting function in JS. (2020-04-10)
Converted script from part server-side processing set-up to complete client-side processing (JS). (2020-04-10)