barrucadu/ markov

Python

Need help with markov?

Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

barrucadu

452 Stars

65 Forks

Do What The F*ck You Want To Public License

48 Commits

2 Opened issues

Description

Markov chain text generator, as used for KingJamesProgramming

Services available

Need anything else?

Contributors list

Michael Walker barrucadu

# 164,214

govuk

Less

Haskell

Emacs

35 commits

Jacob Kopczynski jkopczyn

# 395,515

Python

7 commits

Daniel S. Coolperson

# 577,562

Python

1 commit

Readme

README

Name: markov
Brand: markov
SKU: //barrucadu/markov
Rating: 2.88 (452 reviews)

Overview

The program presents a REPL, from which you can generate text in a number of different ways, a list of commands can be produced by typing

help

, and help for specific topics can be found by typing

help
topic

Getting Started

Download the KingJamesProgramming corpus from this repo
```
tar xvf KingJamesProgramming.tar.xz
```

Set up the virtualenv

virtualenv venv
source venv/bin/activate
pip install -r requirements.txt

Fire up the program
```
python3 -m markov
```

Generate text

train 3 --noparagraphs /path/to/KingJamesProgramming/*
tokens 350

Warning: Repetition

To avoid infinite loops, the

paragraphs

and

sentences

generators may end abruptly. Because they generate blocks of text at a time, and a block would only end when a specific token (such as a paragraph break) occurs, the generators are programmed to end the chunk immediately if they find themselves generating a token from the same state repeatedly (with the threshold set at the number of occurences of that state in the training corpus). This can cause issues with small training sets or, if the training set has many rare words, with a high chance of choosing a random token.