Need help with skip-thoughts?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

sanyam5
219 Stars 46 Forks MIT License 24 Commits 3 Opened issues

Description

The first public PyTorch implementation of Skip-Thought Vectors

Services available

!
?

Need anything else?

Contributors list

# 69,559
Python
pytorch
deep-le...
recurre...
22 commits

skip-thoughts

An implementation of Skip-Thought Vectors in PyTorch.

Blog

Here's a blog explaining the subtleties of Skip-Thoughts blog blog

Instructions

Training

  • Download BookCorpus or any other data-set and concatenate all sentences into one file and put it in
    ./data/
    directory
  • Modify the following line in
    Train.ipynb
    notebook accordingly:
    d = DataLoader("./data/dummy_corpus.txt")
  • There is no early stopping.
  • The
    Train
    notebook runs at the rate of 1 epoch / 2 days on an Nvidia 1080 Ti.
  • Your model is saved when
    ./saved_models
    when the average training loss in the last 20 iterations dips below the previous best.

Evaluation

Only implemented on classification tasks * Download the movie review dataset and put

rt-polarity.neg
and
rt-polarity.pos
in the
./tasks/mr_data
directory. * You may also test on other classification tasks by downloading the datasets and providing their path and tasks type in
Evaluate.ipynb

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.