Need help with one-network-many-uses?
Click the “chat” button below for chat support from the developer who created it, or find similar developers for support.

About the developer

paraschopra
132 Stars 37 Forks 7 Commits 1 Opened issues

Description

Four-in-one deep network: image search, image captioning, similar words and similar images using a single model

Services available

!
?

Need anything else?

Contributors list

One neural network, many uses

Jupyter notebook corresponding to tutorial: One neural network network, many uses: image captioning, image search, similar images and similar words using one model

Requires following packages: - PyTorch - Numpy - Matplotlib

Dataset NOT included (please download separately)

To follow along, you'll need to download the Flickr8K dataset. Fill this form and you'll receive a download link on your email. (There's also a direct link to download the 1GB Flickr8K dataset, though not sure how long it'll stay like that). Extract the zip file in the 'Flicker8kDataset' folder in the same directory as your notebook. You'll also need to download captions from here. Extract captions in the folder 'captiondatasets'.

Example performance

Image caption example:

art 1

Similar words example

art 2

Similar images example

asrt 3

Image search example

search example

search example

Made by @paraschopra

MIT License.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.