SpiderX

SpiderX allows you to watch movies by scraping data from the internet. The frontend is built with Vue.js and the scraping process is handled by python scrapy framework.

How it works

1. The user searches will be first sent to firestore, if the search is not found in the firestore then the scraper (python scrapy framework) will be called to initiate the scraping process.
2. Once the scraper scrapes the data, the data scraped will be sent to firestore.
3. Using firestore real-time updates, the vue interface will be updated in real-time.

Features

1. Get trending movies
2. Get tob imdb movies
3. List movies by genres
4. Trailers for those movies
5. Get info about the movie

Running locally

1. You need to setup firestore and initialize the db in src/firebase.js

import firebase from 'firebase/app';
import 'firebase/firestore';

// fill the values you get from firestore
const config = {
  apiKey: '',
  authDomain: '',
  databaseURL: '',
  projectId: '',
  storageBucket: '',
  messagingSenderId: '',
  appId: '',
  measurementId: '',
}
firebase.initializeApp(config);
const db = firebase.firestore();
export default db;

1. You need to configure .env at the root of the project

VUE_APP_SPIDERX_HEROKU= // the hosted scraper url

1. Then run npm i && npm run serve to see the spider in action

UI

Home

Top IMDB

Individual Movie

Trailer

Mobile