Sneaker-Notify

by YuLin12345

YuLin12345 /Sneaker-Notify

Sneaker/Restock/Monitor Notify via Twitter coded in Python using Scrapy.

135 Stars 37 Forks Last release: Not found 119 Commits 0 Releases

Available items

No Items, yet!

The developer of this repository has not created any items for sale yet. Need a bug fixed? Help with integration? A different license? Create a request here:

Donation: Feel free to buy me a cup of coffee, so I can stay motivated and keep updating this project.

PayPal

Sneaker Restock/Monitor Notify via Twitter/Discord/Slack coded in Python using Scrapy.

Example

Status: Under Development. If Interested feel free to Twitter Follow on Twitter. To view the database online check here.

Description: Crawl a list of sneaker websites. Once the new product is found or is restocked. It will check the item's name for certain keywords. If found, it will alert the user via Twitter using tweets or Discord/Slack using WebHook with date, time, item name, and link.

Supported Sites List: - 43einhalb - 5 Pointz - AFewStore - ALLike - Addict - AdidasUS - AdidasEU - Aphrodite - AsphaltGold - BSTN - Back Door - Bait - Barneys - Ban if crawl too much. - Basket Store - Blends - Bodega - Caliroots - Capsule - ChampsSports - City Gear - Concepts - Consortium - DeadStock - DefShop - Dope Factory - Drome - DSMNY - EastBay - End - Captcha if crawl too much. - Extra Butter NY - Feature - FinishLine - Banned on Vultr. - FootAction - FootAsylum - FootDistrict - FootLocker - FootPatrol - FootShop - Hanon - Haven - Hubbastille - HypeBeast - HypeDC - Inflammable - JDSports - JimmyJazz - ASN blocked on Vultr via CloudFlare. - Kith - Kong - Lapstone and Hammer - Loaded - Luisa Via Roma - MrPorter - NeedSupply - Next Door - NiceKicks - Nike - Nordstrom - Notre - Nrml - Office - Offspring - Oneness - OverKill - Packer - Proper - Puff Reds - Renarts - Rise45 - Ruvilla - SSense - SVD - SaintAlfred - SaveOurSole - Shelf Life - ShoesPalace - Need to disobey robots.txt, if you want to crawl. - Size - Slam Jam Socialism - SneakerBaas - SneakerNStuff - ASN blocked on Vultr via CloudFlare. - SneakerPolitics - SocialStatus - SoleBox - SoleKitchen - SoleStop - Solefly - StickABush - StormFashion - Summer - Tint Footware - Titolo - Tres Bien - TrophyRoom - Undefeated - Uptown - Urban Industry - Urban Jungle - Urban Outfitters - WellGosh - West NYC - XileClothing - YCMC - YME Universe - Zappos

Setup: 1. Make sure you have Python installed. (Working on Python 2.7 - not working on Python 3) To install Python go to https://www.python.org/

  1. Install the pip requirements - can be found in the requirements.txt.
  • Some Windows users will need to install
pip install pypiwin32
  • For Mac: to install MySQL-python. Open terminal and type the below:

    /usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
    brew install mysql-connector-c
    pip install MySQL-python
    
  • If you have problem installing mysqldb or getting "no module named mysqldb" for Windows go to: http://www.lfd.uci.edu/~gohlke/pythonlibs/#mysql-python

Download:
MySQL_python‑1.2.5‑cp27‑none‑win32.whl for 32 Bit Python
MySQL_python‑1.2.5‑cp27‑none‑win_amd64.whl for 64 Bit Python

pip install wheel pip install MySQL_python‑1.2.5‑cp27‑none‑win32.whl for 32 Bit Python pip install MySQL_python‑1.2.5‑cp27‑none‑win_amd64.whl for 64 Bit Python

  1. Install MySQL database -> .sql file provided in the folder.

  2. Go into mysqlpipeline.py edit MySQL connection info and edit Twitter's CONSUMERKEY, CONSUMERSECRET, ACCESSTOKENKEY, and ACCESSTOKENSECRET to your Twitter account's info. To use Discord or Slack paste the WebHook URL into requests.post(' DISCORD or SLACK WEBHOOK URL ', data={'content': TEXTTO_TWEET})

  3. To run:

    • For Windows: Click on main.py
    • For Mac: Open terminal on the folder type python main.py

Optional: Added a crawlerdb.php to see the data online. - To install, put crawlerdb.php on your web server with the crawler's database running and edit the connection info.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.