whotracks.me

by cliqz-oss

cliqz-oss / whotracks.me

Data from the largest and longest measurement of online tracking.

144 Stars 42 Forks Last release: 12 months ago (2019.11.06) MIT License 195 Commits 53 Releases

Available items

No Items, yet!

The developer of this repository has not created any items for sale yet. Need a bug fixed? Help with integration? A different license? Create a request here:

 

WhoTracks.Me

Bringing Transparency to Online Tracking

Transparency · Privacy · Tracking landscape · Built by Cliqz & Ghostery
Trackers · Websites · Blog · Explorer

powered by Cliqz Follow WhoTracks.Me on Twitter License Badge


This repository contains:

  • data on trackers and websites as shown on whotracks.me (WTM)
  • database mapping tracker domains to companies
  • code to render the whotracks.me site

Installation

Python 3.6 is needed to build the site. We recommend creating a virtualenv (or

pipenv
) to install the dependencies.

With Pip

$ pip install git+https://github.com/cliqz-oss/whotracks.me.git

From source

After cloning the repository (requires

git-lfs
):
$ pip install -r requirements.txt
$ pip install -e .

That’s all you need to get started!

Using the data

To get started with the data, everything you need can be found in

whotracksme.data
:
from whotracksme.data.loader import DataSource

data = DataSource()

available entities

data.trackers data.companies data.sites

A whitepaper for whotracks.me is available at https://arxiv.org/abs/1804.08959, and here's a BibTeX entry that you can use to cite it in a publication:

@misc{whotracksme,
    title={WhoTracks.Me: Shedding light on the opaque world of online tracking},
    author={Arjaldo Karaj and Sam Macbeth and Rémi Berson and Josep M. Pujol},
    year={2018},
    eprint={1804.08959},
    archivePrefix={arXiv},
    primaryClass={cs.CY}
}

Building the site

Building the site requires a few extra dependencies, not installed by default to not make the installation heavier than it needs to be. You will need to install

whotracksme
from the repository, because not all assets are packaged with
whotracksme
released on pypi:
$ pip install -r requirements-dev.txt
$ pip install -e '.[dev]'

Once this is done, you will have access to a

whotracksme
entry point that can be used this way:
$ whotracksme website [serve]

The

serve
part is optional and can be used while making changes on the website.

All generated artifacts can be found in the

_site/
folder.

Tests

To run tests, you will need

pytest
, or simply install
whotacksme
with the
dev
extra:
$ pip install -e '.[dev]'
$ pytest

Contributing

We are happy to take contributions on:

  • Guest articles for our blog in the topics of tracking, privacy and security. Feel free to use the data in this repository if you need inspiration.
  • Feature requests that are doable using the WTM database.
  • Curating our database of tracker profiles. Open an issue if you spot anything odd.

Right to Amend

Please read our Guideline for 3rd parties wanting to suggest corrections to their data.

License

The content of this project itself is licensed under the Creative Commons Attribution 4.0 license, and the underlying source code used to generate and display that content is licensed under the MIT license.

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.