supervenn: precise and easy-to-read multiple sets visualization in Python

What it is

supervenn is a matplotlib-based tool for visualization of any number of intersecting sets. It takes native Python

set

supervenn

The easiest way to understand how supervenn diagrams work, is to compare some simple examples to their Euler-Venn counterparts. Top row is Euler-Venn diagrams made with matplotlib-venn package, bottom row is supervenn diagrams:

Installation

pip install supervenn

Requirements

Python 2.7 or 3.6+ with

numpy

matplotlib

Basic usage

The main entry point is the eponymous

supervenn

set

SupervennPlot

python
from supervenn import supervenn
sets = [{1, 2, 3, 4}, {3, 4, 5}, {1, 6, 7, 8}]
supervenn(sets, side_plots=False)

Each row repesents a set, the order from bottom to top is the same as in the

sets

The numbers at the bottom show the sizes (cardinalities) of all intersections, which we will call chunks. The sizes of sets and their intersections (chunks) are up to proportion, but the order of elements is not preserved, e.g. the leftmost chunk of size 3 is

{6, 7, 8}

A combinatorial optimization algorithms is applied that rearranges the chunks (the columns of the array plotted) to minimize the number of parts the sets are broken into. In the example above each set is in one piece ( no gaps in rows at all), but it's not always possible, even for three sets:

supervenn([{1, 2}, {2, 3}, {1, 3}], side_plots=False)

By default, additional side plots are also displayed:

supervenn(sets)

Here, the numbers on the right are the set sizes (cardinalities), and numbers on the top show how many sets does this intersection make part of. The grey bars represent the same numbers visually.

If you need only one of the two side plots, use

side_plots='top'

side_plots='right'

Features (how to)

Add custom set annotations instead of 'Set1', 'Set2' etc

Use the

set_annotations

python
sets = [{1, 2, 3, 4}, {3, 4, 5}, {1, 6, 7, 8}]
labels = ['alice', 'bob', 'third party']
supervenn(sets, labels)

Change size and dpi of the plot

Create a new figure and plot into it:

python
import matplotlib.pyplot as plt
plt.figure(figsize=(16, 8))
supervenn(sets)

The

supervenn

figsize

dpi

Plot into an existing axis

Use the

ax

supervenn(sets, ax=my_axis)

Access the figure and axes objects of the plot

Use

.figure

axes

supervenn()

axes

main

top_side_plot

right_side_plot

unused

side_plots=False

main

Save the plot to an image file

import matplotlib.pyplot as plt
supervenn(sets)
plt.savefig('myplot.png')

Use a different ordering of chunks (columns)

Use the

chunks_ordering

'minimize gaps'

'size'

'occurrence'

'random'

To reverse the order (e.g. you want smaller chunks to go first), pass

reverse_chunks_order=False

True

Reorder the sets (rows) instead of keeping the order as passed into function

Use the

sets_ordering

None

'minimize gaps'

'size'

'chunk count'

'random'

To reverse the order (e.g. you want smaller sets to go first), pass

reverse_sets_order=False

True

Inspect the chunks' contents

supervenn(sets, ...)

SupervennPlot

chunks

dict

frozenset

my_supervenn_object.chunks[frozenset([0, 2])]

sets[0]

sets[2]

There is also a

get_chunk(set_indices)

list

frozenset

my_supervenn_object.get_chunk([0, 2])

If you have a good idea of a more convenient method of chunks lookup, let me know and I'll implement it as well.

Make the plot prettier if sets and/or chunks are very different in size

Use the

widths_minmax_ratio

python
sets = [set(range(200)), set(range(201)), set(range(203)), set(range(206))]
supervenn(sets, side_plots=False)

Annotations in the bottom left corner are unreadable.

One solution is to trade exact chunk proportionality for readability. This is done by making small chunks visually larger. To be exact, a linear function is applied to the chunk sizes, with slope and intercept chosen so that the smallest chunk size is exactly

widths_minmax_ratio

widths_minmax_ratio=1

supervenn(sets, side_plots=False, widths_minmax_ratio=0.05)

The image now looks clean, but chunks of size 1 to 3 look almost the same.

Avoid clutter in the X axis annotations

• Use the

  min_width_for_annotation

  argument to hide annotations for chunks smaller than this value.

  python
  supervenn(sets, side_plots=False, min_width_for_annotation=100)
  

  

• Pass

  rotate_col_annotations=True

  to print chunk sizes vertically.

• There's also

  col_annotations_ys_count

  argument, but it is deprecated and will be removed in a future version.

Change bars appearance in the main plot

Use arguments

bar_height

1

bar_alpha

0.6

bar_align

edge

color_cycle

python
import matplotlib.pyplot as plt
with plt.style.context('bmh'):
    supervenn([{1,2,3}, {3,4}])

Change side plots size and color

Use

side_plot_width

side_plot_color

'tab:gray'

Change axes labels from

SETS

,

ITEMS

to something else

Just use

plt.xlabel

plt.ylabel

Change other parameters

Other arguments can be found in the docstring to the function.

Algorithm used to minimize gaps

If there are are no more than 8 chunks, the optimal permutation is found with exhaustive search (you can increase this limit up to 12 using the

max_bruteforce_size

supervenn._algorithms

Less trivial examples:

Words with many meanings

letters = {'a', 'r', 'c', 'i', 'z'}
programming_languages = {'python', 'r', 'c', 'c++', 'java', 'julia'}
animals = {'python', 'buffalo', 'turkey', 'cat', 'dog', 'robin'}
geographic_places = {'java', 'buffalo', 'turkey', 'moscow'}
names = {'robin', 'julia', 'alice', 'bob', 'conrad'}
green_things = {'python', 'grass'}
sets = [letters, programming_languages, animals, geographic_places, names, green_things]
labels = ['letters', 'programming languages', 'animals', 'geographic places',
          'human names', 'green things']
plt.figure(figsize=(10, 6))
supervenn(sets, labels , sets_ordering='minimize gaps')

And this is how the figure would look without the smart column reordering algorithm:

Banana genome compared to 5 other species

Data courtesy of Jake R Conway, Alexander Lex, Nils Gehlenborg - creators of UpSet

Image from D’Hont, A., Denoeud, F., Aury, J. et al. The banana (Musa acuminata) genome and the evolution of monocotyledonous plants

Figure from original article (note that it is by no means proportional!):

Figure made with UpSetR

Figure made with supervenn (using the

widths_minmax_ratio

plt.figure(figsize=(20, 10))
supervenn(sets_list, species_names, widths_minmax_ratio=0.1,
          sets_ordering='minimize gaps', rotate_col_annotations=True, col_annotations_area_height=1.2)

For comparison, here's the same data visualized to scale (no

widths_minmax_ratio

min_width_for_annotation

plt.figure(figsize=(20, 10))
supervenn(sets_list, species_names, rotate_col_annotations=True,
          col_annotations_area_height=1.2, sets_ordering='minimize gaps',
          min_width_for_annotation=180)

It must be noted that

supervenn

2^n_sets - 1

Order IDs in requests to a multiple vehicle routing problem solver

This was actually my motivation in creating this package. The team I'm currently working in provides an API that solves a variation of the Multiple Vehicles Routing Problem. The API solves tasks of the form "Given 1000 delivery orders each with lat, lon, time window and weight, and 50 vehicles each with capacity and work shift, distribute the orders between the vehicles and build an optimal route for each vehicle".

A given client can send tens of such requests per day and sometimes it is useful to look at their requests and understand how they are related to each other in terms of what orders are included in each of the requests. Are they sending the same task over and over again - a sign that they are not satisfied with routes they get and they might need our help in using the API? Are they manually editing the routes (a process that results in more requests to our API, with only the orders from affected routes included)? Or are they solving for several independent order sets and are happy with each individual result?

We can use

supervenn

Rows from bottom to top are requests to our API from earlier to later, represented by their sets of order IDs. We see that they solved a big task at 10:54, were not satisfied with the result, and applied some manual edits until 11:11. Then in the evening they re-solved the whole task twice over, probably with some change in parameters.

Here's a perfect day:

They solved three unrelated tasks and were happy with each (no repeated requests, no manual edits; each order is distributed only once).

And here's a rather extreme example of a client whose scheme of operation involves sending requests to our API every 15-30 minutes to account for live updates on newly created orders and couriers' GPS positions.

Comparison to similar tools

matplotlib-venn

This tool plots area-weighted Venn diagrams with circles for two or three sets. But the problem with circles is that they are pretty useless even in the case of three sets. For example, if one set is symmetrical difference of the other two:

python
from matplotlib_venn import venn3
set_1 = {1, 2, 3, 4}
set_2 = {3, 4, 5}
set_3 = set_1 ^ set_2
venn3([set_1, set_2, set_3], set_colors=['steelblue', 'orange', 'green'], alpha=0.8)

See all that zeros? This image makes little sense. The

supervenn

UpSetR and pyUpSet

This approach, while very powerful, is less visual, as it displays, so to say only statistics about the sets, not the sets in flesh.

pyvenn

This package produces diagrams for up to 6 sets, but they are not in any way proportional. It just has pre-set images for every given sets count, your actual sets only affect the labels that are placed on top of the fixed image, not unlike the banana diagram above.

RainBio (article)

This approach is quite similar to supervenn. I'll let the reader decide which one does the job better:

RainBio:

supervenn:

Thanks to Dr. Bilal Alsallakh for referring me to this work

Linear Diagram Generator

This tool has a similar concept, but only available as a Javascript web app with minimal functionality, and you have to compute all the intersection sizes yourself. Apparently there is also an columns rearrangement algorithm in place, but the target function (number of gaps within sets) is higher than in the diagram made with supervenn.

Thanks to u/aboutscientific for the link.

Credits

This package was created and is maintained by Fedor Indukaev. My username on Gmail and Telegram is the same as on Github.

How can I help?

• If you like supervenn, you can click the star at the top of the page and tell other people about this tool
• If you have an idea or even an implementation of a algorithm for matrix columns rearrangement, I'll be happy to try it, as my current algorithm is quite primitive. (The problem in question is almost the travelling salesman problem in Hamming metric).
• If you are a Python developer, you can help by reviewing the code in any way that is convenient to you.
• If you found a bug or have a feature request, you can submit them via the Issues section.