sybil

by logv

logv / sybil

columnar storage + NoSQL OLAP engine | https://logv.org

217 Stars 21 Forks Last release: over 2 years ago (0.5.1) Other 496 Commits 12 Releases

Available items

No Items, yet!

The developer of this repository has not created any items for sale yet. Need a bug fixed? Help with integration? A different license? Create a request here:

Sybil is an append only analytics datastore with no up front table schema requirements; just log JSON records to a table and run queries. Written in Go, sybil is designed for fast full table scans of multi-dimensional data on one or more machines.

more documentation is available on the wiki and in the repo.

if sybil by itself is uninteresting (who wants to run command line queries, anyways?), sybil is a supported backend for snorkel

advantages

  • Easy to setup and get data inside sybil - just pipe JSON on stdin to sybil
  • Supports histograms (and percentiles), standard deviations and time series roll ups
  • Runs fast full table queries (performance notes)
  • Lower disk usage through per column compression schemes
  • Serverless design with controlled memory usage
  • Per table retention policies (specify max age and/or size of tables)
  • Timestamp resistant query cache (optional) that avoids recomputation

disadvantages

  • JOINS not supported
  • No UPDATE operation on data - only writes

installation

go get github.com/logv/sybil

build status

CircleCI

additional information

We use cookies. If you continue to browse the site, you agree to the use of cookies. For more information on our use of cookies please see our Privacy Policy.