An influxdb backend for Graphite-web and graphite-api
An influxdb (0.8-rc5 or higher) backend for Graphite-web (source or 0.10.x) or graphite-api.
THIS PROJECT IS NO LONGER MAINTAINED. CHECK OUT InfluxGraph instead.
Using docker is an easy way to get graphite-api + graphite-influx up and running. See https://github.com/Dieterbe/graphite-api-influxdb-docker which provides a container that has all packages installed to make maximum use of these tools.
Otherwise, follow instructions below. Graphite-api is the simplest to setup, though graphite-web might perform better. You can use the experimental statsd support in graphite-api to have this backend submit performance metrics (not supported with graphite-web)
pip install graphite_influxdb
In the configs below, you'll see that you need to configure the schemas (datapoint resolutions) explicitly. It basically contains the same information as /etc/carbon/storage-schemas.conf would for whisper. But Influxdb currently has no way to supply us this information (yet), so we must configure it explicitly here. Also, it seems like internally, the graphite-web/graphite-api is to configure the step (resolution in seconds) per metric (i.e. per Node/Reader), without looking at the timeframe. I don't know how to deal with this yet (TODO), so for now it's one step per pattern, so we don't need to specify retention timeframes. (In fact, in the code we can assume the data exists from now to -infinity, missing data you query for will just show up as nulls anyway) The schema declares at which interval you should have points in InfluxDB. Schema rules use regex and are processed in order, first match wins. If no rule matches, 60 seconds is used.
You need the patched version from https://github.com/Dieterbe/graphite-api/tarball/support-templates2 This adds support for caching, statsd instrumentation, and graphite-style templates
Note that the elasticsearch stuff is optional, see below
In your graphite-api config file::
finders: - graphite_influxdb.InfluxdbFinder influxdb: host: localhost port: 8086 user: graphite pass: graphite db: graphite ssl: false schema: - ['high-res-metrics', 1] - ['^collectd', 10] es: enabled: false hosts: - elastichost1:9200 index: graphite_metrics2 field: _id
Also enable the cache. memcache doesn't seem to work well because the list of series is too big. filesystem seems to work well::
cache: type: 'filesystem' dir: '/tmp/graphite-api-cache'
Note that the elasticsearch stuff is optional, see below In graphite's
STORAGE_FINDERS = ( 'graphite_influxdb.InfluxdbFinder', ) INFLUXDB_HOST = "localhost" INFLUXDB_PORT = 8086 INFLUXDB_USER = "graphite" INFLUXDB_PASS = "graphite" INFLUXDB_DB = "graphite" INFLUXDB_SSL = "false" INFLUXDB_SCHEMA = [ ('', 60), ('high-res-metrics', 10) ] ES_ENABLED = "false" ES_HOSTS = ['elastichost1:9200'] ES_INDEX = "graphite_metrics2" ES_FIELD = "_id"
If you have an index in elasticsearch that contains all your metric id's, then you can use that as a metadata source. Your mileage may vary, but for me ES is noticeably faster. (see also https://github.com/influxdb/influxdb/issues/884) You just need to install the elasticsearch pip module (comes in the docker image mentioned above) and enable it in the config. If you're wondering how to populate an ES index, you can use graph-explorer structured metrics plugins or carbon-tagger (beware the latter currently only does metrics 2.0 metrics)