Projects/InfluxDB Setup: Difference between revisions

From Playful Exploration
Jump to navigation Jump to search
(Created page with "== Goals == * Provide a Database for measurements * Manage memory smartly: ** Allow for high sampling rates e.g. 4 values/second ** Short retention e.g. 1 hour, for high sampl...")
 
Line 1: Line 1:
== Goals ==
== Objective ==
* Provide a Database for measurements
* Provide a Database for measurements
* Manage memory smartly:
* Manage memory smartly:
** Allow for high sampling rates e.g. 4 values/second
** Allow for high sampling rates e.g. 4 values/second
** Short retention e.g. 1 hour, for high sampling rate data
** Short retention for high sampling rate data e.g. 1 hour
** Multiple levels of automatic down-sampling using aggregation see table below for example
** Multiple levels of automatic down-sampling using aggregation with increasing retention for each level


== Retention and Down-Sampling ==
== Retention and Down-Sampling ==

Revision as of 02:36, 4 June 2016

Objective

  • Provide a Database for measurements
  • Manage memory smartly:
    • Allow for high sampling rates e.g. 4 values/second
    • Short retention for high sampling rate data e.g. 1 hour
    • Multiple levels of automatic down-sampling using aggregation with increasing retention for each level

Retention and Down-Sampling

sample rate/aggregate retention # of values InfluxDB Retention and Continuous Query
0.25 seconds (raw data) 1 hour 14400

CREATE RETENTION POLICY _1hour ON weather DURATION 1h REPLICATION 1 DEFAULT

5 seconds 1 day 17280

CREATE RETENTION POLICY _1day ON weather DURATION 1d REPLICATION 1

CREATE CONTINUOUS QUERY CQ_5sec ON weather BEGIN SELECT median(value) as value INTO weather._1day:measurement FROM /^[a-z].*/ GROUP BY time(5s) END

5 minute 1 month 8640

CREATE RETENTION POLICY _1month ON weather DURATION 30d REPLICATION 1

CREATE CONTINUOUS QUERY CQ_5min ON weather._1day BEGIN SELECT median(value) as value INTO weather._1month:measurement FROM /^[a-z].*/ GROUP BY time(5m) END

30 minute 1 year 17280

CREATE RETENTION POLICY _1year ON weather DURATION 366d REPLICATION 1

CREATE CONTINUOUS QUERY CQ_30min ON weather._1month BEGIN SELECT median(value) as value INTO weather._1year:measurement FROM /^[a-z].*/ GROUP BY time(30m) END

1 hour 10 years 86400

CREATE RETENTION POLICY _10year ON weather DURATION 10y REPLICATION 1

CREATE CONTINUOUS QUERY CQ_1hour ON weather._1year BEGIN SELECT median(value) as value INTO weather._10years:measurement FROM /^[a-z].*/ GROUP BY time(1hour) END

  • 144000 measurement, 2.3MB at 16Byte per measurement