Projects/InfluxDB Setup: Difference between revisions
(Created page with "== Goals == * Provide a Database for measurements * Manage memory smartly: ** Allow for high sampling rates e.g. 4 values/second ** Short retention e.g. 1 hour, for high sampl...") |
(→Goals) |
||
| Line 1: | Line 1: | ||
== | == Objective == | ||
* Provide a Database for measurements | * Provide a Database for measurements | ||
* Manage memory smartly: | * Manage memory smartly: | ||
** Allow for high sampling rates e.g. 4 values/second | ** Allow for high sampling rates e.g. 4 values/second | ||
** Short retention e.g. 1 hour | ** Short retention for high sampling rate data e.g. 1 hour | ||
** Multiple levels of automatic down-sampling using aggregation | ** Multiple levels of automatic down-sampling using aggregation with increasing retention for each level | ||
== Retention and Down-Sampling == | == Retention and Down-Sampling == | ||
Revision as of 02:36, 4 June 2016
Objective
- Provide a Database for measurements
- Manage memory smartly:
- Allow for high sampling rates e.g. 4 values/second
- Short retention for high sampling rate data e.g. 1 hour
- Multiple levels of automatic down-sampling using aggregation with increasing retention for each level
Retention and Down-Sampling
| sample rate/aggregate | retention | # of values | InfluxDB Retention and Continuous Query |
|---|---|---|---|
| 0.25 seconds (raw data) | 1 hour | 14400 |
CREATE RETENTION POLICY _1hour ON weather DURATION 1h REPLICATION 1 DEFAULT |
| 5 seconds | 1 day | 17280 |
CREATE RETENTION POLICY _1day ON weather DURATION 1d REPLICATION 1 CREATE CONTINUOUS QUERY CQ_5sec ON weather BEGIN SELECT median(value) as value INTO weather._1day:measurement FROM /^[a-z].*/ GROUP BY time(5s) END |
| 5 minute | 1 month | 8640 |
CREATE RETENTION POLICY _1month ON weather DURATION 30d REPLICATION 1 CREATE CONTINUOUS QUERY CQ_5min ON weather._1day BEGIN SELECT median(value) as value INTO weather._1month:measurement FROM /^[a-z].*/ GROUP BY time(5m) END |
| 30 minute | 1 year | 17280 |
CREATE RETENTION POLICY _1year ON weather DURATION 366d REPLICATION 1 CREATE CONTINUOUS QUERY CQ_30min ON weather._1month BEGIN SELECT median(value) as value INTO weather._1year:measurement FROM /^[a-z].*/ GROUP BY time(30m) END |
| 1 hour | 10 years | 86400 |
CREATE RETENTION POLICY _10year ON weather DURATION 10y REPLICATION 1 CREATE CONTINUOUS QUERY CQ_1hour ON weather._1year BEGIN SELECT median(value) as value INTO weather._10years:measurement FROM /^[a-z].*/ GROUP BY time(1hour) END |
- 144000 measurement, 2.3MB at 16Byte per measurement