Delete stale data.
You may not need to save millions or billions of data points forever. Once time series data is aggregated, you may want to automatically delete unneeded data from the database. Riak TS provides automatic Global Object Expiration that is easy to configure. This ensures you don’t have to manually delete aged data.
With Riak TS, you can expire data at a cluster level. You specify a TTL (time to live) for all objects in the cluster.
TIME SERIES DATA NEEDS AUTOMATIC DATA DELETION
Riak TS offers built-in Global Object Expiration to delete aged data that is no longer needed. Global Object Expiration in Riak TS provides cluster-wide expiry and includes:
- The ability to set TTL (time to live) so that all data written before the “expiry_minutes” setting is automatically expired and won’t be returned in queries.
- The ability to define the expiration mode.
You can enable and configure Global Object Expiration by turning expiration on and by specifying a time interval in seconds, minutes, hours, etc.
Riak TS uses the LevelDB storage engine to optimize the storage and deletion of objects. To set automatic expiration in LevelDB, use the retention_time setting. In the following example, objects are configured to expire after 8 days and 9 hours:
leveldb.expiration = on leveldb.expiration.retention_time = 8d9h
See the Riak TS documentation for the specific details on how to “configure global object expiration.”
BENEFITS OF GLOBAL OBJECT EXPIRATION
IoT and time series data may grow faster than other data. As data ages, it may no longer be needed. Riak TS enables you to delete aging data to maximize the efficiency of your application.
Reduce operational costs
By automatically deleting data based on policy, you eliminate the need to continuously increase storage and can reclaim space. This means less storage to manage and no need to manually delete data.
Increase performance and scale
Eliminating unwanted or unneeded data keeps your database lean and operationally efficient.
Manage massive amounts of data
Managing data, including deleting unwanted data, makes it easier for your application to support thousands or even millions of IoT devices or time series data feeds.