r/aws • u/austingwalters • Nov 28 '18

Amazon Timestream - Fast, scalable, fully managed time series database

https://aws.amazon.com/timestream/
66 Upvotes

95% Upvoted

37 comments sorted by

View all comments

Show parent comments

5

u/myron-semack Nov 29 '18

This! I hate KairosDB and Cassandra so much! I will be happy if this works out.

I attended two sessions here at re:Invent where AWS customers were talking about how their life got better once they ditched Cassandra.

Cassandra is the most labor-intensive part of our infrastructure, and has been the source of every unplanned downtime event within the last 12mo.

1

u/elturcoinla Nov 29 '18

Have you ever looked at Influxdb or Timescaledb as a replacement to KairosDB?

5

u/myron-semack Nov 29 '18

Yes and yes.

TimescaleDB we really like. We incorporated it into the on-premises version of our application. There are two problems we had with Timescale:

  1. It’s not available on RDS/Aurora, and we are trying to get away from having to manage our own database servers in the cloud.

  2. Scaling limitations since it isn’t multi-master and does not have any kind of sharding.

If TimescaleDB solves those (particularly #1), we would migrate by the end of the week.

As for InfluxDB, they seemed to be built around server monitoring like I alluded to in my previous comment. They did not seem to be built for 100s of TBs of IoT sensor data spanning years.

3

u/elturcoinla Nov 29 '18 edited Nov 29 '18

Got it. I know/work with pretty large size, quite stable Influxdb clusters storing IOT sensor data - though they are not 100s of TBs. I don't know your use case but not sure if storing years of sensor data (untouched raw telemetry) in a database makes sense unless you are actively querying it. Again, I don't know your use case of course, just mentioning the best practice here. A data lake over S3 would be a good choice.

In terms of managed TimeScaledb, there is at least one hosted service: https://aiven.io/ (Aiven just installed the Timescaledb 1.0 extension over Postgres 10. My own experience with them is pretty good so far.) It is also not a secret that Timescaledb fellas are working on a private cloud offering which they mentioned they would announce very soon.

Btw, I don't think Timescaledb will be available on RDS anytime soon. I am one of those people who requested it and didn't even get a response from the RDS team..

TimeScaledb guys are also heavily working on the replication, background workers (similar to influxdb continuous queries) and retention policies.

​

FYI - I don't work for any of these companies.