Time series database

2015-10-10

An answer to this question on Stack Overflow.

Question

several times per day I need to store real time series of data with 0.5s time resolution and max. 1 hour in length. The data are numbers, or array of numbers. The data logging can run simultaneously for several series at one time. There can be tens or max. hundreds of series stored per 1 day. The data will be stored on local PC running the logging application. The application will be written in Python.

In Python I will then plot graphs and compute some analytics from the data.

Can you recommend suitable database for my case?

Answer

I'd start with SQLite3.

It requires very little configuration and is suitable for many purposes.

If you reach the point where you have a lot of data, you might consider switching to PostgreSQL.

This is a tough question to answer well without knowing many more specifics about the scenario. However, the great thing about databases is that it is often possible to switch which database you are using with only minor modifications to the front-end code, which is another reason to start with something relatively simple and light-weight.