Questions tagged [historical-db]

is for databases that store data in historical tables usually containing a timestamp and a value for each record (with a few ancillary fields), in a non-relational way.

Historical-DB is for databases that store historical data in tables usually containing a timestamp and a value for each record (with a few ancillary fields). They are used in historian applications, and can usually be queried with SQL, even though they are not relational databases.

Some Examples:

45 questions
13
votes
6 answers

Technological solutions for extremely long term data archiving?

Are there any good technical solutions for extremely long term archiving of data, for example for 25 to 100 years? Somehow I just don't have a lot of confidence that a SQL 2000 backup file will be usable in court cases or for historians in 25 to 100…
MatthewMartin
  • 29,993
  • 30
  • 102
  • 160
3
votes
2 answers

Yahoo Finance ValueError: zero-size array to reduction operation maximum which has no identity

I have been trying to pull data from Yahoo Finance and I keep getting this strange error. So I run this code : #Importing Modules/Libraries import pandas as pd pd.core.common.is_list_like = pd.api.types.is_list_like from pandas_datareader import…
3
votes
4 answers

Getting Stock Historical Data from API for a python project

I am making a stock analysis program, but for that, I need the NYSE stock historical data API. I have searched everywhere, but could not find helpful solutions (i.e. Yahoo/Google Finance APIs are down). I tried the Alpha Vantage API, but it did not…
ShadyAF
  • 67
  • 1
  • 1
  • 8
3
votes
1 answer

Python: How to set ticker in krakenex for fetching historical OHLC-data?

I am trying to load OHLC-data form Kraken with the API krakenex for my research project. But I can't figure out my mistake. I am using a modified version of https://github.com/veox/python3-krakenex/blob/master/examples/trades-history.py in python…
2
votes
0 answers

Historical data ingestion and querying in Time Series Insights

We're evaluating Azure Time Series Insights (Preview) for ingesting historical IoT telemetry data. We use device timestamp instead of event enqueued timestamp as Timestamp property (Non-default behavior) We've hit a snag around ingesting historical…
2
votes
2 answers

How to store historical data using Django

I am new to Django and am trying to figure out how to store historical data and be able to reference any data point from a date in the past. Say I want to store data on a kids height change as he grows and be able to compare his height at day 400 to…
O. Davis
  • 53
  • 4
2
votes
1 answer

Retaining volatile data in orders

Lets assume I have tables: customers and orders, I'd like to store order with unchangeable customer information (like address, name etc.) but do not want to copy all this information to orders table. There are three options: a) Mapping table for…
ololoken
  • 58
  • 4
1
vote
2 answers

Reporting on historical data - when to use current or historic data (warn user about changing the meaning of a record?)

This is similar to this question Basically I am writing the database and software for a building monitoring system. The system monitors things like temperature, humidity, pressure of units (such as fridges). When a report is generated for a…
Mark
  • 1,216
  • 13
  • 27
1
vote
2 answers

How to store historical server data?

I was looking for advice on how to store data in a database for historical data mining purposes. If I can get the state of an entity at a given time, what is the best way to store it so that I can historically mine that data, predicting what the…
s73v3r
  • 1,651
  • 2
  • 21
  • 46
1
vote
1 answer

For Cassandra, how should the historical data be taken care of?

Say I have a dozen CF/SCF and have the write traffic keeps coming (might have spikes). Over the time, a few of them will growing much faster (due to their own nature) than others and data table could be huge. At that stage, should they still be…
tom
  • 13,143
  • 18
  • 63
  • 120
1
vote
1 answer

SOLVED Django historical records not showing up in admin

I am setting historical record for some of my models. It works, the table is created and behaves as expected, however, I can not get it to appear in my admin tables. models.py class Test(models.Model): ... history = HistoricalRecords() In…
yoarch
  • 21
  • 6
1
vote
0 answers

Temporal table like functionality for SQL server 2014 or older version

Is it possible to create temporal table kind of a functionality to keep history of frequently changing records in SQL server 2014 or older versions. I need to track historical changes in a table (E.g, part X was out of stock for Y number of days in…
1
vote
0 answers

update data store as historical for every single day separately with postgresql python

I've seen many kinds of answer for especially postgresql such like: Store value history in PostgreSQL Setting up Cygnus-PostgreSQL for historical data…
Prosenjit
  • 125
  • 2
  • 11
1
vote
1 answer

PI historical database SDK resources

I'm looking for any third-party resources for programming the OSIsoft PI historical database SDK. Websites, books, etc. I already have what OSIsoft puts out.
Lance Roberts
  • 21,279
  • 29
  • 106
  • 128
1
vote
0 answers

Database Triggers vs Controller Triggers

I have a table that I expose to users for edition on a rails website. This table needs to have a way to keep track of changes and at the same time needs to be available for reporting purposes. I ditched triggers for this functionality because they…
Pedro Montoto García
  • 1,630
  • 2
  • 18
  • 35
1
2 3