Stack Overflow
Stack Overflow

Questions tagged [sdmx]

Statistical Data and Metadata eXchange

Official site: https://sdmx.org/

Tools

Listed on official site: https://sdmx.org/?page_id=4500

Listed on GitHub: https://github.com/search?utf8=%E2%9C%93&q=sdmx

40 questions
6
votes
3 answers

Reading sdmx-xml files into a dataframe in R

I was wondering if anyone has managed to read SDMX-XML files into a dataframe. The file I’d like to read is https://www.ecb.europa.eu/stats/sdmx/icpf/1/data/pension_funds.xml (1mb). I saved the file as “pensions_funds.xml” to the pwd and tried to…
Aidan
  • 109
  • 1
  • 7
4
votes
2 answers

Australian Bureau of Statistics SDMX timeout issue

I'm trying to download Australian Bureau of Statistics data using pandasdmx. I can download the ERP_COB using SDMX no problem but for ERP by SA2, age and sex I am getting a timeout error. I have limited the time period to 2018 only but am still…
epidemiologistseekshelp
  • 51
  • 5
4
votes
2 answers

Statistical Data and Metadata eXchange (SDMX)

I stuck myself in SDMX, Since i am not found enough resources to study(programming code) about SDMX. Like:- Creating structure Reading Structure Writing data .. etc Yes there are some guideline in its personal website,But those are not enough…
Kanhu Bhol
  • 440
  • 3
  • 20
2
votes
1 answer

Plotting SDMX with PANDAS or plot

What's the easiest way to plot SDMX data with PANDAS or Plotly? I have the following code: import pandasdmx as sdmx import plotly.express as px df = sdmx.Request('OECD').data( resource_id='MEI_FIN', key='IR3TIB.GBR+USA.M', …
nonamednono
  • 37
  • 3
2
votes
2 answers

Most efficient way of converting RESTful output to dataframe

I have output from a REST call that I've converted to JSON. It's a highly nested collection of dicts and lists, but I'm eventually able to convert it to dataframe as follows: import panads as pd from requests import get url =…
Chris
  • 1,263
  • 2
  • 14
  • 27
2
votes
0 answers

Does .Stat Suite support SDMX version 2.1

FAQ page says https://siscc.org/faq/ The .Stat Suite is a native SDMX solution, supporting a complete end to end flow. It can consume, manage, and export SDMX 2.1 in SDMX-JSON, SDMX-ML, and SDMX-CSV formats. While checking some of the latest…
demonno
  • 494
  • 5
  • 14
2
votes
2 answers

pandas data mining from Eurostat

I'm starting a work to analyse data from Stats Institutions like Eurostat using python, and so pandas. I found out there are two methods to get data from Eurostat. pandas_datareader: it seems very easy to use but I found some problems to get some…
SPS
  • 315
  • 7
  • 22
2
votes
1 answer

Encoding lost when reading XML in R

I am retrieving online XML data using the XML R packages. My issue is that the UTF-8 encoding is lost during the call to xmlToList : for instance, 'é' are replaced by 'é'. This happens during the XML parsing. Here is a code snippet, with an…
jlesuffleur
  • 1,063
  • 7
  • 17
2
votes
1 answer

Error importing SDMX data into R

The problem happens when I am trying to import OECD data. For example, if I try the following code: library(rsdmx) data.url <-…
Gustavo
  • 53
  • 3
2
votes
2 answers

Reading SDMX in R - parse error?

I've been trying to develop a shiny app in R with INEGI (mexican statistics agency) data through their recently initiated SDMX service. I went as far a contacting the developers themselves and they gave me the following, unworkable, code:…
eflores89
  • 277
  • 1
  • 8
  • 23
1
vote
0 answers

Read SDMX into a Dataframe R

I am struggling with using readSDMX into a dataframe. My code is below, along with the error. Any help on this would be greatly appreciated. This is my first time using the RSDMX library, so pretty new to this.Thanks in advance! tmp <-…
akennedy12345
  • 11
  • 4
1
vote
1 answer

XML SDMX reading in python

Im strugling to read SDMX XML file with python from below links: https://www.newyorkfed.org/xml/fedfunds.html or direct Ideally i would like to get fund rates into dataframe but i was trying to use pandasdmx which doesnt seem to work with this…
Drac0
  • 89
  • 1
  • 1
  • 12
1
vote
0 answers

SDMX-Json Parsing - No Time_Period problem - OECD Dataset python extract

I am using the python library pandaSDMX to extract entire datasets from the OECD database, and convert them to a CSV format (any readable format would be OK, because I want to put the final output in an SQL database). To have access to a OECD…
João Conde Pereira
  • 11
  • 2
1
vote
1 answer

How to read IMF xls- or sdmx-data from url?

From the IMF I want to read a .xls file from an URL directly into R, but all attempts fail so far. Weirdly, I can download the file manually or by download.file() and open it without problems in Microsoft Outlook or in a text editor. However, even…
jay.sf
  • 33,483
  • 5
  • 39
  • 75
1
vote
0 answers

Using Python / pandaSDMX to process & upload to Postgresql

I am seeking a way to take SDMX files (like here: http://www12.statcan.gc.ca/datasets/Alternative.cfm?PID=105929&EXT=SDMX) and process them into a Postgresql table. I can use rsdmx (https://cran.r-project.org/web/packages/rsdmx/index.html) for…
Gordon
  • 11
  • 1
1
2 3