For a deeper look into our Eikon Data API, look into:

Overview |  Quickstart |  Documentation |  Downloads |  Tutorials |  Articles

question

Upvotes
1 0 0 1

missing EIA data

eikon API

get_timeseries

Python

Executing this python code, I'm trying to get EIA data starting 2015 but only get it populated starting 4/21/2021. There seems to be missing data. Could you pls fix?


fname = "RICList.csv"
riclist_df = pd.read_csv(pricespath+fname)
riclist = riclist_df["RIC"].tolist()
df_wklies = ek.get_timeseries(riclist, 'close',
                         start_date = '2015-01-01',
                         end_date = today)
df_wklies.to_csv(pricespath + "US_weeklies.csv")


RICREFCR-1-EIAREFCO-1-EIADST-OUT-1-EIAJET-OUT-1-EIADST-STK-1-EIAJET-STK-1-EIADST-IMP-1-EIAJET-IMP-1-EIADST-EXP-T-EIAJET-EXP-T-EIADST-DEL-T-EIAJET-DEL-T-EIAREFCR-2-EIAREFCO-2-EIADST-OUT-2-EIAJET-OUT-2-EIADST-STK-2-EIAJET-STK-2-EIAREFCR-3-EIAREFCO-3-EIADST-OUT-3-EIAJET-OUT-3-EIADST-STK-3-EIAJET-STK-3-EIAREFCR-4-EIAREFCO-4-EIADST-OUT-4-EIAJET-OUT-4-EIADST-STK-4-EIAJET-STK-4-EIAREFCR-5-EIAREFCO-5-EIADST-OUT-5-EIAJET-OUT-5-EIADST-STK-5-EIAJET-STK-5-EIADST-IMP-5-EIAJET-IMP-5-EIA
eikon
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
12k 59 39 61

Hi @julien.granger

Here is one where I do see all the history:

ek.get_timeseries("REFCR-1-EIA", 'close',
                  start_date = '2015-01-01', 
                  end_date='2022-08-05')

ahs.png

Does the above fail for you?


ahs.png (11.9 KiB)
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
1 0 0 1

Thank you. The RIC list is below. I think that some of the RICs have missing data and therefore the get_timeseries gets truncated at 4/21/22. Can you try querying for all those RICs at one time and see if you get everything starting at 1/1/2015?

  • REFCR-1-EIA
  • REFCO-1-EIA
  • DST-OUT-1-EIA
  • JET-OUT-1-EIA
  • DST-STK-1-EIA
  • JET-STK-1-EIA
  • DST-IMP-1-EIA
  • JET-IMP-1-EIA
  • DST-EXP-T-EIA
  • JET-EXP-T-EIA
  • DST-DEL-T-EIA
  • JET-DEL-T-EIA
  • REFCR-2-EIA
  • REFCO-2-EIA
  • DST-OUT-2-EIA
  • JET-OUT-2-EIA
  • DST-STK-2-EIA
  • JET-STK-2-EIA
  • REFCR-3-EIA
  • REFCO-3-EIA
  • DST-OUT-3-EIA
  • JET-OUT-3-EIA
  • DST-STK-3-EIA
  • JET-STK-3-EIA
  • REFCR-4-EIA
  • REFCO-4-EIA
  • DST-OUT-4-EIA
  • JET-OUT-4-EIA
  • DST-STK-4-EIA
  • JET-STK-4-EIA
  • REFCR-5-EIA
  • REFCO-5-EIA
  • DST-OUT-5-EIA
  • JET-OUT-5-EIA
  • DST-STK-5-EIA
  • JET-STK-5-EIA
  • DST-IMP-5-EIA
  • JET-IMP-5-EIA
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
12k 59 39 61

Hi @julien.granger

The reason it appears like you are receiving missing data is because you have hit the limit for a single request using get_timeseries(). According to the Eikon Data API Usage and Limits Guideline, the get_timeseries() has a limit of 3000 data points per request.

  • get_timeseries: The current limit value (10-Oct-2019) is 3,000 data points (rows) for interday intervals and 50,000 data points for intraday intervals. This limit applies to the whole request, whatever the number of requested instrument.

As a result, the server is truncating the results. You will have to break your list into bundles to avoid this limit.

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.