Can we retrieve news headlines data if date range exceeds the limits?

Hi,

I have tried to pull the news headline data for the date range 2019-12-25 to 2020-04-25 and the instrument 'AAPL.O'. While taking news data using get_news_headlines function, I see there is a data restriction of 100. At the moment I thought of looping the function call with single date with the assumption of each date may have less than 100 records. But what if a day has more than 100 records? What is the suggested way to get the news data per instrument?

Is there any available there to retrieve all the news headlines data for the given (2019-12-25 to 2020-04-25) date range?

Thank You,

Priya

Find more posts tagged with

python

eikon

workspace

eikon-data-api

refinitiv-dataplatform-eikon

workspace-data-api

Accepted answers

zoya faberov

Hello @priyanka,

It's a good idea to split the request by date.

If you find that on some day you have full 100 headlines returned, you can further split that day by time into 2 half-days

ek.get_news_headlines('R:GOOG.O', date_from='2019-04-01T09:00:00', date_to='2019-04-01T12:00:00')

To be fully sure you do not over-run the limit of 100 and still get all the news per your search criteria.

All comments

zoya faberov

Hello @priyanka,

It's a good idea to split the request by date.

If you find that on some day you have full 100 headlines returned, you can further split that day by time into 2 half-days

ek.get_news_headlines('R:GOOG.O', date_from='2019-04-01T09:00:00', date_to='2019-04-01T12:00:00')

To be fully sure you do not over-run the limit of 100 and still get all the news per your search criteria.

priyanka

Thanks for the reply.

Is there a situation, data fetch for half day return more than 100 ?Also Is there a possibility to have,

i)more than 100 records in 2 hrs

ii)more than 100 records in 1 hr

Do we have any field/ flag to check this ?

Thank You,
Priya

zoya faberov

Hi @priyanka,

News volume goes up and down. We don't "cup" the news. So if you require to be guaranteed to retrieve every item under your search criteria, I would use the programmatic approach in the pattern of binary search. This way, if there was even a huge peak in the number of published, you will retrieve them all.

If you have retrieved less then a hundred, then proceed

If you have retrieved 100, divide the time interval in half and do 2 retrievals, if you retrieve 100 on one of the halfs, divide it in half and retrieve on the two time retrievals.

Once you have retrieved less then 100, the news for the time period are fully retrieved.

Hope this helps?

EXPLORE OUR SITES