Download News Article Headlines over a longer period

Thesis1231

Hi all,

I couldn't find a post with a similar question.

I am trying to download news article headlines from Refinitv Workspace from the module called 'NEWS2.0', where I filter for 'Government / Politics [POL]' and English. Moreover, for content type I only select 'News Feeds'. I know I can copy the headlines that are shown on my screen, but because I need to collect headlines for a period of 10 years, this is almost impossible. I am still investigating narrowing down the news sources to reduce the number of headlines, however I think downloading everything manually is still not an option.

I read something on using a Python API, but I only have experience with coding in R, thus I have not been able to work this it out yet.

Is there anyone with solutions/alternatives to tackle this problem? Or some good tips on how to start with the Python API?

Thanks in advance.

raksina.samasiri

Hi @Thesis1231 ,

You can check the related resources including overview, quickstart guide, documentation of the data library at this API page https://developers.lseg.com/en/api-catalog/lseg-data-platform/lseg-data-library-for-python .

However, please check the Usage and limit guideline in https://developers.lseg.com/en/api-catalog/lseg-data-platform/lseg-data-library-for-python/documentation .

• news.get_headlines: There is no current limit value other than the aggregate data limit (see the daily limits detailed below) (14-04-2024). The depth of history is 15 month.

You may need to consider anoother product to retrieve a wider range of historical news.

Thesis1231

https://community.developers.refinitiv.com/discussion/comment/125379#Comment_125379

Hi @raksina.samasiri,

Thank you for your reply.

'The depth of history is 15 month', does this mean that I can only download 15 months worth of headlines at once (so multiple downloads of 15 months each would work to get to 10 years) or does this mean that it is not possible to go further into the past than the 15 months from now? Because in the module in Refinitiv Workspace, I can see headlines from e.g. 2015.

Do you know another product to retrieve a wider range of historical news?

Thanks for your help!

Jirapongse

https://community.developers.refinitiv.com/discussion/comment/125398#Comment_125398

@Thesis1231

This means that it is not possible to go further into the past than the 15 months from now.

For other products, it could be Machine Readable News History.

Please contact your LSEG account team or Sales team directly regarding the current news solutions.