Error while attempting to download bulk news data

I have a python script to down load news data using this function
response = news.headlines.Definition(ric, date_from=start, date_to=end, count=999999).get_data()
I am attempting to down load bulk data for a list of 600 RICs by passing one RIC at a time into the function above. About 20 RICS in I get the following error.
What is the cause of this and how do I solve for it?
---------------------------------------------------------------------------LDError Traceback (most recent call last)Cell In[3], line 29 26 pbar2.set_postfix({"status": f"querying {year}"}) 27 pbar2.refresh()---> 29 response = news.headlines.Definition(ric, date_from=start, date_to=end, count=999999).get_data() 31 count = 0 33 # Handle both response formatsFile c:\Users\mwu\miniconda3\envs\prodigal_env\Lib\site-packages\lseg\data\content\news\headlines\_definition.py:104, in Definition.get_data(self, session, on_page_response) 72 """ 73 Returns a response from the API to the library 74 (...) 101 >>> response = definition.get_data() 102 """ 103 self._kwargs["on_page_response"] = on_page_response--> 104 return super().get_data(session)File c:\Users\mwu\miniconda3\envs\prodigal_env\Lib\site-packages\lseg\data\content\news\_news_data_provider_layer.py:13, in NewsDataProviderLayer.get_data(self, session) 11 def get_data(self, session: Optional["Session"] = None): 12 session = get_valid_session(session)---> 13 response = super().get_data(session) 14 return response... 29 error = LDError(code=error_code, message=error_message) 31 error.response = response---> 32 raise errorLDError: Error code 429 | Too many requests, please try again later.
Answers
-
Thank you for reaching out to us.
The 429 error indicates that the application exceeds the API limitations.
This news endpoint is typically not intended for bulk downloads. For alternative solutions to support this use case, please contact your LSEG account team or sales representative directly.
0 -
Hello @Xim_O
Please refer to the Usage and Limits Guideline document.
0 -
Is there a way to workout how close on the day you are to the data limit?
0 -
Hello @Xim_O
Unfortunately, the API does not have this functionality. Please contact your LSEG Representative or Account Manager to help you with the data monitoring.
0
Categories
- All Categories
- 3 Polls
- 6 AHS
- 37 Alpha
- 167 App Studio
- 6 Block Chain
- 4 Bot Platform
- 18 Connected Risk APIs
- 47 Data Fusion
- 34 Data Model Discovery
- 707 Datastream
- 1.5K DSS
- 633 Eikon COM
- 5.2K Eikon Data APIs
- 14 Electronic Trading
- 1 Generic FIX
- 7 Local Bank Node API
- 6 Trading API
- 3K Elektron
- 1.5K EMA
- 259 ETA
- 570 WebSocket API
- 40 FX Venues
- 16 FX Market Data
- 1 FX Post Trade
- 1 FX Trading - Matching
- 12 FX Trading – RFQ Maker
- 5 Intelligent Tagging
- 2 Legal One
- 25 Messenger Bot
- 4 Messenger Side by Side
- 9 ONESOURCE
- 7 Indirect Tax
- 60 Open Calais
- 284 Open PermID
- 47 Entity Search
- 2 Org ID
- 1 PAM
- PAM - Logging
- 6 Product Insight
- Project Tracking
- ProView
- ProView Internal
- 24 RDMS
- 2.2K Refinitiv Data Platform
- 890 Refinitiv Data Platform Libraries
- 5 LSEG Due Diligence
- 1 LSEG Due Diligence Portal API
- 4 Refinitiv Due Dilligence Centre
- Rose's Space
- 1.2K Screening
- 18 Qual-ID API
- 13 Screening Deployed
- 23 Screening Online
- 12 World-Check Customer Risk Screener
- 1K World-Check One
- 46 World-Check One Zero Footprint
- 45 Side by Side Integration API
- 2 Test Space
- 3 Thomson One Smart
- 10 TR Knowledge Graph
- 151 Transactions
- 143 REDI API
- 1.8K TREP APIs
- 4 CAT
- 27 DACS Station
- 124 Open DACS
- 1.1K RFA
- 108 UPA
- 196 TREP Infrastructure
- 232 TRKD
- 920 TRTH
- 5 Velocity Analytics
- 9 Wealth Management Web Services
- 105 Workspace SDK
- 11 Element Framework
- 5 Grid
- 19 World-Check Data File
- 1 Yield Book Analytics
- 48 中文论坛