DSS REST API - Timeout during extraction request

Hi Team,
My client from Baader Bank AG is facing timeouts when utilizing Immediate extractions via DSS Rest API and would like to know if his request should be changed and/or can be optimized. Hopefully you can have a look and comment:
"
What the current flow of application is looking like:
1. We are collecting the array of instruments (ISINs and MICs) from our data, for which i need to resolve the prices.
2. I am querying datascope.refinitiv.com/RestApi/v1/Search/HistoricalBulkSearch API for bulk ric resolution. To do this, i am mapping MIC to MEC using fixed mapping table on my side. RIC resolution works like a charm, thank you for the hint, btw.
3. After we have a bundle of RICs, for which i need prices extracted, i am creating instrument list using datascope.refinitiv.com/RestApi/v1/Extractions/InstrumentLists
4. I am filling the created instrument list with collected instruments.
5. After all instruments are in the list, i am creating immediate extraction request. Here are the example request details:
curl --location 'https://selectapi.datascope.refinitiv.com/RestApi/v1/Extractions/ExtractRaw' \
--header 'Prefer: respond-async' \
--header 'Content-Type: application/json' \
--header 'Authorization: Token _HTE3~~~~1v9U' \
--data-raw '{
"ExtractionRequest": {
"@odata.type":
"#DataScope.Select.Api.Extractions.ExtractionRequests.TickHistoryIntradaySummariesExtractionRequest",
"ContentFieldNames": [
"High Ask",
"High Bid",
"Low Ask",
"Low Bid",
"No. Asks",
"No. Bids",
"No. Trades"
],
"IdentifierList": {
"@odata.type": "#DataScope.Select.Api.Extractions.ExtractionRequests.InstrumentListIdentifierList",
"InstrumentListId": "0x08adcfb6f0f934d2"
},
"Condition": {
"MessageTimeStampIn": "GmtUtc",
"ReportDateRangeType": "Range",
"QueryStartDate": "2023-10-26T13:00:00.000-00:00",
"QueryEndDate": "2023-10-26T14:00:00.000-00:00",
"SummaryInterval": "OneMinute",
"TimebarPersistence": true,
"DisplaySourceRIC": true
}
}
}'
Here where the problem starts. Even if I'm using list of 2 instruments, and small query window, this request takes 60 - 100 seconds to get the response with extraction id. Sometimes it takes 120+ seconds. (But, if there are errors in request body, response is received immediately). Because of that, we often getting timeouts and need to retry.
Is this expected behavior?... Looks strange for async request. Maybe some recommendations/workarounds possible? "
Best Answer
-
Thank you for reaching out to us.
I think it is timeout in the application, not in Tick History REST API.
According to the information, it is an expected behavior.
As far as I know, the API doesn't guarantee that the extraction must be completed within the finite time. There are many factors that may impact extraction, such as current active requests, server load, number of items, number of fields, and number of extracted data.
After sending the request, the application must check the HTTP status of the returned response.
If the HTTP status of the returned resposne is 202, it means that the extraction is in-progress and the API will provide the polling URL in the response's header (Location). The client needs to use this URL to poll for the data.
If the HTTP status of the returned resposne is 200, it means that the extraction is completed and the data is available to download.
For more information, please refer to the REST API Tutorial 6: On Demand intraday bars extraction tutorial.
However, if the application sends a new extraction request while the previous extraction request is in-progress, the extraction requests may overwhelm the server and all extraction requests may be delayed.
0
Categories
- All Categories
- 6 AHS
- 36 Alpha
- 166 App Studio
- 6 Block Chain
- 4 Bot Platform
- 18 Connected Risk APIs
- 47 Data Fusion
- 33 Data Model Discovery
- 682 Datastream
- 1.4K DSS
- 613 Eikon COM
- 5.2K Eikon Data APIs
- 10 Electronic Trading
- Generic FIX
- 7 Local Bank Node API
- 3 Trading API
- 2.9K Elektron
- 1.4K EMA
- 248 ETA
- 552 WebSocket API
- 37 FX Venues
- 14 FX Market Data
- 1 FX Post Trade
- 1 FX Trading - Matching
- 12 FX Trading – RFQ Maker
- 5 Intelligent Tagging
- 2 Legal One
- 23 Messenger Bot
- 2 Messenger Side by Side
- 9 ONESOURCE
- 7 Indirect Tax
- 60 Open Calais
- 275 Open PermID
- 44 Entity Search
- 2 Org ID
- 1 PAM
- PAM - Logging
- 6 Product Insight
- Project Tracking
- ProView
- ProView Internal
- 22 RDMS
- 1.8K Refinitiv Data Platform
- 622 Refinitiv Data Platform Libraries
- 4 LSEG Due Diligence
- LSEG Due Diligence Portal API
- 4 Refinitiv Due Dilligence Centre
- Rose's Space
- 1.2K Screening
- 18 Qual-ID API
- 13 Screening Deployed
- 23 Screening Online
- 12 World-Check Customer Risk Screener
- 1K World-Check One
- 46 World-Check One Zero Footprint
- 45 Side by Side Integration API
- 2 Test Space
- 3 Thomson One Smart
- 10 TR Knowledge Graph
- 151 Transactions
- 143 REDI API
- 1.8K TREP APIs
- 4 CAT
- 26 DACS Station
- 121 Open DACS
- 1.1K RFA
- 104 UPA
- 191 TREP Infrastructure
- 228 TRKD
- 915 TRTH
- 5 Velocity Analytics
- 9 Wealth Management Web Services
- 83 Workspace SDK
- 11 Element Framework
- 5 Grid
- 18 World-Check Data File
- 1 Yield Book Analytics
- 46 中文论坛