Case 14545631: Why are we missing trade data for <.OQ> RICs?
Hi Team - I have download the Raw data for 28 Feb 2025 but in manifest file we can see the data is download. After download the I unzip the using command..
gunzip trth_20250228_eod.gz after unzip the command, I run the below command
onetick@tstcapp008:/apps/OMD/raw_data/equity_tr/eod_raw> cat trth_20250228_eod | grep -i ABCL.0Q | grep -i trade | we -l
0
onetick@tstcapp008:/apps/OMD/raw_data/equity_tr/eod_raw> cat trth_20250228_eod.old | grep -i ABCL.0Q | grep - i trade | we - l
0
I already raised the request on LSEG Support and whole email chain with case id is present.
Can you please answer it while we are able to load as well as see the data after downloading the data from datascope?
Answers
-
Thank you for reaching to us.
The RIC name should be ABCL.OQ. It is the 'O' character. However, the item that you used in the grep command is ABCL.0Q. It is the zero (0) character, not the 'O' character.
You may use the Extraction ID to check the size of the downloaded file.
Extraction ID: 2000000879815096
The endpoint is:
https://selectapi.datascope.refinitiv.com/RestApi/v1/Extractions/ReportExtractions('2000000879815096')/Files
This endpoint will return the files' information including file sizes. For example:
{
"ExtractedFileId": "VjF8MHgwOTU1OTU2Y2RiYWFmNmQ5fA",
"ReportExtractionId": "2000000891162848",
"ScheduleId": "0x0956e7e72e8af95b",
"FileType": "Full",
"ExtractedFileName": "_OnD_0x0956e7e72e8af95b.csv",
"LastWriteTimeUtc": "2025-04-04T05:28:00.546Z",
"ContentsExists": true,
"Size": 446,
"ReceivedDateUtc": "2025-04-04T05:28:00.576Z"
},0 -
My apology for spell mistake, please see the snippet below I used the correct character while checking it..
0 -
The output shows that some files have data for ABCL.OQ.
I don't have permission to access other extractions. You may need to record the Notes and downloaded file sizes.
I can check the request message. Please share the request message you are using. I can test it and verify if the data contains ABCL.OQ.
0 -
Typically, you need to download gzip files and then uncompress them on the machine.
If you download the files with the auto decompression feature, the content may be incomplete.
0 -
We uncompress it on our machine we didn't use any auto decompression feature.
when you say "Please share the request message you are using". what does it mean?
you meant to say manifestation file?0 -
It is a request body message sent to the Extractions/ExtractRaw endpoint. For example:
0 -
We don't use any template to download the data.. we download the whole raw data..
Below is the extraction summary logs
0 -
You need to send an on-demand request to extract data. Please check the Tick History Tutorials.
Did you compare the downloaded file size and the file size from this endpoint?
https://selectapi.datascope.refinitiv.com/RestApi/v1/Extractions/ReportExtractions('2000000879815096')/Files
0 -
Hi @Jirapongse
We do send on-demand requests to extract data from Data Scope. Unfortunately, we don't have the file needed to compare the data for February 28th.
Just curious to know - What we are trying to check here from file size?
0 -
I need to make sure the downloaded file size is equal to the file size shows in the endpoint.
https://selectapi.datascope.refinitiv.com/RestApi/v1/Extractions/ReportExtractions('2000000879815096')/Files
If they are equal, you need to contact the product team to verify it.
0 -
Before created the ticket here, I contacted with the product team, please find the below…
Hi Navneet,
With regards to your follow up questions, I would like to highlight that Job ID is basically extraction ID (alphanumeric code) which we get when the output data is ready. And using this Job ID, we can run a API request to download the output data. Whenever there are any issues with the Tick History extractions, we usually ask the notes file which includes the JOB ID. This Job id helps our development team to investigate at the backend if there were some issues with the extractions. However with regards to your issue, I dont think the Job id is an issue here as you were able to download the data correctly and even the notes file says that the request was completed successfully. And you are observing the issue only when you try to run command on the downloaded data, you are unable to get the trade updates on some of the RICs including RIC <ABCL.OQ>. I have further checked this internally with my team and would like to let you know that our team will be able to assist only if there are any issues with the extraction or the output data. But here since the extraction is completed successfully and output data is also available, we will not be able to assist further as the issue could be with your command on how you run a request on the downloaded data. To add further, when we do a extraction for RIC <ABCL.OQ> for 28th Feb 2025, I was able to get the same count of records (35465) in my notes file as seen in your notes file. And when I open the downloaded data, I could see trade updates
for RIC <ABCL.OQ>. Below screenshot for your reference: Details from my notes file:Details from your notes file:
This indicates that there is no issue in the data or the extraction. I would suggest you to post this query on our developer portal in Q&A section where one of our developers would review your command used to query the downloads and provide inputs on why trade updates were not available or would help to amend the details in your command. LSEG Tick History - REST API | Devportal Kindly let me know if you have any additional questions.
Regards,Shyamala KLead Specialist - Tick HistoryLSEG
Thanks
Navneet Arya0 -
That is why I asked for the on-demand request that you are using and the file size's checking.
0
Categories
- All Categories
- 3 Polls
- 6 AHS
- 36 Alpha
- 166 App Studio
- 6 Block Chain
- 4 Bot Platform
- 18 Connected Risk APIs
- 47 Data Fusion
- 34 Data Model Discovery
- 684 Datastream
- 1.4K DSS
- 614 Eikon COM
- 5.2K Eikon Data APIs
- 10 Electronic Trading
- Generic FIX
- 7 Local Bank Node API
- 3 Trading API
- 2.9K Elektron
- 1.4K EMA
- 248 ETA
- 552 WebSocket API
- 37 FX Venues
- 14 FX Market Data
- 1 FX Post Trade
- 1 FX Trading - Matching
- 12 FX Trading – RFQ Maker
- 5 Intelligent Tagging
- 2 Legal One
- 23 Messenger Bot
- 3 Messenger Side by Side
- 9 ONESOURCE
- 7 Indirect Tax
- 60 Open Calais
- 275 Open PermID
- 44 Entity Search
- 2 Org ID
- 1 PAM
- PAM - Logging
- 6 Product Insight
- Project Tracking
- ProView
- ProView Internal
- 22 RDMS
- 1.9K Refinitiv Data Platform
- 639 Refinitiv Data Platform Libraries
- 4 LSEG Due Diligence
- LSEG Due Diligence Portal API
- 4 Refinitiv Due Dilligence Centre
- Rose's Space
- 1.2K Screening
- 18 Qual-ID API
- 13 Screening Deployed
- 23 Screening Online
- 12 World-Check Customer Risk Screener
- 1K World-Check One
- 46 World-Check One Zero Footprint
- 45 Side by Side Integration API
- 2 Test Space
- 3 Thomson One Smart
- 10 TR Knowledge Graph
- 151 Transactions
- 143 REDI API
- 1.8K TREP APIs
- 4 CAT
- 26 DACS Station
- 121 Open DACS
- 1.1K RFA
- 104 UPA
- 191 TREP Infrastructure
- 228 TRKD
- 915 TRTH
- 5 Velocity Analytics
- 9 Wealth Management Web Services
- 91 Workspace SDK
- 11 Element Framework
- 5 Grid
- 18 World-Check Data File
- 1 Yield Book Analytics
- 46 中文论坛