Time and sales too huge and unable to download in compressed format

Hello. I'm using Stored & Scheduled Workflow to download Tick History Time And Sales from DSS.
When i download the file using Python, i noticed that the format is raw and too huge.
Below is a sample i tried.
https://selectapi.datascope.refinitiv.com/RestApi/v1/Extractions/ExtractedFiles('VjF8MHgwOGQzYTE2MjA1Nzk5OTYyfA')/$value
The output is below in which i need to write into a file.
what can i do to download directly from the link below (GUI) ? in the Download link, the file size is already in gz format and relatively smaller. How can i get this using Python?
Best Answer
-
Thank you for reaching out to us.
We have an article and Python sample regarding this workflow.
The article is DSS REST API: Downloading Completed Extraction Files by a Schedule Name. The Python example is on GitHub.
The download code is in the DSSClient.py.
def download_file(self, extracted_file, aws):
decode = True
headers={}
headers["Prefer"] = "respond-async"
headers["Authorization"] = "Token "+self.__token__
if aws == True:
headers["X-Direct-Download"] = "True"
if extracted_file["ExtractedFileName"].endswith("gz") == True:
decode = False
requestUrl = self.__dss_uri__+self.__download_file_endpoint__.format(extracted_file["ExtractedFileId"])
r = requests.get(requestUrl,headers=headers,stream=True)
chunk_size = 1024
with open(extracted_file["ExtractedFileName"], 'wb') as fd:
for data in r.raw.stream(chunk_size,decode_content=decode):
fd.write(data)The code checks the file's surname before opening the stream. Please check if this code works.
0
Answers
-
Thanks @Jirapongse. The key point here is decode = False to ensure the file is downloaded in .gz. However i noticed, although i use AWS to download, the speed is still slow. Any recommendation for this?
0
Categories
- All Categories
- 6 AHS
- 36 Alpha
- 166 App Studio
- 6 Block Chain
- 4 Bot Platform
- 18 Connected Risk APIs
- 47 Data Fusion
- 34 Data Model Discovery
- 682 Datastream
- 1.4K DSS
- 613 Eikon COM
- 5.2K Eikon Data APIs
- 10 Electronic Trading
- Generic FIX
- 7 Local Bank Node API
- 3 Trading API
- 2.9K Elektron
- 1.4K EMA
- 248 ETA
- 552 WebSocket API
- 37 FX Venues
- 14 FX Market Data
- 1 FX Post Trade
- 1 FX Trading - Matching
- 12 FX Trading – RFQ Maker
- 5 Intelligent Tagging
- 2 Legal One
- 23 Messenger Bot
- 3 Messenger Side by Side
- 9 ONESOURCE
- 7 Indirect Tax
- 60 Open Calais
- 275 Open PermID
- 44 Entity Search
- 2 Org ID
- 1 PAM
- PAM - Logging
- 6 Product Insight
- Project Tracking
- ProView
- ProView Internal
- 22 RDMS
- 1.9K Refinitiv Data Platform
- 626 Refinitiv Data Platform Libraries
- 5 LSEG Due Diligence
- 1 LSEG Due Diligence Portal API
- 4 Refinitiv Due Dilligence Centre
- Rose's Space
- 1.2K Screening
- 18 Qual-ID API
- 13 Screening Deployed
- 23 Screening Online
- 12 World-Check Customer Risk Screener
- 1K World-Check One
- 46 World-Check One Zero Footprint
- 45 Side by Side Integration API
- 2 Test Space
- 3 Thomson One Smart
- 10 TR Knowledge Graph
- 151 Transactions
- 143 REDI API
- 1.8K TREP APIs
- 4 CAT
- 26 DACS Station
- 121 Open DACS
- 1.1K RFA
- 104 UPA
- 191 TREP Infrastructure
- 228 TRKD
- 915 TRTH
- 5 Velocity Analytics
- 9 Wealth Management Web Services
- 83 Workspace SDK
- 11 Element Framework
- 5 Grid
- 18 World-Check Data File
- 1 Yield Book Analytics
- 46 中文论坛