DSS extract raw - gzip

Liang.Xue

According to the guide, we did 2 steps for extracting using DSS rest api:

Step 1:  url1 - https://selectapi.datascope.refinitiv.com/RestApi/v1/Extractions/ExtractRaw 
Step 2: url2 - https://selectapi.datascope.refinitiv.com/RestApi/v1/Extractions/RawExtractionResults('$JOBID')/$value

$JOBID is obtained in step 1.

In step 2, we set the header:

requestHeaders['Accept-Encoding'] = 'gzip'

When we get the response data from step 2,

resp = requests.get(url2, headers = requestHeaders)

data is sitting in resp.text and could directly save into a csv file.

What's the role of 'gzip' here? We don't see any zipping/compressing.

Gurpreet

Hi @Liang.Xue,

It is advisable to start with a Refinitiv sample and then modify it to your needs.

In most languages, the content decoding is automatically handled by the library - which in this case is the requests module. The actual binary transfer on the wire is gzipped.

If you would like to not have automatic decoding of the binary data (which is a requirement for very large direct data download from AWS), you should set the flag:

req.raw.decode_content = False

See this article on direct AWS downloads.