question

Upvotes
Accepted
IoannisG avatar image
54 ●1 ●0 ●5

Workspace Python API takes a long time to complete

When using Workspace Python API under Windows 10, some simple queries take a long time to complete.


For example, the Python commands:


import refinitiv.data as rd

rd.open_session()

df=rd.get_data('4296477482', ['TR.OrganizationID','AVAIL(TR.CompanyName,TR.CommonName)','(TR.InvestorSharesHeld/1000000-TR.InvtrPrevSharesHeld)/TR.InvtrPrevSharesHeld', \
'TR.SecurityOwnedName','TR.SecurityOwnedRIC','TR.InvestorValueHeld','TR.InvestorValueHeld.currency','TR.InvestorSharesHeld/1000000','TR.InvtrPrevSharesHeld'], \
parameters={'Scale':6,'NULL':'Blank','Curn':'NATIVE'})

df=df.sort_values(by=['Investor Based Value Held'],ascending=False,na_position='last').head(25)

df.to_excel('PythonOutput.xlsx', sheet_name='PythonData', index=False)

rd.close_session()


, take about half a minute to complete.


As this needs to be scaled to running this script around 10 times (I prefer to do so instead of a bulk download for all 10 at once), is there any way to make the code run faster?


#productpython apiperformance
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

4 Answers

· Write an Answer
Upvotes
Accepted
Jirapongse avatar image
84.6k ●287 ●53 ●77

@IoannisG

Please try this one:

df=rd.get_data('4296477482', ['TR.OrganizationID',
                              'AVAIL(TR.CompanyName,TR.CommonName)',
                              '(TR.InvestorSharesHeld/1000000-TR.InvtrPrevSharesHeld)/TR.InvtrPrevSharesHeld', 
                              'TR.InvestorSharesHeld',
                              'TR.InvtrPrevSharesHeld',
                              'TR.SecurityOwnedName',
                              'TR.SecurityOwnedRIC',
                              'TR.InvestorValueHeld',
                              'TR.InvestorValueHeld.currency',
                              'TR.InvestorSharesHeld/1000000',
                              'TR.InvtrPrevSharesHeld'], 
                parameters=
                {'Scale':6,'NULL':'Blank','Curn':'NATIVE','StartNum':1,'EndNum':25,"SortOrder":"Descending"})

Otherwise, please contact the helpdesk team via MyAccount for other supported parameters.

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
Jirapongse avatar image
84.6k ●287 ●53 ●77

@IoannisG

Thank you for reaching out to us.

As far as I know, the problem is not in the code. The backend or server needs times to extract the requested data. I ran the code and found that the response contains 15447 rows.

1719806887893.png

On my maching, it took around 20-30 seconds to get the response. I think this is an expected behavior of Data Libary to extract this size of data.

You may contact your LSEG account team for sales team for other solutions.


1719806887893.png (10.9 KiB)
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
IoannisG avatar image
54 ●1 ●0 ●5

OK,thanks. So there is no way to sort the data (say, top 25) on the server, and just return this reduced set, but only to return the full set (of 15477 rows) and do the sorting later, is this right?

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
IoannisG avatar image
54 ●1 ●0 ●5

Thanks, is there also a way to specify in which field(s) (e.g. TR.InvestorValueHeld, TR.SecurityOwnedName) the sorting should be done?

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Jirapongse avatar image Jirapongse

@IoannisG

You can specify the parameters to the field. For example:

TR.PvtOwnInvestorName(SortOrder=Descending)

However, I am unable to find those field in the Data Item Browser so I can't confirm which parameters can be used.

Please contact the helpdesk team via MyAccount for more information.


Write an Answer

Hint: Notify or tag a user in this post by typing @username.

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.