question

Upvotes
Accepted
Caspero avatar image
1 ●0 ●1 ●3

Parallel requests when using eikon.get_news_story

Is parallel processing with the eikon module possible?

I see from this article that it is possible with Refinitiv Data (RD) Library for Python: https://developers.lseg.com/en/article-catalog/article/leveraging-parallel-programming-in-python

I also see from documentation that 5 requests per second is the rate limit when using the eikon API.


The maximum requests per second I can achieve when calling eikon.get_news_story using a single thread is about 3 per second.

I therefore tried to use the concurrent module in Python to make parallel requests but am getting an error about thread locking - something to do with eikon's session management using asyncio I think.

Is parallel processing possible with eikon or is it limited to the Refinitiv Data (RD) Library?


python#technology#productparallel-run
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

raksina.samasiri avatar image   raksina.samasiri

Hi @Caspero ,

Thank you for your participation in the forum. Is the reply below satisfactory in resolving your query?
If so please can you click the 'Accept' text next to the appropriate reply? This will guide all community members who have a similar question.

Thanks,
AHS

Caspero avatar image   Caspero raksina.samasiri
No it doesn't answer the question.
raksina.samasiri avatar image   raksina.samasiri

Hi @Caspero ,

Thank you for your participation in the forum. Is the reply below satisfactory in resolving your query?
If so please can you click the 'Accept' text next to the appropriate reply? This will guide all community members who have a similar question.

Thanks,
AHS

Jirapongse avatar image   Jirapongse

@Caspero

Hi,

Please be informed that a reply has been verified as correct in answering the question, and marked as such.

Thanks,

AHS

1 Answer

· Write an Answer
Upvote
Accepted
jonathan.legrand avatar image
5.8k ●21 ●2 ●6

Hi @Caspero, May I ask how exactly you used the article you mentioned to enable parallel requests? I am asking because the workflow shown in that article refers to .py files in which the data retreival is made, with RD:

1703855044624.png

If you would liket o do this with the Eikon Data API (EDAPI), you will have to change those calls in the .py files in question before importing them in your code.


1703855044624.png (75.5 KiB)
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Caspero avatar image Caspero
Hi Jonathan,

I didn't use the article I mentioned in my Eikon API script. I was using it as an example of something similar to what I have in mind for the Eikon API which is possible with RD - i.e. I was saying "if this is possible with RD maybe it's also possible with the Eikon API".

jonathan.legrand avatar image jonathan.legrand Caspero
Hi @Caspero, I believe it is possible, yes. But the devil is in the detail and it depends on the specific application you woulf like to go forward with. Please do let us know on thie Developer Q&A Forum if, during your implementation, you have any further questions.
Caspero avatar image Caspero jonathan.legrand
Thank you @jonathan.legrand , having looked into it a little more I think the rate limits might ultimately making it not worthwhile to operate in parallel. If I have further questions I will be sure to ask.

Write an Answer

Hint: Notify or tag a user in this post by typing @username.

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.