Need to publishing multiple Rics in Parallel to avoid performance issues

nsharma

Currently when trying to publishing 10000 Rics one by one so it is taking almost 40-45 mins to publish but need to publish the records in few mins with Parallel publishing if possible from the number of set to be publised at a time.

I am using the NiProvider.

TrepPublishingClient appClient = new TrepPublishingClient();

appClient.setServicename("ABC");

appClient.setName("PQR");

OmmConsumer consumer = null;

consumer = EmaFactory.createOmmConsumer(EmaFactory.createOmmConsumerConfig().host(host).username(username));

ReqMsg reqMsg = EmaFactory.createReqMsg();

consumer.registerClient(reqMsg.domainType( EmaRdm.MMT_LOGIN ), appClient, consumer);

consumer.registerClient(reqMsg.clear().serviceName("ABC").name("PQR"), appClient, consumer);

Thread.sleep(1000); // API calls onRefreshMsg(), onUpdateMsg() and onStatusMsg()

if (consumer != null) consumer.uninitialize();

Gurpreet

Hello @nsharma,

The code snippet in your question is for the consumer app.

Yes, you can publish the instruments concurrently in large batches in parallel. The infrastructure or the RealTime SDK does not prohibit an application from doing so.

nsharma

https://community.developers.refinitiv.com/discussion/comment/126804#Comment_126804

Hello @Gurpreet

Thank you so much for the information!!

Can you please let me know how I can achive it.

Gurpreet

@nsharma,

I would refer you to this MP Performance example packaged with the RTSDK. The example demonstrates how to publish 1000 instruments. You can take this example and apply the technique into your own application, while being mindful of throttling. Publishing those 10,000 instruments in a batch of 500 or 1000 would be a good approach.

nsharma

https://community.developers.refinitiv.com/discussion/comment/126807#Comment_126807

Thanks @Gurpreet for the quick help will apply the same after fews hrs as I am not with my system currently and will let you know....

Jirapongse

@nsharma

According to your previous question, the application uses the post messages to publish data.

Typically, we refer to this method as posting. It is completely different from the NIProvider method. Please confirm whether you are using Posting or NIProvider.

nsharma

https://community.developers.refinitiv.com/discussion/comment/126811#Comment_126811

Hello @Jirapongse

I am using OmmConsumer posting, please check the below code snippet of submitting for publish.

nestedFieldList1.add(EmaFactory.createFieldEntry().ascii(8793, getPre_lb018()));

nestedFieldList1.add(EmaFactory.createFieldEntry().ascii(8794, getPre_lb019()));

nestedFieldList1.add(EmaFactory.createFieldEntry().ascii(4402, getTenor()));

((OmmConsumer)event.closure()).submit( postMsg.postId( postId++ ).serviceName( getServicename() )

.name( getName() ).solicitAck( true ).complete(true)

.payload(nestedRefreshMsg), event.handle() );

Jirapongse

EMA is both thread-safe and thread-aware, allowing multiple threads to post data concurrently for improved performance. However, each item's data must be posted by the same thread to ensure consistency.

nsharma

https://community.developers.refinitiv.com/discussion/comment/126816#Comment_126816

Hello @Jirapongse

Thank you for your response, can you please help me with any example or the code snippet to achieve this…

Jirapongse

@nsharma

Sorry,

As far as I know, we don't have the sample code for that.