Discover Refinitiv
MyRefinitiv Refinitiv Perspectives Careers
Created with Sketch.
All APIs Questions & Answers  Register |  Login
Ask a question
  • Questions
  • Tags
  • Badges
  • Unanswered
Search:
  • Home /
  • TREP APIs /
avatar image
Question by RicknBaker · Jan 31, 2018 at 06:46 AM · OMMxmlvalueaddgeneric message

Generic Message Payload Size?

Right next question. Now I've got a .Net ValueAdd Provider and Consumer exchanging XML data using OMM generic messages. Is there a limit to the payload size? Some of our documents are about 40 Mbyte. Is that too big? Should I consider zipping them up first?

People who like this

0 Show 0
Comment
10 |1500 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

5 Replies

  • Sort: 
avatar image
REFINITIV
Best Answer
Answer by umer.nalla · Feb 01, 2018 at 06:25 AM

Hi @RicknBaker

As mentioned above RSSL can handle large payloads.

However, when I was looking at large payloads a while back, I was recommended that in order optimise the data distribution across the TREP infrastructure, I should ideally limit the size to no greater then 6k bytes. This is the size of the RSSL message buffer in the infrastructure. Larger messages mean the infrastructure has to break up and re-assemble at the expense of extra resources.

You mentioned in your other posts that data wont be sent too often, so you may not be overly concerned about performance - but you should discuss with your Market Data team about possible impact on other users of your TREP infrastructure.

Based, on the above, zipping the data would appear to be a good idea - however, you should do some testing to determine for yourself the suitability of doing so.

If you take a look at our tutorial on Decoding Machine Readable News you will note that we zip and split our larger news payloads into smaller fragments for distribution. The consumer then has to unzip and re-assemble the fragments to get the full payload.

Comment

People who like this

0 Show 0 · Share
10 |1500 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

avatar image
REFINITIV
Answer by jirapongse.phuriphanvichai · Jan 31, 2018 at 10:50 PM

According to the specification of the underlying API (ETA), the size of payload in the message can be up to 4,294,967,295 bytes. This payload length is typically limited by the contained type’s specification.

However, if the XML is in the container's entry, the size is limited to 65,535 bytes.


payload.png (93.2 KiB)
Comment

People who like this

0 Show 0 · Share
10 |1500 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

avatar image
Answer by RicknBaker · Feb 05, 2018 at 11:27 AM

OK, thanks I'll take a look at compression. Things seem to blow up spectacularly with big payloads .

Are there any samples showing how to send a multi fragment generic message?

Thanks guys, I appreciate the help.

Comment

People who like this

0 Show 0 · Share
10 |1500 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

avatar image
REFINITIV
Answer by jirapongse.phuriphanvichai · Feb 08, 2018 at 02:28 AM

I can't find any samples for this.

However, to send multi-part generic messages, the application needs to set the GenericMsg.IndicationMaskFlag.MessageComplete flag on the final part.

genericMsg.IndicationMask = GenericMsg.IndicationMaskFlag.MessageComplete

For example, if you would like to send four generic messages for a XML file. The first, second, and third generic messages will not have the GenericMsg.IndicationMaskFlag.MessageComplete flag. Only the forth (final) part will have the GenericMsg.IndicationMaskFlag.MessageComplete flag.

MessageComplete flag is used to indicate whether this generic message is the final portion of the message.

Moreover, you can also set GenericMsg.SeqNum and GenericMsg.SecondarySeqNum to specify the order of messages.

genericMsg.SeqNum = 1;
genericMsg.SecondarySeqNum = 2;
Comment

People who like this

0 Show 0 · Share
10 |1500 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

avatar image
Answer by RicknBaker · Feb 14, 2018 at 10:20 AM

Thanks. I now have an implementation that breaks big payloads down and submits them as individual messages Presumably, there's no chance of these getting out of order or dropped is there?

I did discover that a huge payload, around 2Mb of compressed XML caused the ADH server I connect to to hang. Last message seen in the log was

<xxxxx.1.adh.rrcpTransport.1.srcSide.rrcp.send.transmissionBus: Warning: Tue Feb 13 12:54:22 2018> RRCP STATUS MSG: RRCP_CONG_BEGIN: possible congestion sets in<END>

<xxx Warning: Tue Feb 13 12:54:23 2018> RRCP STATUS MSG: RRCP_CONG_END: congestion ends<END>

Comment

People who like this

0 Show 1 · Share
10 |1500 characters needed characters left characters exceeded
▼
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Viewable by all users

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

avatar image
REFINITIV
jirapongse.phuriphanvichai ♦♦ · Feb 16, 2018 at 01:42 AM 0
Share

It uses TCP/IP to send messages. Therefore, if the application sends messages in order, there is no chance to get out of order or dropped messages.

Moreover, TREP also uses reliable UDP protocol so messages couldn't be out of order.

However, you can use GenericMsg.SeqNum and GenericMsg.SecondarySeqNum to specify the order of messages.

For the error messages on TREP, please direct contact TREP support team via Contact Us.

Watch this question

Add to watch list
Add to your watch list to receive emailed updates for this question. Too many emails? Change your settings >
8 People are following this question.

Related Questions

NIP Publishing with two ADH servers using Elektron Java SDK

OMM Provider

OMMViewer Java - where to download and how to tune the timeout parameter

RFA configuration for MRN_STORY

SSL(MarketFeed) vs RSSL(OMM) message size reduction

  • Feedback
  • Copyright
  • Cookie Policy
  • Privacy Statement
  • Terms of Use
  • Careers
  • Anonymous
  • Sign in
  • Create
  • Ask a question
  • Spaces
  • Alpha
  • App Studio
  • Block Chain
  • Bot Platform
  • Calais
  • Connected Risk APIs
  • DSS
  • Data Fusion
  • Data Model Discovery
  • Datastream
  • Eikon COM
  • Eikon Data APIs
  • Elektron
    • EMA
    • ETA
    • WebSocket API
  • Legal One
  • Messenger Bot
  • Messenger Side by Side
  • ONESOURCE
    • Indirect Tax
  • Open PermID
    • Entity Search
  • Org ID
  • PAM
    • PAM - Logging
  • ProView
  • ProView Internal
  • Product Insight
  • Project Tracking
  • Refinitiv Data Platform
    • Refinitiv Data Platform Libraries
  • Rose's Space
  • Screening
    • Qual-ID API
    • Screening Deployed
    • Screening Online
    • World-Check One
    • World-Check One Zero Footprint
  • Side by Side Integration API
  • TR Knowledge Graph
  • TREP APIs
    • CAT
    • DACS Station
    • Open DACS
    • RFA
    • UPA
  • TREP Infrastructure
  • TRIT
  • TRKD
  • TRTH
  • Thomson One Smart
  • Transactions
    • REDI API
  • Velocity Analytics
  • Wealth Management Web Services
  • World-Check Data File
  • Explore
  • Tags
  • Questions
  • Badges