question

Upvotes
Accepted
ashwathguru.s avatar image
3 ●3 ●2 ●1

How to store EMA data ? Any best practice that can be suggested (capturing in elastic search / Hadoop) ?

elektronrefinitiv-realtimeelektron-sdkema-apirrtelektron-message-apidatastream-api
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

moragodkrit.chumsri_1 avatar image   moragodkrit.chumsri_1

Hello @ashwathguru.s,

Thank you for your participation in the forum. Is the reply below satisfactory in resolving your query?

If yes, please click the 'Accept' text next to the reply. This will guide all community members who have a similar question. Otherwise please post again offering further insight into your question.

Thanks,

1 Answer

· Write an Answer
Upvotes
Accepted
Gurpreet avatar image
22k ●58 ●14 ●21

Hi @ashwathguru.s, If you are interested in storing level 1 data, it comes in the form of a map of key/value pairs; where the keys are Field Identifiers and the values are the data for that field.

For storage, I think best option might be to serialize the OMM message into a JSON object, since it is the format used by Elasticsearch and Hadoop is able to read it as well. If following this approach, ensure that your callback method is not slowed down by field decoding or file I/O operations.

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Write an Answer

Hint: Notify or tag a user in this post by typing @username.

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.