question

Upvotes
Accepted
3 3 2 1

How to store EMA data ? Any best practice that can be suggested (capturing in elastic search / Hadoop) ?

elektronrefinitiv-realtimeelektron-sdkema-apirrtelektron-message-apidatastream-api
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

1 Answer

· Write an Answer
Upvotes
Accepted
22.6k 59 14 21

Hi @ashwathguru.s, If you are interested in storing level 1 data, it comes in the form of a map of key/value pairs; where the keys are Field Identifiers and the values are the data for that field.

For storage, I think best option might be to serialize the OMM message into a JSON object, since it is the format used by Elasticsearch and Hadoop is able to read it as well. If following this approach, ensure that your callback method is not slowed down by field decoding or file I/O operations.

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Write an Answer

Hint: Notify or tag a user in this post by typing @username.

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.