question

Upvotes
Accepted
1 0 0 1

API Throttling Exception

Hi team,

Can you please check this below on what may have caused this and how can this be sorted? Thank you in advance.

In ERT Consume, we are receiving 'API Throttling Exception' with intermediate frequency leading to data loss. Could you please us resolving the Exception, Please find below the full trace of Exception message received.

PutLogEvents API responded with error='ThrottlingException', message='Rate exceeded'\n","stream":"stderr",

"kubernetes":{"pod_name":"fluent-bit-gqxr9","namespace_name":"a250377-reps-automation-amazon-cloudwatch",

"pod_id":"dbcfc31b-5ad4-417c-ac1b-91a19e021f5f","host":"ip-10-180-121-120.ec2.internal",

"container_name":"fluent-bit","docker_id":"4cce69ce6913afd46f649571697926b83e54ffc640f3b6f08729658bcbf9242e",

"container_hash":"public.ecr.aws/aws-observability/aws-for-fluent-bit@sha256:ff702d8e4a0a9c34d933ce41436e570eb340f56a08a2bc57b2d052350bfbc05d",

"container_image":"public.ecr.aws/aws-observability/aws-for-fluent-bit:stable"}}

#technologyapi
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvote
Accepted
82.7k 279 53 77

@ryan.roxas01

Thank you for reaching out to us.

Please confirm the product that the client is using.

According to the current information, it looks like to be an exeception from AWS (https://repost.aws/knowledge-center/ssm-parameter-store-rate-exceeded).

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
1 0 0 1

Hi team client is using ERT stream API

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
26.3k 61 17 14

Hello @ryan.roxas01

I am assuming that the client using the WebSocket API or RTSDK (C#, Java, or C/C++) to connect to the Refinitiv Real-Time Optmized (RTO) as part of the application.

However, the log " ThrottlingException', message='Rate exceeded'\n" " message does not look like the Refinitiv Real-Time or RTO message. It looks like the AWS service exception that suggested by @Jirapongse, so I suggest the client tries the workaround on the AWS: rePost page.

If the client thinks the log is from the RTO, please ask for more details such as:

  • more log messages
  • Which API that the client use (WebSocket or RTSDK?)
  • If the client uses RTSDK, is it EMA or ETA? which edition (C#, C/C++, Java)?
  • Any replication steps?
  • snippet of code
  • etc
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
1 0 0 0

Hi wasin.w

  • Which API that the client use (WebSocket or RTSDK?) --- RTSDK
  • If the client uses RTSDK, is it EMA or ETA? which edition (C#, C/C++, Java)? --- EMA

Regards,

Jayanthi

+91 84388 47433

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
1 0 0 0

Hi wasin.w,

We are still facing API Throttling issue with intermittent frequency. Could you

please help us here, as it's a major concern leading to data loss.


Regards,

Jayanthi

+91 84388 47433

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
26.3k 61 17 14

Hello @jayanthi.pathrasamy

About the log message

PutLogEvents API responded with error='ThrottlingException', message='Rate exceeded'\n","stream":"stderr",

Based on my knowledge, the error='ThrottlingException', message='Rate exceeded'\n" log does not look like the Refinitiv Real-Time error message. It looks like the exception message generated by the AWS services (like Lambda, etc).

The "PutLogEvents API" is also the Amazon CloudWatch API log (https://docs.aws.amazon.com/AmazonCloudWatchLogs/latest/APIReference/API_PutLogEvents.html), not the EMA API log. The EMA API (and RTSDK) does not have the PutLogEvents API.

The EMA API (and RTSDK) does not connect or send any request to the AWS CloudWatch service. It connects to the RTO (which is Refinitiv's ADS on the Cloud) only.

I am assuming that you are using the EMA and AWS SDK in the same application. If so, this error log is generated from the code that connect to the AWS services, not RTO.

I highly recommend you contact the AWS support team or check the AWS Developer Community website.

I hope this information helps.

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Write an Answer

Hint: Notify or tag a user in this post by typing @username.

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.