question

Upvotes
Accepted
ryan.roxas01 avatar image
1 ●0 ●0 ●1

API Throttling Exception

Hi team,

Can you please check this below on what may have caused this and how can this be sorted? Thank you in advance.

In ERT Consume, we are receiving 'API Throttling Exception' with intermediate frequency leading to data loss. Could you please us resolving the Exception, Please find below the full trace of Exception message received.

PutLogEvents API responded with error='ThrottlingException', message='Rate exceeded'\n","stream":"stderr",

"kubernetes":{"pod_name":"fluent-bit-gqxr9","namespace_name":"a250377-reps-automation-amazon-cloudwatch",

"pod_id":"dbcfc31b-5ad4-417c-ac1b-91a19e021f5f","host":"ip-10-180-121-120.ec2.internal",

"container_name":"fluent-bit","docker_id":"4cce69ce6913afd46f649571697926b83e54ffc640f3b6f08729658bcbf9242e",

"container_hash":"public.ecr.aws/aws-observability/aws-for-fluent-bit@sha256:ff702d8e4a0a9c34d933ce41436e570eb340f56a08a2bc57b2d052350bfbc05d",

"container_image":"public.ecr.aws/aws-observability/aws-for-fluent-bit:stable"}}

#technologyapi
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

wasin.w avatar image   wasin.w

<AHS>

Case 12791314

wasin.w avatar image   wasin.w

Hello @jayanthi.pathrasamy

Thank you for your participation in the forum. Is the reply below satisfactory in resolving your query?


If so please can you click the 'Accept' text next to the appropriate reply? This will guide all community members who have a similar question.

Thanks,


AHS

wasin.w avatar image   wasin.w

Please be informed that a reply has been verified as correct in answering the question, and has been marked as such.

Thanks,


AHS

6 Answers

· Write an Answer
Upvote
Accepted
Jirapongse avatar image
79.3k ●253 ●52 ●74

@ryan.roxas01

Thank you for reaching out to us.

Please confirm the product that the client is using.

According to the current information, it looks like to be an exeception from AWS (https://repost.aws/knowledge-center/ssm-parameter-store-rate-exceeded).

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
ryan.roxas01 avatar image
1 ●0 ●0 ●1

Hi team client is using ERT stream API

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
wasin.w avatar image
24.8k ●54 ●17 ●14

Hello @ryan.roxas01

I am assuming that the client using the WebSocket API or RTSDK (C#, Java, or C/C++) to connect to the Refinitiv Real-Time Optmized (RTO) as part of the application.

However, the log " ThrottlingException', message='Rate exceeded'\n" " message does not look like the Refinitiv Real-Time or RTO message. It looks like the AWS service exception that suggested by @Jirapongse, so I suggest the client tries the workaround on the AWS: rePost page.

If the client thinks the log is from the RTO, please ask for more details such as:

  • more log messages
  • Which API that the client use (WebSocket or RTSDK?)
  • If the client uses RTSDK, is it EMA or ETA? which edition (C#, C/C++, Java)?
  • Any replication steps?
  • snippet of code
  • etc
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
jayanthi.pathrasamy avatar image
1 ●0 ●0 ●0

Hi wasin.w

  • Which API that the client use (WebSocket or RTSDK?) --- RTSDK
  • If the client uses RTSDK, is it EMA or ETA? which edition (C#, C/C++, Java)? --- EMA

Regards,

Jayanthi

+91 84388 47433

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
jayanthi.pathrasamy avatar image
1 ●0 ●0 ●0

Hi wasin.w,

We are still facing API Throttling issue with intermittent frequency. Could you

please help us here, as it's a major concern leading to data loss.


Regards,

Jayanthi

+91 84388 47433

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Upvotes
wasin.w avatar image
24.8k ●54 ●17 ●14

Hello @jayanthi.pathrasamy

About the log message

PutLogEvents API responded with error='ThrottlingException', message='Rate exceeded'\n","stream":"stderr",

Based on my knowledge, the error='ThrottlingException', message='Rate exceeded'\n" log does not look like the Refinitiv Real-Time error message. It looks like the exception message generated by the AWS services (like Lambda, etc).

The "PutLogEvents API" is also the Amazon CloudWatch API log (https://docs.aws.amazon.com/AmazonCloudWatchLogs/latest/APIReference/API_PutLogEvents.html), not the EMA API log. The EMA API (and RTSDK) does not have the PutLogEvents API.

The EMA API (and RTSDK) does not connect or send any request to the AWS CloudWatch service. It connects to the RTO (which is Refinitiv's ADS on the Cloud) only.

I am assuming that you are using the EMA and AWS SDK in the same application. If so, this error log is generated from the code that connect to the AWS services, not RTO.

I highly recommend you contact the AWS support team or check the AWS Developer Community website.

I hope this information helps.

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Write an Answer

Hint: Notify or tag a user in this post by typing @username.

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.