RICs data not coming back

dhruv.arora

Hi

I am using Java EMA API. I am sending 53000 RICs using my program. But when I see in my Analytics APP (AWS), I don't find RICs, which are supposed to be there. I doubt if I am getting all the RICs data back. When I send only the RICs (supposed to appear in my app around 1900), then I can see those RICs data in the app. Following is part of my code, which sends data to API.

public static OmmArray processResultRows(AthenaClient athenaClient, String queryExecutionId,OmmArray arrayI,ElementList batchView,AppClient appClient,OmmConsumer consumer,OmmArray array) throws IOException {

try {

BufferedWriter writer = new BufferedWriter(new FileWriter("C:\\Users\\Operations\\Desktop\\RICS\\RicsGotIn.csv"));

GetQueryResultsRequest getQueryResultsRequest = GetQueryResultsRequest.builder()

// Max Results can be set but if its not set,

// it will choose the maximum page size

// As of the writing of this code, the maximum value is 1000

// .withMaxResults(1000)

.queryExecutionId(queryExecutionId).build();

GetQueryResultsIterable getQueryResultsResults = athenaClient.getQueryResultsPaginator(getQueryResultsRequest);

int j = 0;

for (GetQueryResultsResponse result : getQueryResultsResults) {

List<ColumnInfo> columnInfoList = result.resultSet().resultSetMetadata().columnInfo();

List<Row> results = result.resultSet().rows();

processRow(results, columnInfoList,arrayI,writer);

batchView.add(EmaFactory.createElementEntry().array(EmaRdm.ENAME_BATCH_ITEM_LIST, arrayI));

batchView.add(EmaFactory.createElementEntry().uintValue(EmaRdm.ENAME_VIEW_TYPE, 1));

batchView.add(EmaFactory.createElementEntry().array(EmaRdm.ENAME_VIEW_DATA, array));

try {

consumer.registerClient(EmaFactory.createReqMsg().serviceName("ELEKTRON_DD").payload(batchView), appClient);

}catch(Exception e) {

consumer.registerClient(EmaFactory.createReqMsg().serviceName("ELEKTRON_DD").payload(batchView), appClient);

}

j = j + 1;

//consumer.uninitialize();

arrayI = null;

arrayI = EmaFactory.createOmmArray();

}

System.out.println("The value of j is:" + j);

} catch (AthenaException e) {

Is there any restriction on the number of RICs, I am supposed to send?

GE-XXXXXX is the username.all_input_rics.zip

Attached is the file, which has all the RICs, I am requesting data for. Please let me know, if I should send you the full code.

Thanks

Dhruv

zoya faberov

Hello @dhruv.arora,

Firstly, you are correct, the total max ERT entitlement is for 50K RICs.

However, I would not recommend submitting all 50K in one batch, rather, I would submit more reasonable batches of 2-3K. (I would also examine the response per batch, and make sure if any invalid/expired RICs you would not be submitting them next time that you submit that batch)

I would additionally, for larger performance requirements, increase EMA GuaranteedOutputBuffers parameter in EmaConfig.xml. If you go with 2-3K batches, GuaranteedOutputBuffers 10K should work well, if you go with extra-large batches, you may wish to test and tune the configuration to your consumer requirements.