Hi,
Retrieving Time and Sales data in a .Net application for up to 15 RICs over max 15 minute query window ...
Extraction Services Version 16.1.44123 (ed92f5e3e332), Built Aug 10 2022 01:55:41
User ID: -------
Extraction ID: 2000000447520516
Correlation ID: CiD/-------/0x0000000000000000/REST API/EXT.2000000447520516
Schedule: 0x082acb91eea331e9 (ID = 0x0000000000000000)
Input List (15 items): (ID = 0x082acb91eea331e9) Created: 14/09/2022 12:19:01 Last Modified: 14/09/2022 12:19:01
Report Template (2 fields): _OnD_0x082acb91eea331e9 (ID = 0x082acb91eeb331e9) Created: 14/09/2022 12:17:57 Last Modified: 14/09/2022 12:17:57
Schedule dispatched via message queue (0x082acb91eea331e9), Data source identifier (F5CE03EFE93B42DEAF241C749ED80AE7)
Schedule Time: 14/09/2022 12:17:58
Processing started at 14/09/2022 12:17:58
Processing completed successfully at 14/09/2022 12:19:01
Extraction finished at 14/09/2022 12:19:01 UTC, with servers: tm07n01, TRTH (54.806 secs)
Historical Instrument <RIC,FGBMH0> expanded to 1 RIC: FGBMH0.
Historical Instrument <RIC,FGBSH0> expanded to 1 RIC: FGBSH0.
Historical Instrument <RIC,STXEH0> expanded to 1 RIC: STXEH0.
Historical Instrument <RIC,FFIH0> expanded to 1 RIC: FFIH0.
Historical Instrument <RIC,UNA.AS> expanded to 1 RIC: UNA.AS.
Instrument <RIC,IMCD.AS> expanded to 1 RIC: IMCD.AS.
Instrument <RIC,OREP.PA> expanded to 1 RIC: OREP.PA.
Instrument <RIC,PHG.AS> expanded to 1 RIC: PHG.AS.
Instrument <RIC,BAR.BR> expanded to 1 RIC: BAR.BR.
Instrument <RIC,ABI.BR> expanded to 1 RIC: ABI.BR.
Instrument <RIC,ATCOa.ST> expanded to 1 RIC: ATCOa.ST.
Instrument <RIC,AFPD.S> expanded to 1 RIC: AFPD.S.
Instrument <RIC,LVMH.PA> expanded to 1 RIC: LVMH.PA.
Instrument <RIC,AMPF.MI> expanded to 1 RIC: AMPF.MI.
Instrument <RIC,CHRH.CO> expanded to 1 RIC: CHRH.CO.
Total instruments after instrument expansion = 15
Range Query from 2019-12-20T09:02:34.000 to 2019-12-20T09:11:27.000 (UTC)
Quota Message: INFO: Tick History Compliance Quota Count Before Extraction: 2802; Instruments Approved for Extraction: 14; Tick History Compliance Quota Count After Extraction: 2802, 28.02% of Limit; Tick History Compliance Quota Limit: 10000
Manifest: #RIC,Domain,Start,End,Status,Count
Manifest: ABI.BR,Market Price,2019-12-20T09:02:39.336925949Z,2019-12-20T09:11:26.421164980Z,Active,930
Manifest: AFPD.S,Market Price,,,Inactive,0
Manifest: AMPF.MI,Market Price,2019-12-20T09:02:34.241595786Z,2019-12-20T09:11:26.674041158Z,Active,618
Manifest: ATCOa.ST,Market Price,2019-12-20T09:02:34.202579216Z,2019-12-20T09:11:24.300485901Z,Active,628
Manifest: BAR.BR,Market Price,2019-12-20T09:02:38.593195816Z,2019-12-20T09:09:59.962822200Z,Active,141
Manifest: CHRH.CO,Market Price,2019-12-20T09:02:41.101816484Z,2019-12-20T09:11:26.986073709Z,Active,208
Manifest: FFIH0,Market Price,2019-12-20T09:02:35.106607821Z,2019-12-20T09:11:25.914743782Z,Active,2071
Manifest: FGBMH0,Market Price,2019-12-20T09:02:34.110009742Z,2019-12-20T09:11:26.167625056Z,Active,4086
Manifest: FGBSH0,Market Price,2019-12-20T09:02:35.612086751Z,2019-12-20T09:11:26.669088468Z,Active,899
Manifest: IMCD.AS,Market Price,2019-12-20T09:02:37.045480176Z,2019-12-20T09:11:24.190847735Z,Active,396
Manifest: LVMH.PA,Market Price,2019-12-20T09:02:39.337839279Z,2019-12-20T09:11:24.194082022Z,Active,3583
Manifest: OREP.PA,Market Price,2019-12-20T09:02:34.404629591Z,2019-12-20T09:11:24.597156067Z,Active,1878
Manifest: PHG.AS,Market Price,2019-12-20T09:02:37.046180441Z,2019-12-20T09:11:24.934922999Z,Active,1636
Manifest: STXEH0,Market Price,2019-12-20T09:02:34.006535645Z,2019-12-20T09:11:26.355424258Z,Active,18739
Manifest: UNA.AS,Market Price,2019-12-20T09:02:37.808890854Z,2019-12-20T09:11:26.117026806Z,Active,6738
Using IExtractionsContext.ExtractRawAsync() and subsequently IExtractionsContext.GetReadStreamAsync(RawExtractionResult) for obtaining a response stream which I then process with a StreamReader.
For the extraction note above however, the response stream stops after 13466 lines (almost at the end of LVMH.PA data). Looking at the manifest Count values it is in the block of LVMH.PA lines that the limit of 10000 is reached. Coincidence ? Because this quota limit is on RICs not on retrieved lines, correct ?
I notice this behaviour consistently in other requests with +10000 lines of reply data. Still coincidence or am I overlooking something ?
Any help/info much appreciated !