.NET SDK GetReadStream truncates the data of a RawExtractionResult?

I use the .NET SDK, and followed the extraction example: "Tick History / Request Time and Sales for RICs" available in the API Examples sample application.The suggested way to unpack the results following the sample application is to get the ReadStream:

//Download the results
using (var response = ExtractionsContext.RawExtractionResultOperations.GetReadStream(result))
using (var stream = response.Stream)
using (var reader = newStreamReader(stream))
{
var lineCount = 0;
while (!reader.EndOfStream)
{
Debug.WriteLine(reader.ReadLine());
lineCount++;
}
}

It appears this method works fine only as long as the data extracted is small. As soon as I try to retrieve a few RICs the response.Stream seems to be truncated. Is that limited? I have run a couple of extractions, and by the Notes in the RawExtractionResults I should have received about 20,000 updates. However when I read the stream extracted like above it always seem to cap it at 5314 lines.

I assume I am hitting a limitation placed on the stream? Can you confirm please? If that is so, could you please:

a) point me to any documentation or sample code comments that states that such limitation exists,

b) point me to the alternative way to retrieve the extracted data.

Many thanks.

Best Answer

Answers