File size in Python Pickle format

One of our clients would like to understand file size of TickHistory data to determine data capacity in their database.

They would like to know the size of data in Python pickle files through REST API.

Is it possible to guess Python pickle file size from csv file size in TickHistory GUI?

For example, some files are 7.4GB and 29.7GB respectively in csv format from TickHistory GUI (after unzipped from gunzip format).

In that case, roughly how much data capacity is expected in Python pickle format?

Regards,

Hiroko

Find more posts tagged with

tick-history-rest-api

Accepted answers

zoya faberov

Hello @hiroko.goto ,

We do not have the statistics on pickle sizes that are specific to Tick History files.

I am looking at this relevant article, the author has done some relevant research, and from their findings pickle file looks to be slightly under half the size of CSV.

So gzip will be significantly more efficient, if they are looking to keep the data as blobs.

Hope that this information helps

All comments

zoya faberov

Hello @hiroko.goto ,

We do not have the statistics on pickle sizes that are specific to Tick History files.

I am looking at this relevant article, the author has done some relevant research, and from their findings pickle file looks to be slightly under half the size of CSV.

So gzip will be significantly more efficient, if they are looking to keep the data as blobs.

Hope that this information helps

hiroko.goto

Hi Zoya,,

Thank you very much!

Yes, your information really helpful.

Best Regards,

Hiroko

EXPLORE OUR SITES