Missing data in Organization data dump

gpilgrim

Hello,

I think some data may be missing within the OpenPermID-bulk-organization-20180506_071051.ntriples.gz bulk data file. The data appears to be missing for a large number of PermIDs. I've checked these PermIDs, which are present on the website but not within the file:

Carrefour SA: 1-4295866751

Aviva PLC: 1-8589934340

Could you confirm whether these data points exist in the bulk data file? I've accessed the file in a number of ways and been unable to find them.

Thanks,

Graham

Jirapongse

@david.snowsill

I found that this issue has been fixed.

Could you please verify it?

david.snowsill

Hi Graham,

I can confirm that both PermId's were present in the bulk file:

OpenPermID-bulk-organization-20180415_070501.ntriples

but are not present in:

OpenPermID-bulk-organization-20180528_081334.ntriples

It appears the recent bulk organization files are about 30% smaller than a month ago and hence missing many companies.

Regards,

David

michaeltran

Noticing the same issue for the June 1 dump,

(Apple Inc) https://permid.org/1-4295905573 is present in

OpenPermID-bulk-organization-20180325_071611.ntriples, but not in

OpenPermID-bulk-organization-20180601_155209.ntriple..

david.snowsill

https://community.developers.refinitiv.com/discussion/comment/32488#Comment_32488

Yes, I can confirm that this has been fixed

marketpsych-dev

Sorry to reopen this issue, but we've been finding missing companies in the bulk dumps. One example, missing from OpenPermID-bulk-organization-20191027_084656.ntriples.gz : https://permid.org/1-5062407369.
The last few weeks' files have been decreasing their size too:
OpenPermID-bulk-organization-20191006_084709.ntriples.gz 511M
OpenPermID-bulk-organization-20191020_084659.ntriples.gz 296M
OpenPermID-bulk-organization-20191027_084656.ntriples.gz 154M

phil94

https://community.developers.refinitiv.com/discussion/comment/51231#Comment_51231

@marketpsych-dev Thanks for reopening this issue. I face the same problem. Do you still have by any chance a copy of the most recent complete organization file: OpenPermID-bulk-organization-20191006_084709.ntriples.gz... While Refinitiv fixes the bug, I would be very grateful if you could share it via a secure link.