Entity Search Results Limited to Maximum of 2000?

Dear Support,
I am trying to iterate through all the quotes on the ASX using the following query:
https://api.thomsonreuters.com/permid/search?access-token={token}&entityType=quote&q=mic:XASX&start=1&num=100using batches of 100 quotes and incrementing the start value by 100 for each batch.
The results I am getting looks like:
{
"result": {
"quotes": {
"entityType": "quotes",
"total": 2000,
"start": 1,
"num": 100,
"entities": [
{
...
The issue is that the "total" field appears to be limited to "2000" quotes irrespective of how many quotes are on the exchange (in my case around 2400).
When I use the web interface, I can see the same limitation as well:
Am I missing something?
Regards,
David
Best Answer
-
As the bulk files have been dropped by now, are there any plans to lift/eliminate the 2k limit? I guess then the API will be truly open and not quasi closed as it is right now.
0
Answers
-
Hi Jirapongse,
This is a show stopper for us.
We need to make a decision whether we continue to utilise PermId in the next few weeks or move across to an alternative identifier.Thanks,
David
0 -
I have contacted the PermId team to verify the problem.
0 -
Hi Jirapongse,
Have you had any feedback on this issue?
Thanks,
David
0 -
They are looking into the issue.
0 -
Hi Jirapongse,
This is a showstopper for us and preventing a product going into production. I prompt response would be appreciated
Regards,
David
0 -
Hi David,
We do have limitation on the amount of search results, as the search purpose is to search for a specific entity by name or other id.
If you want to iterate over all of ours quotes, I recommend you download a a quote bulk file containing all of our quotes. We publish the files on a weekly basis. and provide Atom feed for consuming the incremental updates.
Notes
1.In order to reach the download page, you should login to the site.
2. We provide bulk files in two formats (TTL & NTRIPLES)
3. You can find additional info in our dev portal and user guide
Please Let me know whether additional info is needed.
Thanks
Tsafi
0 -
Hi Tsafi,
Your API also allows searching by a single exchange (as per my example) which is what we are doing and why we took the approach that we have to use the API.
To rebuild everything using the Bulk files will involve us rewriting everything we have done so far. Can your limit be lifted?
Why is there a limit of the search API when your API forces a paging mechanism to download anyway?
Regards,
David0 -
Hi Tsafi,
Any thoughts on my questions?
Regards,
David
0 -
Hi Tsafi,
As the Atom feed is currently broken (see other threads in forum) and unlikely to be fixed soon, would it be possible to increase the maximum number of entities from the Entity Search feed as a short term workaround until the Atom feed is fixed?
Regards,
david0 -
According to the response:
We do have limitation on the amount of search results, as the search purpose is to search for a specific entity by name or other id.
We don't have a plan to lift this limit.
0
Categories
- All Categories
- 3 Polls
- 6 AHS
- 36 Alpha
- 166 App Studio
- 6 Block Chain
- 4 Bot Platform
- 18 Connected Risk APIs
- 47 Data Fusion
- 34 Data Model Discovery
- 684 Datastream
- 1.4K DSS
- 615 Eikon COM
- 5.2K Eikon Data APIs
- 10 Electronic Trading
- Generic FIX
- 7 Local Bank Node API
- 3 Trading API
- 2.9K Elektron
- 1.4K EMA
- 249 ETA
- 554 WebSocket API
- 37 FX Venues
- 14 FX Market Data
- 1 FX Post Trade
- 1 FX Trading - Matching
- 12 FX Trading – RFQ Maker
- 5 Intelligent Tagging
- 2 Legal One
- 23 Messenger Bot
- 3 Messenger Side by Side
- 9 ONESOURCE
- 7 Indirect Tax
- 60 Open Calais
- 275 Open PermID
- 44 Entity Search
- 2 Org ID
- 1 PAM
- PAM - Logging
- 6 Product Insight
- Project Tracking
- ProView
- ProView Internal
- 22 RDMS
- 1.9K Refinitiv Data Platform
- 643 Refinitiv Data Platform Libraries
- 4 LSEG Due Diligence
- LSEG Due Diligence Portal API
- 4 Refinitiv Due Dilligence Centre
- Rose's Space
- 1.2K Screening
- 18 Qual-ID API
- 13 Screening Deployed
- 23 Screening Online
- 12 World-Check Customer Risk Screener
- 1K World-Check One
- 46 World-Check One Zero Footprint
- 45 Side by Side Integration API
- 2 Test Space
- 3 Thomson One Smart
- 10 TR Knowledge Graph
- 151 Transactions
- 143 REDI API
- 1.8K TREP APIs
- 4 CAT
- 26 DACS Station
- 121 Open DACS
- 1.1K RFA
- 104 UPA
- 192 TREP Infrastructure
- 228 TRKD
- 915 TRTH
- 5 Velocity Analytics
- 9 Wealth Management Web Services
- 90 Workspace SDK
- 11 Element Framework
- 5 Grid
- 18 World-Check Data File
- 1 Yield Book Analytics
- 46 中文论坛