lseg get_data() randomly missing data

igorg
igorg Advocate
edited April 16 in Eikon Data APIs

Another problem: sometimes, for some requests the server returns empty values. If I rerun the query for the symbol with missing data, I get a correct response.

This is an example of a relatively big query, so I will post only the logs:

Request with 100 RICs:

json = {'Entity': {'E': 'DataGrid_StandardAsync', 'W': {'requests': [{'instruments': ['ADM.N', 'ADNT.N', 'ADT.N', 'ADX.N', 'AEE.N', 'AEFC.N', 'AEG.N', 'AEM.N', 'AEO.N', 'AER.N', 'AES.N', 'AESI.N', 'AFB.N', 'AFG.N', 'AFGB.N', 'AFGC.N', 'AFGD.N', 'AFGE.N', 'AFL.N', 'AG.N', 'AGCO.N', 'AGD.N', 'AGI.N', 'AGL.N', 'AGM.N', 'AGM_pd.N', 'AGM_pe.N', 'AGM_pf.N', 'AGM_pg.N', 'AGMa.N', 'AGO.N', 'AGRO.N', 'AGS.N', 'AGX.N', 'AHH.N', 'AHH_pa.N', 'AHL_pd.N', 'AHL_pe.N', 'AHL_pf.N', 'AHM.N', 'AHR.N', 'AHT.N', 'AHT_pd.N', 'AHT_pf.N', 'AHT_pg.N', 'AHT_ph.N', 'AHT_pi.N', 'AI.N', 'AIFD.N', 'AIG.N', 'AIN.N', 'AIO.N', 'AIR.N', 'AIT.N', 'AIV.N', 'AIZ.N', 'AIZN.N', 'AJG.N', 'AKA.N', 'AKOa.N', 'AKOb.N', 'AKR.N', 'AL.N', 'ALB.N', 'ALB_pa.N', 'ALC.N', 'ALE.N', 'ALEX.N', 'ALG.N', 'ALIT.N', 'ALK.N', 'ALL.N', 'ALLE.N', 'ALLY.N', 'ALL_pb.N', 'ALL_ph.N', 'ALL_pi.N', 'ALL_pj.N', 'ALSN.N', 'ALTG.N', 'ALTG_pa.N', 'ALUR.N', 'ALUR_t.N', 'ALV.N', 'ALVU.N', 'ALX.N', 'AM.N', 'AMBC.N', 'AMBP.N', 'AMBP_t.N', 'AMC.N', 'AMCR.N', 'AME.N', 'AMG.N', 'AMH.N', 'AMH_pg.N', 'AMH_ph.N', 'AMN.N', 'AMP.N', 'AMPS.N'], 'fields': [{'name': 'TR.COMPANYMARKETCAP'}, {'name': 'TR.GICSINDUSTRYCODE'}, {'name': 'TR.GICSINDUSTRYGROUPCODE'}, {'name': 'TR.GICSSECTORCODE'}, {'name': 'TR.GICSSUBINDUSTRYCODE'}, {'name': 'TR.ISINCODE'}, {'name': 'TR.RICCODE'}, {'name': 'TR.SEDOLCODE'}], 'parameters': {'SDATE': '2025-04-10'}}]}}}

Response:

text = {"responses":[{"columnHeadersCount":1,"data":[["ADM.N",21357324468.48,302020,3020,30,30202010,"US0394831020","ADM.N","2047317"],["ADNT.N",888847218.87,251010,2510,25,25101010,"IE00BD845X29","ADNT.N","BD845X2"],["ADT.N",6513392980.34,253020,2530,25,25302020,"US00090Q1031","ADT.N","BFWCP81"],["ADX.N",2130413627.52,"","","","","US0062121043","ADX.N","2007203"],["AEE.N",26129649358.8,551030,5510,55,55103010,"US0236081024","AEE.N","2050832"],["AEFC.N","","","","","","US00775V1044","AEFC.N","BK59DD5"],["AEG.N",9437213424.20605,403010,4030,40,40301020,"","AEG.N",""],["AEM.N",55740962055.1193,151040,1510,15,15104030,"CA0084741085","AEM.N","2009834"],["AEO.N",1842450609.36,255040,2550,25,25504010,"","AEO.N",""],["AER.N",16879600043.25,201070,2010,20,20107010,"NL0000687663","AER.N","B1HHKD3"],["AES.N",7332575634.1,551050,5510,55,55105010,"US00130H1059","AES.N","2002479"],["AESI.N",1660890752.64,101010,1010,10,10101020,"US6420451089","AESI.N","BL6JGD2"],["AFB.N",284287417.04,"","","","","US01864U1060","AFB.N","2842783"],["AFG.N",10453536517.82,403010,4030,40,40301040,"US0259321042","AFG.N","2134532"],["AFGB.N",10453536517.82,403010,4030,40,40301040,"US0259328070","AFGB.N","BDFZ743"],["AFGC.N",10453536517.82,403010,4030,40,40301040,"US0259328807","AFGC.N","BJQY934"],["AFGD.N",10453536517.82,403010,4030,40,40301040,"US0259328724","AFGD.N","BMWJ1L6"],["AFGE.N",10453536517.82,403010,4030,40,40301040,"US0259328641","AFGE.N","BN76JV5"],["AFL.N",57135872328,403010,4030,40,40301020,"US0010551028","AFL.N","2026361"],["AG.N",2913147209.12017,151040,1510,15,15104045,"","AG.N",""],["AGCO.N",6258176794.74,201060,2010,20,20106015,"US0010841023","AGCO.N","2010278"],["AGD.N",223785729,"","","","","US00302M1062","AGD.N","BG1Z1K2"],["AGI.N",11683222829.9702,151040,1510,15,15104030,"CA0115321089","AGI.N","BYNBW45"],["AGL.N",2267666863,351020,3510,35,35102015,"","AGL.N",""],["AGM.N",1767533339.45,402010,4020,40,40201050,"","AGM.N",""],["AGM_pd.N",1767533339.45,402010,4020,40,40201050,"US3131488682","AGM_pd.N","BK6S6K9"],["AGM_pe.N",1767533339.45,402010,4020,40,40201050,"US3131488500","AGM_pe.N","BMZN5R9"],["AGM_pf.N",1767533339.45,402010,4020,40,40201050,"US3131488435","AGM_pf.N","BKY44P0"],["AGM_pg.N",1767533339.45,402010,4020,40,40201050,"US3131488351","AGM_pg.N","BMBQGR9"],["AGMa.N",1767533339.45,402010,4020,40,40201050,"","AGMa.N",""],["AGO.N",3992891546.16,403010,4030,40,40301040,"","AGO.N",""],["AGRO.N",1115255019.06,302020,3020,30,30202030,"","AGRO.N",""],["AGS.N",492213296.57,253010,2530,25,25301010,"","AGS.N",""],["AGX.N",1881521532,201030,2010,20,20103010,"","AGX.N",""],["AHH.N",660607097.64,601010,6010,60,60101010,"","AHH.N",""],["AHH_pa.N",660607097.64,601010,6010,60,60101010,"US04208T2078","AHH_pa.N","BK645V1"],["AHL_pd.N",275110000,403010,4030,40,40301040,"BMG053841620","AHL_pd.N","BD915N2"],["AHL_pe.N",275110000,403010,4030,40,40301040,"BMG053842040","AHL_pe.N","BKDJPD1"],["AHL_pf.N",null,403010,4030,40,40301040,"BMG053841703","AHL_pf.N","BS0CHC2"],["AHM.N",null,"","","","",null,null,null],["AHR.N",4563090943.2,601050,6010,60,60105010,"US3981823038","AHR.N","BQWNKQ4"],["AHT.N",33380465.26,601030,6010,60,60103010,"","AHT.N",""],["AHT_pd.N",33380465.26,601030,6010,60,60103010,"US0441034065","AHT_pd.N","B23NM25"],["AHT_pf.N",33380465.26,601030,6010,60,60103010,"US0441036045","AHT_pf.N","BZ77ZD6"],["AHT_pg.N",33380465.26,601030,6010,60,60103010,"US0441037035","AHT_pg.N","BYMPGX5"],["AHT_ph.N",33380465.26,601030,6010,60,60103010,"US0441038025","AHT_ph.N","BF2N6M5"],["AHT_pi.N",33380465.26,601030,6010,60,60103010,"US0441038850","AHT_pi.N","BZ7MMX0"],["AI.N",2694596056.6,451030,4510,45,45103010,"","AI.N",""],["AIFD.N",49763487.03,"","","","","US29287L5021","AIFD.N","BNZHS24"],["AIG.N",47489942091.75,403010,4030,40,40301040,"US0268747849","AIG.N","2027342"],["AIN.N",1962694583.1,201060,2010,20,20106020,"","AIN.N",""],["AIO.N",668280122.06,"","","","","US92838Y1001","AIO.N","BLBNHT2"],["AIR.N",1881008084.2,201010,2010,20,20101010,"","AIR.N",""],["AIT.N",8469092412.72,201070,2010,20,20107010,"US03820C1053","AIT.N","2086309"],["AIV.N",1064757405,601060,6010,60,60106010,"","AIV.N",""],["AIZ.N",9681186150.48,403010,4030,40,40301040,"US04621X1081","AIZ.N","2331430"],["AIZN.N",9681186150.48,403010,4030,40,40301040,"US04621X3061","AIZN.N","BLD4BS0"],["AJG.N",83297939707.44,403010,4030,40,40301010,"US3635761097","AJG.N","2359506"],["AKA.N",115592951.5,255040,2550,25,25504010,"US00152K2006","AKA.N","BKPJGF8"],["AKOa.N",2974417398.67333,302010,3020,30,30201030,"US29081P2048","AKOa.N","2299765"],["AKOb.N",2974417398.67333,302010,3020,30,30201030,"","AKOb.N",""],["AKR.N",2224183235.82,601070,6010,60,60107010,"","AKR.N",""],["AL.N",4550831977.2,201070,2010,20,20107010,"US00912X3026","AL.N","B3XS562"],["ALB.N",6436662575.28,151010,1510,15,15101050,"US0126531013","ALB.N","2046853"],["ALB_pa.N",6436662575.28,151010,1510,15,15101050,"US0126532003","ALB_pa.N","BPCTR42"],["ALC.N",43943009838.455,351010,3510,35,35101020,"CH0432492467","ALC.N","BJXBP41"],["ALE.N",3744927469.01,551010,5510,55,55101010,"","ALE.N",""],["ALEX.N",1163382624,601010,6010,60,60101010,"US0144911049","ALEX.N","B827VB2"],["ALG.N",2043533181.04,201060,2010,20,20106015,"US0113111076","ALG.N","2021634"],["ALIT.N",2710017253.7,202020,2020,20,20202010,"US01626W1018","ALIT.N","BNG7BZ7"],["ALK.N",5463681950.35,203020,2030,20,20302010,"US0116591092","ALK.N","2012605"],["ALL.N",50564319697.92,403010,4030,40,40301040,"US0200021014","ALL.N","2019952"],["ALLE.N",10534326050.08,201020,2010,20,20102010,"IE00BFRT3W74","ALLE.N","BFRT3W7"],["ALLY.N",9825255879.74,402020,4020,40,40202010,"US02005N1000","ALLY.N","B72XK05"],["ALL_pb.N",null,403010,4030,40,40301040,"US0200023093","ALL_pb.N","B87XV26"],["ALL_ph.N",50564319697.92,403010,4030,40,40301040,"US0200028381","ALL_ph.N","BKDKS91"],["ALL_pi.N",50564319697.92,403010,4030,40,40301040,"US0200028126","ALL_pi.N","BK727P2"],["ALL_pj.N",null,403010,4030,40,40301040,"US0200027888","ALL_pj.N","BNBXR41"],["ALSN.N",7553604575.99,201060,2010,20,20106010,"US01973R1014","ALSN.N","B4PZ892"],["ALTG.N",140639473.2,201070,2010,20,20107010,"","ALTG.N",""],["ALTG_pa.N",140639473.2,201070,2010,20,20107010,"US02128L2051","ALTG_pa.N","BMFQ222"],["ALUR.N",14073975.64,253020,2530,25,25302020,"US02008G2012","ALUR.N","BR84PL8"],["ALUR_t.N","",253020,2530,25,25302020,"US02008G1105","ALUR_t.N","BPJJT49"],["ALV.N",6161254885.4,251010,2510,25,25101010,"US0528001094","ALV.N","2064253"],["ALVU.N",null,"","","","",null,null,null],["ALX.N",1017831824.1,601070,6010,60,60107010,"","ALX.N",""],["AM.N",7600263280,101020,1010,10,10102040,"","AM.N",""],["AMBC.N",302886292.1,403010,4030,40,40301040,"","AMBC.N",""],["AMBP.N",1571949911.18,151030,1510,15,15103010,"LU2369833749","AMBP.N","BMWT6B1"],["AMBP_t.N","",151030,1510,15,15103010,"LU2369834044","AMBP_t.N","BMWT699"],["AMC.N",1261293416,502020,5020,50,50202010,"","AMC.N",""],["AMCR.N",13036995772.24,151030,1510,15,15103020,"JE00BJ1F3079","AMCR.N","BJ1F307"],["AME.N",36324178572.2,201040,2010,20,20104010,"US0311001004","AME.N","2089212"],["AMG.N",4491829359.42,402030,4020,40,40203010,"US0082521081","AMG.N","2127899"],["AMH.N",12711301130.64,601060,6010,60,60106020,"US02665T3068","AMH.N","BCF5RR9"],["AMH_pg.N",12711301130.64,601060,6010,60,60106020,"US02665T8760","AMH_pg.N","BDFG5B9"],["AMH_ph.N",12711301130.64,601060,6010,60,60106020,"US02665T8687","AMH_ph.N","BFY78Q3"],["AMN.N",734980525.24,351020,3510,35,35102015,"US0017441017","AMN.N","2813552"],["AMP.N",43740987193.12,402030,4020,40,40203010,"US03076C1062","AMP.N","B0J7D57"],["AMPS.N",804477041.56,551050,5510,55,55105020,"","AMPS.N",""]],"error":[{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":38},{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":39},{"code":416,"col":6,"message":"Unable to collect data for the field 'TR.ISINCode' and some specific identifier(s).","row":39},{"code":416,"col":7,"message":"Unable to collect data for the field 'TR.RICCode' and some specific identifier(s).","row":39},{"code":416,"col":8,"message":"Unable to collect data for the field 'TR.SEDOLCode' and some specific identifier(s).","row":39},{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":74},{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":77},{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":84},{"code":416,"col":6,"message":"Unable to collect data for the field 'TR.ISINCode' and some specific identifier(s).","row":84},{"code":416,"col":7,"message":"Unable to collect data for the field 'TR.RICCode' and some specific identifier(s).","row":84},{"code":416,"col":8,"message":"Unable to collect data for the field 'TR.SEDOLCode' and some specific identifier(s).","row":84}],"headerOrientation":"horizontal","headers":[[{"displayName":"Instrument"},{"displayName":"Company Market Cap","field":"TR.COMPANYMARKETCAP"},{"displayName":"GICS Industry Code","field":"TR.GICSINDUSTRYCODE"},{"displayName":"GICS Industry Group Code","field":"TR.GICSINDUSTRYGROUPCODE"},{"displayName":"GICS Sector Code","field":"TR.GICSSECTORCODE"},{"displayName":"GICS Sub-Industry Code","field":"TR.GICSSUBINDUSTRYCODE"},{"displayName":"ISIN Code","field":"TR.ISINCODE"},{"displayName":"RIC Code","field":"TR.RICCODE"},{"displayName":"SEDOL Code","field":"TR.SEDOLCODE"}]],"rowHeadersCount":1,"totalColumnsCount":9,"totalRowsCount":101}]}

Some RICs without ISIN and SEDOL:

["AIR.N",1881008084.2,201010,2010,20,20101010,"","AIR.N",""]

["AHT.N",33380465.26,601030,6010,60,60103010,"","AHT.N",""]

["ALX.N",1017831824.1,601070,6010,60,60107010,"","ALX.N",""]

Now, as example, I send request only for these 3 RICs:

image.png

All data is present.

What's going on there? How can I rely on the response from the server if it looks like a random behavior?

Please advise on how we should deal with this.

FYI, I sent the same request the second time and I've got more data. (not sure if something else is missing).

Answers

  • Jirapongse
    Jirapongse ✭✭✭✭✭

    @igorg

    Thank you for reaching out to us.

    I ran the code and could get the data properly.

    df = ld.get_data(
        universe=['ADM.N', 'ADNT.N', 'ADT.N', 'ADX.N', 'AEE.N', 'AEFC.N', 'AEG.N', 'AEM.N', 'AEO.N', 'AER.N', 'AES.N', 'AESI.N', 'AFB.N', 'AFG.N', 'AFGB.N', 'AFGC.N', 'AFGD.N', 'AFGE.N', 'AFL.N', 'AG.N', 'AGCO.N', 'AGD.N', 'AGI.N', 'AGL.N', 'AGM.N', 'AGM_pd.N', 'AGM_pe.N', 'AGM_pf.N', 'AGM_pg.N', 'AGMa.N', 'AGO.N', 'AGRO.N', 'AGS.N', 'AGX.N', 'AHH.N', 'AHH_pa.N', 'AHL_pd.N', 'AHL_pe.N', 'AHL_pf.N', 'AHM.N', 'AHR.N', 'AHT.N', 'AHT_pd.N', 'AHT_pf.N', 'AHT_pg.N', 'AHT_ph.N', 'AHT_pi.N', 'AI.N', 'AIFD.N', 'AIG.N', 'AIN.N', 'AIO.N', 'AIR.N', 'AIT.N', 'AIV.N', 'AIZ.N', 'AIZN.N', 'AJG.N', 'AKA.N', 'AKOa.N', 'AKOb.N', 'AKR.N', 'AL.N', 'ALB.N', 'ALB_pa.N', 'ALC.N', 'ALE.N', 'ALEX.N', 'ALG.N', 'ALIT.N', 'ALK.N', 'ALL.N', 'ALLE.N', 'ALLY.N', 'ALL_pb.N', 'ALL_ph.N', 'ALL_pi.N', 'ALL_pj.N', 'ALSN.N', 'ALTG.N', 'ALTG_pa.N', 'ALUR.N', 'ALUR_t.N', 'ALV.N', 'ALVU.N', 'ALX.N', 'AM.N', 'AMBC.N', 'AMBP.N', 'AMBP_t.N', 'AMC.N', 'AMCR.N', 'AME.N', 'AMG.N', 'AMH.N', 'AMH_pg.N', 'AMH_ph.N', 'AMN.N', 'AMP.N', 'AMPS.N'],
        fields=[
            'TR.COMPANYMARKETCAP',
            'TR.GICSINDUSTRYCODE',
            'TR.GICSINDUSTRYGROUPCODE',
            'TR.GICSSECTORCODE',
            'TR.GICSSUBINDUSTRYCODE',
            'TR.ISINCODE',
            'TR.RICCode',
            'TR.SEDOLCODE'       
        ],
        parameters={'SDate':'2025-04-10'})
    
    df[df['Instrument']=='AIR.N']
    
    image.png

    Does the problem happen intermittently?

  • igorg
    igorg Advocate

    Yes, it happens randomly.

    Even if I re-run the query immediately it may return the correct result.

    I gave you the line from lseg-data log. It's generated by that module.

    I will monitor the responses and will post more evidence when it happens.

  • igorg
    igorg Advocate

    Example, from yesterday:

    Request:

    json = {'Entity': {'E': 'DataGrid_StandardAsync', 'W': {'requests': [{'instruments': ['WHG.N', 'WHR.N', 'WIA.N', 'WINN.N', 'WIT.N', 'WIW.N', 'WK.N', 'WKC.N', 'WLK.N', 'WLKP.N', 'WLTG.N', 'WLY.N', 'WLYB.N', 'WM.N', 'WMB.N', 'WMK.N', 'WMS.N', 'WMT.N', 'WNC.N', 'WNS.N', 'WOLF.N', 'WOR.N', 'WOW.N', 'WPC.N', 'WPM.N', 'WPP.N', 'WRB.N', 'WRBY.N', 'WRB_pe.N', 'WRB_pf.N', 'WRB_pg.N', 'WRB_ph.N', 'WS.N', 'WSM.N', 'WSO.N', 'WSOb.N', 'WSR.N', 'WST.N', 'WT.N', 'WTI.N', 'WTM.N', 'WTRG.N', 'WTS.N', 'WTTR.N', 'WU.N', 'WWW.N', 'WY.N', 'X.N', 'XFLT.N', 'XFLT_pa.N', 'XHR.N', 'XIFR.N', 'XIN.N', 'XOM.N', 'XPER.N', 'XPEV.N', 'XPO.N', 'XPOF.N', 'XPRO.N', 'XYF.N', 'XYL.N', 'XYZ.N', 'YALA.N', 'YELP.N', 'YETI.N', 'YEXT.N', 'YMM.N', 'YOU.N', 'YPF.N', 'YRD.N', 'YSG.N', 'YUM.N', 'YUMC.N', 'YXR.N', 'ZBH.N', 'ZEPP.N', 'ZETA.N', 'ZGN.N', 'ZH.N', 'ZIM.N', 'ZIP.N', 'ZK.N', 'ZKH.N', 'ZTO.N', 'ZTR.N', 'ZTS.N', 'ZVIA.N', 'ZWS.N'], 'fields': [{'name': 'TR.COMPANYMARKETCAP'}, {'name': 'TR.GICSINDUSTRYCODE'}, {'name': 'TR.GICSINDUSTRYGROUPCODE'}, {'name': 'TR.GICSSECTORCODE'}, {'name': 'TR.GICSSUBINDUSTRYCODE'}, {'name': 'TR.ISINCODE'}, {'name': 'TR.RICCODE'}, {'name': 'TR.SEDOLCODE'}], 'parameters': {'SDATE': '2025-04-15'}}]}}}

    Response:

    {"responses":[{"columnHeadersCount":1,"data":[["WHG.N",142477263.25,402030,4020,40,40203010,"US9617651040","WHG.N","2958293"],["WHR.N",4399145798.19,252010,2520,25,25201040,"US9633201069","WHR.N","2960384"],["WIA.N",189376718.72,"","","","","US95766Q1067","WIA.N","2461575"],["WINN.N",697236000,"","","","","US41151J4067","WINN.N","BM96HM3"],["WIT.N",29670632029.8997,451020,4510,45,45102010,"US97651M1099","WIT.N","2646123"],["WIW.N",520065139,"","","","","US95766R1041","WIW.N","2414137"],["WK.N",3896268447.24,451030,4510,45,45103010,"","WK.N","BSS6HY8"],["WKC.N",1352338202,101020,1010,10,10102030,"","WKC.N","2469450"],["WLK.N",11570434990.3,151010,1510,15,15101010,"US9604131022","WLK.N","B01ZP20"],["WLKP.N",808372474.64,151010,1510,15,15101010,"US9604171036","WLKP.N","BP9F5H2"],["WLTG.N",42692369.5,"","","","","US26923N8011","WLTG.N","BMB5CY5"],["WLY.N",2303799359.73,502010,5020,50,50201040,"","WLY.N","2965668"],["WLYB.N",2303799359.73,502010,5020,50,50201040,"US9682233054","WLYB.N","2965679"],["WM.N",93131909507.52,202010,2020,20,20201050,"US94106L1098","WM.N","2937667"],["WMB.N",71459002169.38,101020,1010,10,10102040,"","WMB.N","2967181"],["WMK.N",2145957782.54,301010,3010,30,30101030,"","WMK.N","2946845"],["WMS.N",8140684925.34,201020,2010,20,20102010,"","WMS.N","BP7RS59"],["WMT.N",753343342252.68,301010,3010,30,30101040,"US9311421039","WMT.N","2936921"],["WNC.N",387773458.94,201060,2010,20,20106010,"US9295661071","WNC.N","2932048"],["WNS.N",2923015527.9,202020,2020,20,20202030,"JE00BQC4YW14","WNS.N","BQC4YW1"],["WOLF.N",353146446.94,453010,4530,45,45301020,"US9778521024","WOLF.N","BMBVND9"],["WOR.N",2375560785.34,201060,2010,20,20106020,"","WOR.N","2981932"],["WOW.N",359895457,502010,5020,50,50201030,"US96758W1018","WOW.N","BYQN8D9"],["WPC.N",13261171298.88,601010,6010,60,60101010,"","WPC.N","B826YT8"],["WPM.N",38078414687.2054,151040,1510,15,15104030,"","WPM.N","BDG1S92"],["WPP.N",7882466682.47583,502010,5020,50,50201010,"US92937A1025","WPP.N","B7YQHN4"],["WRB.N",27137017404.48,403010,4030,40,40301040,"US0844231029","WRB.N","2093644"],["WRBY.N",1786293197.02,255040,2550,25,25504040,"US93403J1060","WRBY.N","BLGZN51"],["WRB_pe.N",27137017404.48,403010,4030,40,40301040,"US0844237067","WRB_pe.N","BFMXK34"],["WRB_pf.N",27137017404.48,403010,4030,40,40301040,"US0844238057","WRB_pf.N","BJBK4B0"],["WRB_pg.N",27137017404.48,403010,4030,40,40301040,"US0844238883","WRB_pg.N","BN0W233"],["WRB_ph.N",27137017404.48,403010,4030,40,40301040,"US0844238701","WRB_ph.N","BNKBJW8"],["WS.N",1220817536.76,151040,1510,15,15104050,"US9821041012","WS.N","BS70KN1"],["WSM.N",17649506835.5,255040,2550,25,25504060,"US9699041011","WSM.N","2967589"],["WSO.N",23462231377.6,201070,2010,20,20107010,"","WSO.N","2943039"],["WSOb.N",23462231377.6,201070,2010,20,20107010,"US9426221019","WSOb.N","2943501"],["WSR.N",666723779.5,601070,6010,60,60107010,"US9660842041","WSR.N","B6452T5"],["WST.N",15362205337.5,352030,3520,35,35203010,"","WST.N","2950482"],["WT.N",1229320084.52,402030,4020,40,40203010,"","WT.N","2476513"],["WTI.N",165351994.08,101020,1010,10,10102020,"US92922P1066","WTI.N","B01Z7M4"],["WTM.N",4527235508.52,403010,4030,40,40301040,"","WTM.N","2339252"],["WTRG.N",10996172857.41,551040,5510,55,55104010,"","WTRG.N","BLCF3J9"],["WTS.N",6619566823.69,201060,2010,20,20106020,"","WTS.N","2943620"],["WTTR.N",989815954.4,101010,1010,10,10101020,"US81617J3014","WTTR.N","BDHSLL5"],["WU.N",3294811086,402010,4020,40,40201060,"","WU.N","B1F76F9"],["WWW.N",871124078.5,252030,2520,25,25203020,"","WWW.N","2977500"],["WY.N",18763194452.75,601080,6010,60,60108040,"US9621661043","WY.N","2958936"],["X.N",9370920582.14,151040,1510,15,15104050,"","X.N","2824770"],["XFLT.N",325808584.96,"","","","","US98400T1060","XFLT.N","BYWMJ15"],["XFLT_pa.N",325808584.96,"","","","","US98400T2050","XFLT_pa.N","BN7QJW6"],["XHR.N",992046867.3,601030,6010,60,60103010,"","XHR.N","BVV6CY1"],["XIFR.N",822169188.75,551050,5510,55,55105020,"US65341B1061","XIFR.N","BNGY4Q0"],["XIN.N",9214806.24,602010,6020,60,60201030,"US98417P2048","XIN.N","BP5J9J8"],["XOM.N",445937775727.4,101020,1010,10,10102010,"US30231G1022","XOM.N","2326618"],["XPER.N",297234231.27,451030,4510,45,45103020,"US98423J1016","XPER.N","BQV3RS6"],["XPEV.N",18854332992.74,251020,2510,25,25102010,"US98422D1054","XPEV.N","BMXR2T4"],["XPO.N",11280256946.16,203040,2030,20,20304030,"US9837931008","XPO.N","B6Z1355"],["XPOF.N",363630000,253010,2530,25,25301030,"","XPOF.N","BP0TJN7"],["XPRO.N",936345693.69,101010,1010,10,10101020,"NL0010556684","XPRO.N","BCRY5H0"],["XYF.N",564194274.3,402020,4020,40,40202010,"US98372W2026","XYF.N","BN0TDW0"],["XYL.N",26559161155.8,201060,2010,20,20106020,"US98419M1009","XYL.N","B3P2CN8"],["XYZ.N",34120958400,402010,4020,40,40201060,"US8522341036","XYZ.N","BYNZGK1"],["YALA.N",965576155.3,502030,5020,50,50203010,"US98459U1034","YALA.N","BMY5866"],["YELP.N",2203324036.76,502030,5020,50,50203010,"","YELP.N","B7KCD72"],["YETI.N",2337863367.2,252020,2520,25,25202010,"","YETI.N","BGR7KH2"],["YEXT.N",771557164.1,451030,4510,45,45103010,"","YEXT.N","BD8ZJW2"],["YMM.N",10793628071.76,203040,2030,20,20304030,"US35969L1089","YMM.N","BMD2L36"],["YOU.N",3620367859.28,451030,4510,45,45103010,"","YOU.N","BLD30T1"],["YPF.N",13374824139.2842,101020,1010,10,10102010,"US9842451000","YPF.N","2985945"],["YRD.N",495526895.1,402020,4020,40,40202010,"US98585L1008","YRD.N","BYPHX26"],["YSG.N",382639270.89,303020,3030,30,30302010,"US9851942089","YSG.N","BQKW4W7"],["YUM.N",40298651642.34,253010,2530,25,25301040,"","YUM.N","2098876"],["YUMC.N",16709863379.04,253010,2530,25,25301040,"US98850P1093","YUMC.N","BYW4289"],["YXR.N",null,null,null,null,null,null,null,null],["ZBH.N",19244026071.83,351010,3510,35,35101010,"US98956P1021","ZBH.N","2783815"],["ZEPP.N",36975002.55,452030,4520,45,45203010,"US98945L2043","ZEPP.N","BQ95T22"],["ZETA.N",2847915022.88,451030,4510,45,45103010,"US98956A1051","ZETA.N","BN0TQF4"],["ZGN.N",1730172171.15,252030,2520,25,25203010,"NL0015000PB5","ZGN.N","BLCY7G1"],["ZH.N",338385119.284176,502030,5020,50,50203010,"US98955N2071","ZH.N","BQSB1R0"],["ZIM.N",1667131938.4,203030,2030,20,20303010,"","ZIM.N","BLC90J0"],["ZIP.N",533957283.68,502030,5020,50,50203010,"US98980B1035","ZIP.N","BMGH6N3"],["ZK.N",4954301751.86,251020,2510,25,25102010,"US98923K1034","ZK.N","BS561Z0"],["ZKH.N",485053095,201070,2010,20,20107010,"US98877R1041","ZKH.N","BP2FHC8"],["ZTO.N",15267694037.983,203010,2030,20,20301010,"US98980A1051","ZTO.N","BYYDFN0"],["ZTR.N",320514539.19,"","","","","US92835W1071","ZTR.N","BD87V44"],["ZTS.N",66561208542.54,352020,3520,35,35202010,"US98978V1035","ZTS.N","B95WG16"],["ZVIA.N",170540174.72,302010,3020,30,30201030,"US98955K1043","ZVIA.N","BNLYJG0"],["ZWS.N",4971017373.65,201020,2010,20,20102010,"","ZWS.N","BMV1ZD3"]],"error":[{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":73},{"code":416,"col":2,"message":"Unable to collect data for the field 'TR.GICSIndustryCode' and some specific identifier(s).","row":73},{"code":416,"col":3,"message":"Unable to collect data for the field 'TR.GICSIndustryGroupCode' and some specific identifier(s).","row":73},{"code":416,"col":4,"message":"Unable to collect data for the field 'TR.GICSSectorCode' and some specific identifier(s).","row":73},{"code":416,"col":5,"message":"Unable to collect data for the field 'TR.GICSSubIndustryCode' and some specific identifier(s).","row":73},{"code":416,"col":6,"message":"Unable to collect data for the field 'TR.ISINCode' and some specific identifier(s).","row":73},{"code":416,"col":7,"message":"Unable to collect data for the field 'TR.RICCode' and some specific identifier(s).","row":73},{"code":416,"col":8,"message":"Unable to collect data for the field 'TR.SEDOLCode' and some specific identifier(s).","row":73}],"headerOrientation":"horizontal","headers":[[{"displayName":"Instrument"},{"displayName":"Company Market Cap","field":"TR.COMPANYMARKETCAP"},{"displayName":"GICS Industry Code","field":"TR.GICSINDUSTRYCODE"},{"displayName":"GICS Industry Group Code","field":"TR.GICSINDUSTRYGROUPCODE"},{"displayName":"GICS Sector Code","field":"TR.GICSSECTORCODE"},{"displayName":"GICS Sub-Industry Code","field":"TR.GICSSUBINDUSTRYCODE"},{"displayName":"ISIN Code","field":"TR.ISINCODE"},{"displayName":"RIC Code","field":"TR.RICCODE"},{"displayName":"SEDOL Code","field":"TR.SEDOLCODE"}]],"rowHeadersCount":1,"totalColumnsCount":9,"totalRowsCount":89}]}

    ["WK.N",3896268447.24,451030,4510,45,45103010,"","WK.N","BSS6HY8"]

    has no ISINCode.

    LSEG Workspace DIB show :

    image.png

    And if I run the query now (with 1 RIC) it returns correct result.

  • Jirapongse
    Jirapongse ✭✭✭✭✭

    @igorg

    It should be the problem on the backend service.

    I will contact the product team to investigate this issue.

  • igorg
    igorg Advocate

    Yes, it looks like it is a server side issue. Please keep me posted. I can collect more evidence if required.

  • Jirapongse
    Jirapongse ✭✭✭✭✭

    @igorg

    The product team couldn't replicate this issue.

    Can you share the full log (lseg-data-lib.log) when the problem occurred again?

    config = ld.get_config()
    config.set_param("logs.transports.file.enabled", True)
    config.set_param("logs.transports.file.name", "lseg-data-lib.log")
    config.set_param("logs.level", "debug")

    ld.open_session()
  • igorg
    igorg Advocate
    edited April 24

    Debug log was already activated. That snipped was taken from there. Here is another example that happened yesterday:

    [2025-04-23T17:16:03.780180-04:00] - [sessions.desktop.workspace.0] - [DEBUG] - [14868 - MainThread] - [_data_df_builder] - [build_df] - [DataDFBuilder.build_df] Start
    [2025-04-23T17:16:03.795808-04:00] - [sessions.desktop.workspace.0] - [DEBUG] - [14868 - MainThread] - [_data_df_builder] - [build_df] - [DataDFBuilder.build_df] End
    [2025-04-23T17:16:03.827055-04:00] - [sessions.desktop.workspace.0] - [DEBUG] - [14868 - MainThread] - [http_service] - [build_request] - HTTP Request id 155
    url = http://localhost:9000/api/udf
    method = POST
    headers = {'Content-Type': 'application/json', 'Authorization': 'Bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJBcGlWZXJzaW9uIjoiMSIsIkFwcEtleSI6ImRkN2JmYjgzMzA2ZTQ4MTJhNTc0NmM2NGU5NDc4MmY4M2Y2NWUyOGMiLCJBcHBTY29wZSI6InRyYXBpIiwiTGlicmFyeU5hbWUiOiJSRFAgUHl0aG9uIExpYnJhcnkiLCJMaWJyYXJ5VmVyc2lvbiI6IjIuMS4xIiwiaWF0IjoxNzQ1NDQyMTczLCJleHAiOjE3NDY2NTE3NzN9.noIei4BPkkwX1cSswlWAZi2XB8HF8_wX-TUzSWczwXE', 'x-tr-applicationid': 'dd7bfb83306e4812a5746c64e94782f83f65e28c'}
    json = {'Entity': {'E': 'DataGrid_StandardAsync', 'W': {'requests': [{'instruments': ['AVA.N', 'AVAL.N', 'AVAN_u.N', 'AVB.N', 'AVD.N', 'AVK.N', 'AVNS.N', 'AVNT.N', 'AVTR.N', 'AVY.N', 'AWF.N', 'AWI.N', 'AWK.N', 'AWP.N', 'AWR.N', 'AX.N', 'AXL.N', 'AXP.N', 'AXR.N', 'AXS.N', 'AXS_pe.N', 'AXTA.N', 'AYI.N', 'AZEK.N', 'AZO.N', 'AZUL.N', 'AZZ.N', 'BA.N', 'BABA.N', 'BAC.N', 'BAC_pb.N', 'BAC_pe.N', 'BAC_pk.N', 'BAC_pl.N', 'BAC_pm.N', 'BAC_pn.N', 'BAC_po.N', 'BAC_pp.N', 'BAC_pq.N', 'BAC_ps.N', 'BAH.N', 'BAK.N', 'BALL.N', 'BALY.N', 'BAM.N', 'BANC.N', 'BANC_pf.N', 'BAP.N', 'BARK.N', 'BARK_t.N', 'BAX.N', 'BA_pa.N', 'BB.N', 'BBAI.N', 'BBAI_t.N', 'BBAR.N', 'BBCO.N', 'BBD.N', 'BBDC.N', 'BBDO.N', 'BBN.N', 'BBU.N', 'BBUC.N', 'BBVA.N', 'BBW.N', 'BBWI.N', 'BBY.N', 'BC.N', 'BCAT.N', 'BCC.N', 'BCE.N', 'BCH.N', 'BCO.N', 'BCS.N', 'BCSF.N', 'BCX.N', 'BC_pa.N', 'BC_pc.N', 'BDC.N', 'BDJ.N', 'BDN.N', 'BDX.N', 'BE.N', 'BEDU.N', 'BEKE.N', 'BEN.N', 'BEP.N', 'BEPC.N', 'BEPH.N', 'BEPI.N', 'BEPJ.N', 'BEP_pa.N', 'BERY.N', 'BFAM.N', 'BFH.N', 'BFK.N', 'BFLY.N', 'BFLY_t.N', 'BFa.N', 'BFb.N'], 'fields': [{'name': 'TR.COMPANYMARKETCAP'}, {'name': 'TR.GICSINDUSTRYCODE'}, {'name': 'TR.GICSINDUSTRYGROUPCODE'}, {'name': 'TR.GICSSECTORCODE'}, {'name': 'TR.GICSSUBINDUSTRYCODE'}, {'name': 'TR.ISINCODE'}, {'name': 'TR.RICCODE'}, {'name': 'TR.SEDOLCODE'}], 'parameters': {'SDATE': '2025-04-23'}}]}}}

    Response has empty value in TR.ISINCode for AVK, AWP, AXP, AXR, AXTA, AZZ, BAC…

    [2025-04-23T17:16:08.736643-04:00] - [sessions.desktop.workspace.0] - [DEBUG] - [14868 - MainThread] - [http_service] - [request] - HTTP Response id 155
    status_code = 200
    text = {"responses":[{"columnHeadersCount":1,"data":[["AVA.N",3332807473.17,551030,5510,55,55103010,"US05379B1070","AVA.N","2942605"],["AVAL.N",3123423390.37353,401010,4010,40,40101010,"US40053W1018","AVAL.N","BQRX1Y4"],["AVAN_u.N",null,null,null,null,null,null,null,null],["AVB.N",29387730333.98,601060,6010,60,60106010,"US0534841012","AVB.N","2131179"],["AVD.N",122636151.54,151010,1510,15,15101030,"US0303711081","AVD.N","2025711"],["AVK.N",478130908.35,"","","","","","AVK.N","2627485"],["AVNS.N",571819154.5,351010,3510,35,35101020,"US05350V1061","AVNS.N","BFFVV54"],["AVNT.N",2990371806.18,151010,1510,15,15101050,"US05368V1061","AVNT.N","BMHWY55"],["AVTR.N",10541594008.4,352030,3520,35,35203010,"US05352A1007","AVTR.N","BJLT387"],["AVY.N",13443960819,151030,1510,15,15103020,"US0536111091","AVY.N","2066408"],["AWF.N",889890266.64,"","","","","US01879R1068","AWF.N","2019792"],["AWI.N",5828990835.72,201020,2010,20,20102010,"US04247X1028","AWI.N","B1FT462"],["AWK.N",28699760775.65,551040,5510,55,55104010,"US0304201033","AWK.N","B2R3PV1"],["AWP.N",323246718.96,"","","","","","AWP.N","BG1Z6R4"],["AWR.N",3084915614.56,551040,5510,55,55104010,"US0298991011","AWR.N","2267171"],["AX.N",3542389451.04,401010,4010,40,40101015,"US05465C1009","AX.N","BGK38H3"],["AXL.N",401150473.47,251010,2510,25,25101010,"US0240611030","AXL.N","2382416"],["AXP.N",182251188641.8,402020,4020,40,40202010,"","AXP.N","2026082"],["AXR.N",122140071.9,602010,6020,60,60201030,"","AXR.N","2031804"],["AXS.N",7477329559.53,403010,4030,40,40301040,"BMG0692U1099","AXS.N","2677606"],["AXS_pe.N",7477329559.53,403010,4030,40,40301040,"US05461T3059","AXS_pe.N","BD2Z8N2"],["AXTA.N",6919632110.26,151010,1510,15,15101050,"","AXTA.N","BSFWCF5"],["AYI.N",7237629772.12,201040,2010,20,20104010,"US00508Y1029","AYI.N","2818461"],["AZEK.N",6962239279.6,201020,2010,20,20102010,"US05478C1053","AZEK.N","BKPVG43"],["AZO.N",61094895516.27,255040,2550,25,25504050,"US0533321024","AZO.N","2065955"],["AZUL.N",227103792.321397,203020,2030,20,20302010,"US05501U1060","AZUL.N","BDCT500"],["AZZ.N",2441805128.55,201020,2010,20,20102010,"","AZZ.N","2067672"],["BA.N",129692478189.45,201010,2010,20,20101010,"US0970231058","BA.N","2108601"],["BABA.N",284088386740.23,255030,2550,25,25503030,"US01609W1027","BABA.N","BP41ZD1"],["BAC.N",292953282745,401010,4010,40,40101010,"","BAC.N","2295677"],["BAC_pb.N",292953282745,401010,4010,40,40101010,"","BAC_pb.N","BFZNM46"],["BAC_pe.N",292953282745,401010,4010,40,40101010,"","BAC_pe.N","B1GH4Y3"],["BAC_pk.N",292953282745,401010,4010,40,40101010,"","BAC_pk.N","BYVQZ09"],["BAC_pl.N",292953282745,401010,4010,40,40101010,"","BAC_pl.N","B2PB3Z7"],["BAC_pm.N",292953282745,401010,4010,40,40101010,"","BAC_pm.N","BJN6RX9"],["BAC_pn.N",292953282745,401010,4010,40,40101010,"","BAC_pn.N","BKVJXF1"],["BAC_po.N",292953282745,401010,4010,40,40101010,"","BAC_po.N","BMVXBP3"],["BAC_pp.N",292953282745,401010,4010,40,40101010,"","BAC_pp.N","BN4Q1G7"],["BAC_pq.N",292953282745,401010,4010,40,40101010,"","BAC_pq.N","BMH4QB1"],["BAC_ps.N",292953282745,401010,4010,40,40101010,"","BAC_ps.N","BN7SQB0"],["BAH.N",14744081217.68,202020,2020,20,20202020,"US0995021062","BAH.N","B5367T7"],["BAK.N",1518097436.10131,151010,1510,15,15101010,"US1055321053","BAK.N","2222835"],["BALL.N",13695375292,151030,1510,15,15103010,"US0584981064","BALL.N","2073022"],["BALY.N",728624309.4,253010,2530,25,25301010,"","BALY.N","BSPS220"],["BAM.N",82831684956.59,402030,4020,40,40203010,"CA1130041058","BAM.N","BP95GD5"],["BANC.N",2188682041.5,401010,4010,40,40101015,"US05990K1060","BANC.N","BCD47X4"],["BANC_pf.N",2188682041.5,401010,4010,40,40101015,"US05990K8412","BANC_pf.N","BMWDYS6"],["BAP.N",15295040191.1,401010,4010,40,40101010,"","BAP.N","2232878"],["BARK.N",209897823.6,255040,2550,25,25504040,"","BARK.N","BNVVLD2"],["BARK_t.N","",255040,2550,25,25504040,"US68622E1120","BARK_t.N","BNVVLG5"],["BAX.N",15182552353.6,351010,3510,35,35101010,"","BAX.N","2085102"],["BA_pa.N",null,201010,2010,20,20101010,"US0970232049","BA_pa.N","BRBLC59"],["BB.N",1886788640.90745,451030,4510,45,45103020,"CA09228F1036","BB.N","BCBHZ42"],["BBAI.N",780318759.6,451020,4510,45,45102010,"US08975B1098","BBAI.N","BM92RJ8"],["BBAI_t.N","",451020,4510,45,45102010,"US08975B1171","BBAI_t.N","BM92RD2"],["BBAR.N",4691322403.24251,401010,4010,40,40101010,"US0589341009","BBAR.N","BKT4TC7"],["BBCO.N",null,null,null,null,null,null,null,null],["BBD.N",22282971204.6236,401010,4010,40,40101010,"US0594603039","BBD.N","B00FSK0"],["BBDC.N",921274118.12,402030,4020,40,40203010,"US06759L1035","BBDC.N","BFZ4N57"],["BBDO.N",22282971204.6236,401010,4010,40,40101010,"US0594604029","BBDO.N","B7RL3L6"],["BBN.N",981883047.46,"","","","","","BBN.N","B680JB7"],["BBU.N",2967006822.16603,201050,2010,20,20105010,"BMG162341090","BBU.N","BYY9FP0"],["BBUC.N",1760107215.27346,201050,2010,20,20105010,"CA11259V1067","BBUC.N","BL5DCB5"],["BBVA.N",81316255076.2568,401010,4010,40,40101010,"US05946K1016","BBVA.N","2042152"],["BBW.N",437436646.4,255040,2550,25,25504040,"US1200761047","BBW.N","B034L50"],["BBWI.N",6156851331.36,255040,2550,25,25504040,"US0708301041","BBWI.N","BNNTGJ5"],["BBY.N",13415632129.79,255040,2550,25,25504020,"","BBY.N","2094670"],["BC.N",2983625191.26,252020,2520,25,25202010,"US1170431092","BC.N","2149309"],["BCAT.N",1463710535.87,"","","","","US09260U1097","BCAT.N","BMZ8B43"],["BCC.N",3550374276.39,201070,2010,20,20107010,"","BCC.N","B9BP4R1"],["BCE.N",20493131323.6616,501010,5010,50,50101020,"CA05534B7604","BCE.N","B188TJ4"],["BCH.N",14806067989.0519,401010,4010,40,40101010,"US0595201064","BCH.N","2834252"],["BCO.N",3926586516.36,202010,2020,20,20201080,"US1096961040","BCO.N","2691305"],["BCS.N",55960105072.3044,401010,4010,40,40101010,"US06738E2046","BCS.N","2077756"],["BCSF.N",975622345.28,402030,4020,40,40203010,"US05684B1070","BCSF.N","BG48294"],["BCX.N",708147086.14,"","","","","","BCX.N","B58DNB7"],["BC_pa.N",2983625191.26,252020,2520,25,25202010,"US1170434062","BC_pa.N","BG87WW0"],["BC_pc.N",2983625191.26,252020,2520,25,25202010,"US1170436042","BC_pc.N","BJT13Z2"],["BDC.N",3853678675.41,452030,4520,45,45203015,"US0774541066","BDC.N","B01WL78"],["BDJ.N",1431482534.01,"","","","","US09251A1043","BDJ.N","B0J2MX3"],["BDN.N",686966263.17,601040,6010,60,60104010,"US1053682035","BDN.N","2518954"],["BDX.N",58093238376.72,351010,3510,35,35101010,"US0758871091","BDX.N","2087807"],["BE.N",3978559605.34,201040,2010,20,20104020,"US0937121079","BE.N","BDD1BB8"],["BEDU.N",46372878.24,253020,2530,25,25302010,"","BEDU.N","BPJK050"],["BEKE.N",25559551009.7641,602010,6020,60,60201040,"","BEKE.N","BMBX7M2"],["BEN.N",9662068797.03,402030,4020,40,40203010,"","BEN.N","2350684"],["BEP.N",6270040668.30751,551050,5510,55,55105020,"BMG162581083","BEP.N","B6XZN93"],["BEPC.N",4924824598.08,551050,5510,55,55105020,"CA11285B1085","BEPC.N","BSPS5J8"],["BEPH.N","","","","","","","BEPH.N","BLFF1H0"],["BEPI.N","","","","","","US11259P2083","BEPI.N","BMV7W07"],["BEPJ.N","","","","","","US11259P3073","BEPJ.N","BRBHMW4"],["BEP_pa.N",6270040668.30751,551050,5510,55,55105020,"BMG162582313","BEP_pa.N","BL0FH99"],["BERY.N",7933458000,151030,1510,15,15103010,"US08579W1036","BERY.N","B8BR3H3"],["BFAM.N",6875618561.81,253020,2530,25,25302010,"","BFAM.N","B7MJWP2"],["BFH.N",2304553710.4,402020,4020,40,40202010,"US0185811082","BFH.N","2762030"],["BFK.N",415743845.28,"","","","","","BFK.N","2784034"],["BFLY.N",585444793.91,351010,3510,35,35101010,"","BFLY.N","BMHYQY4"],["BFLY_t.N","",351010,3510,35,35101010,"US1241551100","BFLY_t.N","BMHYQZ5"],["BFa.N",16326294823.97,302010,3020,30,30201020,"US1156371007","BFa.N","2146816"],["BFb.N",16326294823.97,302010,3020,30,30201020,"","BFb.N","2146838"]],"error":[{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":2},{"code":416,"col":2,"message":"Unable to collect data for the field 'TR.GICSIndustryCode' and some specific identifier(s).","row":2},{"code":416,"col":3,"message":"Unable to collect data for the field 'TR.GICSIndustryGroupCode' and some specific identifier(s).","row":2},{"code":416,"col":4,"message":"Unable to collect data for the field 'TR.GICSSectorCode' and some specific identifier(s).","row":2},{"code":416,"col":5,"message":"Unable to collect data for the field 'TR.GICSSubIndustryCode' and some specific identifier(s).","row":2},{"code":416,"col":6,"message":"Unable to collect data for the field 'TR.ISINCode' and some specific identifier(s).","row":2},{"code":416,"col":7,"message":"Unable to collect data for the field 'TR.RICCode' and some specific identifier(s).","row":2},{"code":416,"col":8,"message":"Unable to collect data for the field 'TR.SEDOLCode' and some specific identifier(s).","row":2},{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":51},{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":56},{"code":416,"col":2,"message":"Unable to collect data for the field 'TR.GICSIndustryCode' and some specific identifier(s).","row":56},{"code":416,"col":3,"message":"Unable to collect data for the field 'TR.GICSIndustryGroupCode' and some specific identifier(s).","row":56},{"code":416,"col":4,"message":"Unable to collect data for the field 'TR.GICSSectorCode' and some specific identifier(s).","row":56},{"code":416,"col":5,"message":"Unable to collect data for the field 'TR.GICSSubIndustryCode' and some specific identifier(s).","row":56},{"code":416,"col":6,"message":"Unable to collect data for the field 'TR.ISINCode' and some specific identifier(s).","row":56},{"code":416,"col":7,"message":"Unable to collect data for the field 'TR.RICCode' and some specific identifier(s).","row":56},{"code":416,"col":8,"message":"Unable to collect data for the field 'TR.SEDOLCode' and some specific identifier(s).","row":56}],"headerOrientation":"horizontal","headers":[[{"displayName":"Instrument"},{"displayName":"Company Market Cap","field":"TR.COMPANYMARKETCAP"},{"displayName":"GICS Industry Code","field":"TR.GICSINDUSTRYCODE"},{"displayName":"GICS Industry Group Code","field":"TR.GICSINDUSTRYGROUPCODE"},{"displayName":"GICS Sector Code","field":"TR.GICSSECTORCODE"},{"displayName":"GICS Sub-Industry Code","field":"TR.GICSSUBINDUSTRYCODE"},{"displayName":"ISIN Code","field":"TR.ISINCODE"},{"displayName":"RIC Code","field":"TR.RICCODE"},{"displayName":"SEDOL Code","field":"TR.SEDOLCODE"}]],"rowHeadersCount":1,"totalColumnsCount":9,"totalRowsCount":101}]}

    The log file is attached.

  • Jirapongse
    Jirapongse ✭✭✭✭✭

    Thank you so much.

    I will forward it to the product team.

  • Jirapongse
    Jirapongse ✭✭✭✭✭

    @igorg

    The product team would like to get the UUID.

    You can get the UUID from the About LSEG Workspace.

    image.png
  • Jirapongse
    Jirapongse ✭✭✭✭✭

    @igorg

    The product team is still unable to identify the cause of this problem.

    Could you please share the runnable code that can be used to replicate this issue?

    Therefore, we can replicate this issue on our environment.

  • igorg
    igorg Advocate

    Another one.

    Request:

    [2025-05-14T17:30:39.339999-04:00] - [sessions.desktop.workspace.0] - [DEBUG] - [14008 - MainThread] - [http_service] - [build_request] - HTTP Request id 176
    url = http://localhost:9000/api/udf
    method = POST
    headers = {'Content-Type': 'application/json', 'Authorization': 'Bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJBcGlWZXJzaW9uIjoiMSIsIkFwcEtleSI6ImRkN2JmYjgzMzA2ZTQ4MTJhNTc0NmM2NGU5NDc4MmY4M2Y2NWUyOGMiLCJBcHBTY29wZSI6InRyYXBpIiwiTGlicmFyeU5hbWUiOiJSRFAgUHl0aG9uIExpYnJhcnkiLCJMaWJyYXJ5VmVyc2lvbiI6IjIuMS4xIiwiaWF0IjoxNzQ3MjU3MDM4LCJleHAiOjE3NDg0NjY2Mzh9.AdjBjLL4v-TPh-cf5omsIffaz2yvF9L2oO1kBaRqdyw', 'x-tr-applicationid': 'dd7bfb83306e4812a5746c64e94782f83f65e28c'}
    json = {'Entity': {'E': 'DataGrid_StandardAsync', 'W': {'requests': [{'instruments': ['AS.N', 'ASA.N', 'ASAN.N', 'ASB.N', 'ASBA.N', 'ASB_pe.N', 'ASB_pf.N', 'ASC.N', 'ASG.N', 'ASGI.N', 'ASGN.N', 'ASH.N', 'ASIX.N', 'ASPN.N', 'ASR.N', 'ASX.N', 'ATCO_pd.N', 'ATCO_ph.N', 'ATEN.N', 'ATESTa.N', 'ATGE.N', 'ATHM.N', 'ATHS.N', 'ATH_pa.N', 'ATH_pb.N', 'ATH_pc.N', 'ATH_pd.N', 'ATH_pe.N', 'ATI.N', 'ATKR.N', 'ATMU.N', 'ATO.N', 'ATR.N', 'ATS.N', 'ATUS.N', 'AU.N', 'AUB.N', 'AUB_pa.N', 'AUNA.N', 'AVA.N', 'AVAL.N', 'AVAN_u.N', 'AVB.N', 'AVD.N', 'AVK.N', 'AVNS.N', 'AVNT.N', 'AVTR.N', 'AVY.N', 'AWF.N', 'AWI.N', 'AWK.N', 'AWP.N', 'AWR.N', 'AX.N', 'AXL.N', 'AXP.N', 'AXR.N', 'AXS.N', 'AXS_pe.N', 'AXTA.N', 'AYI.N', 'AZEK.N', 'AZO.N', 'AZUL.N', 'AZZ.N', 'B.N', 'BA.N', 'BABA.N', 'BAC.N', 'BAC_pb.N', 'BAC_pe.N', 'BAC_pk.N', 'BAC_pl.N', 'BAC_pm.N', 'BAC_pn.N', 'BAC_po.N', 'BAC_pp.N', 'BAC_pq.N', 'BAC_ps.N', 'BAH.N', 'BAK.N', 'BALL.N', 'BALY.N', 'BAM.N', 'BANC.N', 'BANC_pf.N', 'BAP.N', 'BARK.N', 'BARK_t.N', 'BAX.N', 'BA_pa.N', 'BB.N', 'BBAI.N', 'BBAI_t.N', 'BBAR.N', 'BBCO.N', 'BBD.N', 'BBDC.N', 'BBDO.N'], 'fields': [{'name': 'TR.COMPANYMARKETCAP'}, {'name': 'TR.GICSINDUSTRYCODE'}, {'name': 'TR.GICSINDUSTRYGROUPCODE'}, {'name': 'TR.GICSSECTORCODE'}, {'name': 'TR.GICSSUBINDUSTRYCODE'}, {'name': 'TR.ISINCODE'}, {'name': 'TR.RICCODE'}, {'name': 'TR.SEDOLCODE'}], 'parameters': {'SDATE': '2025-05-14'}}]}}}

    Response:

    [2025-05-14T17:30:44.381530-04:00] - [sessions.desktop.workspace.0] - [DEBUG] - [14008 - MainThread] - [http_service] - [request] - HTTP Response id 176
    status_code = 200
    text = {"responses":[{"columnHeadersCount":1,"data":[["AS.N",17323120122.84,252030,2520,25,25203010,"KYG0260P1028","AS.N","BN6TZY0"],["ASA.N",536802257.76,"","","","","BMG3156P1032","ASA.N","B046PT7"],["ASAN.N",4261286638.1,451030,4510,45,45103010,"US04342Y1047","ASAN.N","BLFDQC4"],["ASB.N",4042437926.1,401010,4010,40,40101015,"","ASB.N","2055718"],["ASBA.N",4042437926.1,401010,4010,40,40101015,"US0454876006","ASBA.N","BMX3XP5"],["ASB_pe.N",4042437926.1,401010,4010,40,40101015,"US0454872047","ASB_pe.N","BG2F3F0"],["ASB_pf.N",4042437926.1,401010,4010,40,40101015,"US0454874027","ASB_pf.N","BMTD069"],["ASC.N",403395605.04,101020,1010,10,10102040,"MHY0207T1001","ASC.N","BCGCR57"],["ASG.N",318775111.38,"","","","","US5299001025","ASG.N","2392039"],["ASGI.N",550518531.84,"","","","","US00326W1062","ASGI.N","BMYJCY4"],["ASGN.N",2409876000,451020,4510,45,45102010,"","ASGN.N","BFY8W20"],["ASH.N",2370632475.8,151010,1510,15,15101050,"US0441861046","ASH.N","BYND5N1"],["ASIX.N",622322465.27,151010,1510,15,15101010,"","ASIX.N","BYMMZL7"],["ASPN.N",470859071.34,151010,1510,15,15101050,"US04523Y1055","ASPN.N","BN65SM7"],["ASR.N",9390605966.91915,203050,2030,20,20305010,"","ASR.N","2639361"],["ASX.N",21784190377.2841,453010,4530,45,45301020,"","ASX.N","BFXQ991"],["ATCO_pd.N",349269163.435,203050,2030,20,20305030,"MHY0436Q1171","ATCO_pd.N","BLH91B4"],["ATCO_ph.N",349269163.435,203050,2030,20,20305030,"MHY0436Q1411","ATCO_ph.N","BLH91G9"],["ATEN.N",1270783040.71,451030,4510,45,45103020,"US0021211018","ATEN.N","BKQVBN6"],["ATESTa.N","","","","","","","ATESTa.N",""],["ATGE.N",4660575230.64,253020,2530,25,25302010,"","ATGE.N","BZ12TX5"],["ATHM.N",3292778452.69854,502030,5020,50,50203010,"","ATHM.N","BH5QGR0"],["ATHS.N",4846778500.5648,403010,4030,40,40301020,"US04686J8383","ATHS.N","BSLKYN5"],["ATH_pa.N",4846778500.5648,403010,4030,40,40301020,"US04686J8615","ATH_pa.N","BPSKDY1"],["ATH_pb.N",4846778500.5648,403010,4030,40,40301020,"US04686J2006","ATH_pb.N","BKWG6L8"],["ATH_pc.N",4846778500.5648,403010,4030,40,40301020,"US04686J3095","ATH_pc.N","BMG0ZK2"],["ATH_pd.N",4846778500.5648,403010,4030,40,40301020,"US04686J4085","ATH_pd.N","BMC8G63"],["ATH_pe.N",4846778500.5648,403010,4030,40,40301020,"US04686J5074","ATH_pe.N","BPLKV33"],["ATI.N",10589943080.46,201010,2010,20,20101010,"","ATI.N","2526117"],["ATKR.N",2334748424.28,201040,2010,20,20104010,"","ATKR.N","BDHF495"],["ATMU.N",3172641441.5,201060,2010,20,20106010,"","ATMU.N","BNRR1B2"],["ATO.N",24182912544,551020,5510,55,55102010,"US0495601058","ATO.N","2315359"],["ATR.N",10069885478.56,151030,1510,15,15103010,"US0383361039","ATR.N","2045247"],["ATS.N",2752389053.17546,201060,2010,20,20106020,"CA00217Y1043","ATS.N","BP8JTG2"],["ATUS.N",1309552168.4,502010,5020,50,50201030,"","ATUS.N","BDRY7P9"],["AU.N",20075138185.86,151040,1510,15,15104030,"GB00BRXH2664","AU.N","BRXH266"],["AUB.N",4427920607.04,401010,4010,40,40101015,"US04911A1079","AUB.N","BFZ9DB8"],["AUB_pa.N",4427920607.04,401010,4010,40,40101015,"US04911A2069","AUB_pa.N","BM9JN46"],["AUNA.N",513353875.06,351020,3510,35,35102020,"","AUNA.N","BPVG1X1"],["AVA.N",3018716555.73,551030,5510,55,55103010,"","AVA.N","2942605"],["AVAL.N",3346389226.88059,401010,4010,40,40101010,"US40053W1018","AVAL.N","BQRX1Y4"],["AVAN_u.N",null,null,null,null,null,null,null,null],["AVB.N",28701424483.2,601060,6010,60,60106010,"US0534841012","AVB.N","2131179"],["AVD.N",120333125.22,151010,1510,15,15101030,"","AVD.N","2025711"],["AVK.N",523604115.7,"","","","","US00764C1099","AVK.N","2627485"],["AVNS.N",561864357,351010,3510,35,35101020,"US05350V1061","AVNS.N","BFFVV54"],["AVNT.N",3480989303.57,151010,1510,15,15101050,"US05368V1061","AVNT.N","BMHWY55"],["AVTR.N",8756371169.55,352030,3520,35,35203010,"US05352A1007","AVTR.N","BJLT387"],["AVY.N",14111470877.13,151030,1510,15,15103020,"US0536111091","AVY.N","2066408"],["AWF.N",928693621.29,"","","","","US01879R1068","AWF.N","2019792"],["AWI.N",6832340961.28,201020,2010,20,20102010,"US04247X1028","AWI.N","B1FT462"],["AWK.N",26096454319.3,551040,5510,55,55104010,"US0304201033","AWK.N","B2R3PV1"],["AWP.N",332753975.4,"","","","","US00302L1089","AWP.N","BG1Z6R4"],["AWR.N",2897784716.75,551040,5510,55,55104010,"","AWR.N","2267171"],["AX.N",4082539177.8,401010,4010,40,40101015,"US05465C1009","AX.N","BGK38H3"],["AXL.N",558541898.56,251010,2510,25,25101010,"","AXL.N","2382416"],["AXP.N",210246719887,402020,4020,40,40202010,"","AXP.N","2026082"],["AXR.N",118491732.09,602010,6020,60,60201030,"US0321591051","AXR.N","2031804"],["AXS.N",7761495309,403010,4030,40,40301040,"BMG0692U1099","AXS.N","2677606"],["AXS_pe.N",7761495309,403010,4030,40,40301040,"US05461T3059","AXS_pe.N","BD2Z8N2"],["AXTA.N",7177493224.68,151010,1510,15,15101050,"BMG0750C1082","AXTA.N","BSFWCF5"],["AYI.N",8408618251.84,201040,2010,20,20104010,"","AYI.N","2818461"],["AZEK.N",7427197147.59,201020,2010,20,20102010,"","AZEK.N","BKPVG43"],["AZO.N",60983148087.51,255040,2550,25,25504050,"US0533321024","AZO.N","2065955"],["AZUL.N",228483745.86127,203020,2030,20,20302010,"","AZUL.N","BDCT500"],["AZZ.N",2737047277.5,201020,2010,20,20102010,"US0024741045","AZZ.N","2067672"],["B.N",31331968632.1923,151040,1510,15,15104030,"","B.N","BNKB6Z0"],["BA.N",154360000637.28,201010,2010,20,20101010,"US0970231058","BA.N","2108601"],["BABA.N",319813344918.9,255030,2550,25,25503030,"US01609W1027","BABA.N","BP41ZD1"],["BAC.N",336976136848.22,401010,4010,40,40101010,"US0605051046","BAC.N","2295677"],["BAC_pb.N",336976136848.22,401010,4010,40,40101010,"","BAC_pb.N","BFZNM46"],["BAC_pe.N",336976136848.22,401010,4010,40,40101010,"","BAC_pe.N","B1GH4Y3"],["BAC_pk.N",336976136848.22,401010,4010,40,40101010,"","BAC_pk.N","BYVQZ09"],["BAC_pl.N",336976136848.22,401010,4010,40,40101010,"","BAC_pl.N","B2PB3Z7"],["BAC_pm.N",336976136848.22,401010,4010,40,40101010,"","BAC_pm.N","BJN6RX9"],["BAC_pn.N",336976136848.22,401010,4010,40,40101010,"","BAC_pn.N","BKVJXF1"],["BAC_po.N",336976136848.22,401010,4010,40,40101010,"","BAC_po.N","BMVXBP3"],["BAC_pp.N",336976136848.22,401010,4010,40,40101010,"","BAC_pp.N","BN4Q1G7"],["BAC_pq.N",336976136848.22,401010,4010,40,40101010,"","BAC_pq.N","BMH4QB1"],["BAC_ps.N",336976136848.22,401010,4010,40,40101010,"","BAC_ps.N","BN7SQB0"],["BAH.N",15634399813.8,202020,2020,20,20202020,"US0995021062","BAH.N","B5367T7"],["BAK.N",1539169357.93153,151010,1510,15,15101010,"","BAK.N","2222835"],["BALL.N",14675385961.6,151030,1510,15,15103010,"US0584981064","BALL.N","2073022"],["BALY.N",538164881.1,253010,2530,25,25301010,"US05875B3042","BALY.N","BSPS220"],["BAM.N",96470753286.6,402030,4020,40,40203010,"","BAM.N","BP95GD5"],["BANC.N",2152266634.62,401010,4010,40,40101015,"US05990K1060","BANC.N","BCD47X4"],["BANC_pf.N",2152266634.62,401010,4010,40,40101015,"US05990K8412","BANC_pf.N","BMWDYS6"],["BAP.N",19623027527.47,401010,4010,40,40101010,"","BAP.N","2232878"],["BARK.N",227389308.9,255040,2550,25,25504040,"US68622E1047","BARK.N","BNVVLD2"],["BARK_t.N","",255040,2550,25,25504040,"US68622E1120","BARK_t.N","BNVVLG5"],["BAX.N",15559454569.36,351010,3510,35,35101010,"US0718131099","BAX.N","2085102"],["BA_pa.N",null,201010,2010,20,20101010,"US0970232049","BA_pa.N","BRBLC59"],["BB.N",2343823844.85827,451030,4510,45,45103020,"","BB.N","BCBHZ42"],["BBAI.N",1121076899.25,451020,4510,45,45102010,"","BBAI.N","BM92RJ8"],["BBAI_t.N","",451020,4510,45,45102010,"US08975B1171","BBAI_t.N","BM92RD2"],["BBAR.N",4653218385.64695,401010,4010,40,40101010,"US0589341009","BBAR.N","BKT4TC7"],["BBCO.N",null,null,null,null,null,null,null,null],["BBD.N",27015752413.8606,401010,4010,40,40101010,"US0594603039","BBD.N","B00FSK0"],["BBDC.N",933646780.06,402030,4020,40,40203010,"US06759L1035","BBDC.N","BFZ4N57"],["BBDO.N",27015752413.8606,401010,4010,40,40101010,"US0594604029","BBDO.N","B7RL3L6"]],"error":[{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":41},{"code":416,"col":2,"message":"Unable to collect data for the field 'TR.GICSIndustryCode' and some specific identifier(s).","row":41},{"code":416,"col":3,"message":"Unable to collect data for the field 'TR.GICSIndustryGroupCode' and some specific identifier(s).","row":41},{"code":416,"col":4,"message":"Unable to collect data for the field 'TR.GICSSectorCode' and some specific identifier(s).","row":41},{"code":416,"col":5,"message":"Unable to collect data for the field 'TR.GICSSubIndustryCode' and some specific identifier(s).","row":41},{"code":416,"col":6,"message":"Unable to collect data for the field 'TR.ISINCode' and some specific identifier(s).","row":41},{"code":416,"col":7,"message":"Unable to collect data for the field 'TR.RICCode' and some specific identifier(s).","row":41},{"code":416,"col":8,"message":"Unable to collect data for the field 'TR.SEDOLCode' and some specific identifier(s).","row":41},{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":91},{"code":416,"col":1,"message":"Unable to collect data for the field 'TR.CompanyMarketCap' and some specific identifier(s).","row":96},{"code":416,"col":2,"message":"Unable to collect data for the field 'TR.GICSIndustryCode' and some specific identifier(s).","row":96},{"code":416,"col":3,"message":"Unable to collect data for the field 'TR.GICSIndustryGroupCode' and some specific identifier(s).","row":96},{"code":416,"col":4,"message":"Unable to collect data for the field 'TR.GICSSectorCode' and some specific identifier(s).","row":96},{"code":416,"col":5,"message":"Unable to collect data for the field 'TR.GICSSubIndustryCode' and some specific identifier(s).","row":96},{"code":416,"col":6,"message":"Unable to collect data for the field 'TR.ISINCode' and some specific identifier(s).","row":96},{"code":416,"col":7,"message":"Unable to collect data for the field 'TR.RICCode' and some specific identifier(s).","row":96},{"code":416,"col":8,"message":"Unable to collect data for the field 'TR.SEDOLCode' and some specific identifier(s).","row":96}],"headerOrientation":"horizontal","headers":[[{"displayName":"Instrument"},{"displayName":"Company Market Cap","field":"TR.COMPANYMARKETCAP"},{"displayName":"GICS Industry Code","field":"TR.GICSINDUSTRYCODE"},{"displayName":"GICS Industry Group Code","field":"TR.GICSINDUSTRYGROUPCODE"},{"displayName":"GICS Sector Code","field":"TR.GICSSECTORCODE"},{"displayName":"GICS Sub-Industry Code","field":"TR.GICSSUBINDUSTRYCODE"},{"displayName":"ISIN Code","field":"TR.ISINCODE"},{"displayName":"RIC Code","field":"TR.RICCODE"},{"displayName":"SEDOL Code","field":"TR.SEDOLCODE"}]],"rowHeadersCount":1,"totalColumnsCount":9,"totalRowsCount":101}]}

    Many symbols do not have ISIN Code in the response.

    Some of them:

    ASGN.N, ATGE.N, ATI.N, ATKR.N, ATMU.N, ATUS.N …., AZUL.N.

    There is not much I can share. This is what our python module calls:

    dataFrame = ld.get_data(universe=par["instruments"], fields=fields, parameters=pars, header_type=ld.HeaderType.NAME)

    The instruments, fields and parameters you can see in the log line for http request.

  • Jirapongse
    Jirapongse ✭✭✭✭✭

    Thank you for much.

    I will forward it to the product team.

  • Jirapongse
    Jirapongse ✭✭✭✭✭

    @igorg

    The product team suggests changing the underlying platform used to retrieve the data by using the following code.

    config = ld.get_config()
    config.set_param("apis.data.datagrid.underlying-platform", "rdp")
    ld.open_session()

    With this code, it will use the http://localhost:9001/api/rdp/data/datagrid/beta1/ endpoint to retrieve the data.

  • igorg
    igorg Advocate

    We will try it within next couple days.

    Thanks for the update.