News and news metadata

BelianK

Dear Support,

I’d like to ask your help with Refinitiv Codebook. There is a smaple Python code in the Workspace application that can exctract news but the code stoped working since a few days. This sample code was provided by Refinitiv and I didn’t make any modification in it but I’d like to use it. I attached screenshot where the issue occures it seems the storyText column is empty and Python is not able to join it with the storyID.

Jirapongse

@BelianK

Thank you for reaching out to us.

Please change the code to this one:

baseurl = "/data/news/v1/stories/"

fullcodelist = pd.DataFrame()

compNews['storyText'] = str()

compNews['q_codes'] = str()

compNews['pIDs_mentioned'] = str()

compNews['RICs_mentioned'] = str()

compNews['urgency'] = str()


for i, uri in enumerate(compNews['storyId']):

    request_definition = rd.delivery.endpoint_request.Definition(

        url = baseurl + uri,

        method = rd.delivery.endpoint_request.RequestMethod.GET

    )

    response = request_definition.get_data()

    time.sleep(0.1)

    rawr = response.data.raw

    if 'newsItem' in rawr.keys():
        compNews['storyText'][i] = rawr['newsItem']['contentSet']['inlineData'][0]['$']

        topics = rawr['newsItem']['contentMeta']['subject']

        rics = [x for x in rawr['newsItem']['assert'] if x['_qcode'].startswith("R:")]

        compNews['q_codes'][i] = [d['_qcode'] for d in topics]

        compNews['pIDs_mentioned'][i] = [x for x in compNews['q_codes'][i] if x.startswith("P:")]

        compNews['RICs_mentioned'][i] = [d['_qcode'] for d in rics] 

        compNews['urgency'] = rawr['newsItem']['contentMeta']['urgency']['$'] # 1 = hot, 3 = regular


compNews

BelianK

Dear Jirapongse,T

Thank you very much, the given solution worked.However I have following questions:
1. q_codes -> how to effectively use them as sometimes if many codes are given then the query runs into server error → is there a document availble about its usage?
2. which parameters can be provided to the rd.news.get_headlines function, is there a document available I'm specifically interested how to filter significant news here
3. is there a limit on the number of news that can be exctracted?
4. How can I only extract news for the specific RIC that I provided without having the "mentioned RIC" option - I need news only about the company I'm querying and not other news where the company is tagged
5. Urgency column in the extracted news output file is always showing "3" - how can I filter for only hot news - I tried to set a filter for "1" but usually data output is empty in that case

Jirapongse

1. They are news codes. You can access the News codes from the Machine Readable News - News codes file.
2. You can use the help command to list all parameters.
   
   help(rd.news.get_headlines)
   
3. The depth of news history is 15 month.
4. The method requires a news query, which should be the same as the one used in the NEWS2.0 Workspace app. You can either build your query directly within the NEWS2.0 app or contact the helpdesk via LSEG Support to assist you in creating news queries.
5. It uses a news query to retrieve news. You may check if there are any news code for the urgency that can be used in a news query. You can contact the helpdesk via LSEG Support to verify this

When submitting questions to LSEG Support, please include the URL of this discussion in your raised question to prevent it from being redirected back to this Q&A forum.