【问题标题】:Why is NLU not picking up an entire text of data为什么 NLU 没有拾取整个数据文本
【发布时间】:2017-07-17 20:03:06
【问题描述】:

我似乎 NLU 无法识别我提供的完整数据块。我是在代码中做错了什么,还是对 api 的工作方式有错误的假设?包含来自 api 的响应,其中包含分析的代码以及提交的完整文本。有一个增量,我不确定为什么会这样。

这是我的代码:

def nlu(text):
print("Calling NLU")
url = "https://gateway.watsonplatform.net/natural-language-understanding/api/v1/analyze?version=2017-02-27"
data = {
    'text': text,
    'language': "en",
    'return_analyzed_text': True,
    'clean': True,
    'features': {
        'entities': {
            'emotion': True,
            'sentiment': True,
            'limit': 2
        },
        "concepts": {
            "limit": 15
        },
        'keywords': {
            'emotion': True,
            'sentiment': True,
            'limit': 2
        }
    }
}
headers = {
    'content-type': "application/json"
}
username = os.getenv("nlu-username")
password = os.getenv("nlu-password")
print("NLU", username, password)
print("data", json.dumps(data))
response = requests.request("POST", url, data=json.dumps(data), headers=headers, auth=(username, password))
print("Done calling NLU")
print(response.text)

这是请求/响应:

"keywords": [
{
  "text": "anthropologists study skeletons",
  "sentiment": {
    "score": 0.0
  },"analyzed_text": "move between two thousand eight and two thousand twelve archaeologists excavated the rubble of an ancient hospital in England in the process they uncovered a number of skeletons one in particular belong to a wealthy Mel who lived in the eleventh or twelfth century and died of leprosy between the ages of eighteen and twenty five how do we know all this simply by examining some old soil Kate bones even centuries after death skeletons carry unique features that tell us about their identities and using modern tools and techniques we can read those features as clues this is a branch of science known as biological anthropology it allows researchers to piece together details about Incheon individuals and identify historical events that affected whole populations when researchers uncover a skeleton some of the first clues they gather like age and gender line its morphology which is the structure appearance and size of a skeleton mostly the clavicle stop growing at age twenty five so a skeleton with the clavicle that hasn't fully formed must be younger than similarly the plates in the cranium can continue fusing up to age forty and sometimes beyond by combining these with some microscopic skeletal clues physical anthropologists can estimate an approximate age of death meanwhile pelvic bones reveal gender biologically female palaces are wider allowing women to give birth whereas males are narrower those also betrayed the signs of aging disease disorders like anemia leave their traces on the bones and the condition of teeth can reveal clues to factors like diet and malnutrition which sometimes correlate with wealth or poverty a protein called collagen can give us even more profound details the air we breathe water we drink and food we eat leaves permanent traces in our bones and teeth in the form of chemical compounds these compounds contain measurable quantities called isotopes stable isotopes in bone collagen and tooth enamel varies among mammals dependent on where they lived and what they eat so but analyzing these isotopes we can draw direct inferences regarding the diet and location of historic people not only that but during life bones undergo a constant cycle of remodeling so if someone moves from one place to another bones synthesized after that move will also reflect the new isotopic signatures of the surrounding environment that means that skeletons can be used like migratory maps for instance between one and six fifty A. D. the great city of TOT Makana Mexico bustled with thousands of people researchers examined the isotope ratios and skeletons to the now which held details of their diets when they were young they found evidence for significant migration into the city a majority of the individuals were born elsewhere with further geological and skeletal analysis they may be able to map where those people came from that work in tier two Akon is also an example of how bio anthropologists study skeletons in cemeteries and mass graves and analyze their similarities and differences from not information they can learn about cultural beliefs social norms wars and what caused their deaths today we use these tools to answer big questions about how forces like migration and disease shape the modern world DNA analysis is even possible in some relatively well preserved ancient remains that's helping us understand how diseases like tuberculosis have evolved over the centuries so we can build better treatments for people today ocean skeletons can tell us a surprisingly great deal about the past two of your remains are someday buried intact what might archaeologists of the distant future learn from them"

【问题讨论】:

    标签: python ibm-watson watson-nlu


    【解决方案1】:

    我刚刚在 NLU 上尝试了您的文字并得到了正确的响应。检查以下结果。我认为您应该首先使用您的服务凭据尝试Watson API Explorer。它还将帮助您将任何错误放置的标头或丢失的参数修复到 API 调用中。

    注意:只需在进行 POST 调用之前删除参数对象中的 "metadata": {},因为它适用于 URL 和 HTML。

    {
    "semantic_roles": [{
        "subject": {
            "text": "anthropologists"
        },
        "sentence": "anthropologists study skeletons",
        "object": {
            "text": "skeletons"
        },
        "action": {
            "verb": {
                "text": "study",
                "tense": "present"
            },
            "text": "study",
            "normalized": "study"
        }
    }],
    "language": "en",
    "keywords": [{
            "text": "anthropologists",
            "relevance": 0.966464
        },
        {
            "text": "skeletons",
            "relevance": 0.896147
        }
    ],
    "entities": [],
    "concepts": [{
        "text": "Cultural studies",
        "relevance": 0.86926,
        "dbpedia_resource": "http://dbpedia.org/resource/Cultural_studies"
    }],
    "categories": [{
            "score": 0.927751,
            "label": "/science/social science/anthropology"
        },
        {
            "score": 0.219365,
            "label": "/education/homework and study tips"
        },
        {
            "score": 0.128377,
            "label": "/science"
        }
    ],
    "warnings": [
        "emotion: cannot locate keyphrase",
        "relations: Not Found",
        "sentiment: cannot locate keyphrase"
    ]
    

    }

    【讨论】:

    • 您列出的网站非常有用。它与官方文档相关联吗? Watson api post comman你是怎么找到的?我认为已推送了一个修复程序,因为它在我发布到 SO 后的第二天就开始工作了。
    • 大部分 API 调用都链接到官方文档。一些服务已被弃用,但它们的 API 调用在此应用程序(如 Alchemy)中仍然可用。对于 NLU,我在看到您的查询前一周左右检查了来自该应用程序的 API 调用。对我来说它就在那里。
    • 非常酷。在您发送之前,我什至没有看到它存在 - 感谢您的分享。
    【解决方案2】:

    在你的代码中

    data=json.dumps(data)

    将整个 JSON 对象转换为字符串。那应该是:

    data=data

    我还建议使用Python WDC SDK,因为它会让您更轻松。

    和上面的例子一样。

    import json
    from watson_developer_cloud import NaturalLanguageUnderstandingV1
    import watson_developer_cloud.natural_language_understanding.features.v1 as Features
    
    username = os.getenv("nlu-username")
    password = os.getenv("nlu-password")
    
    nluv1 = NaturalLanguageUnderstandingV1(
        username=username, 
        password=password)
    
    features = [ 
        Features.Entities(), 
        Features.Concepts(),
        Features.Keywords()
    ]
    
    def nlu(text):
        print('Calling NLU')
        response = nluv1.analyze(text,features=features, language='en')
        print('Done calling NLU')
        print(json.dumps(response, indent=2))
    

    【讨论】:

    • 很好的建议,我很愿意,但是由于各种原因,SDK 无法安装软件包。 Stack Overflow issue 为什么不将所需的请求/响应作为示例发布在 api 文档中?
    • 问题不在于 WDC SDK。这是 6 和 OSX/python 2.7 的已知安装问题。无论如何,上面的示例代码是 python 3.6,它可以很好地安装 SDK。
    • 感谢西蒙的建议。有没有办法从 SDK 中重构这些依赖项,或者将客户端分解为可以单独导入和安装的独立依赖项?
    猜你喜欢
    • 1970-01-01
    • 1970-01-01
    • 2020-06-09
    • 2013-01-23
    • 1970-01-01
    • 2018-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多