按条目递归搜索xml

Question

我有一个来自 Google 的 XML 提要，总共大约 300 个条目。它看起来像这样：

<?xml version="1.0"?>
-<ns0:feed ns1:etag="W/"LIESANDCRAPfyt7I2A9WhHERE."" xmlns:ns4="http://www.w3.org/2007/app" xmlns:ns3="http://schemas.google.com/contact/2008" xmlns:ns2="http://a9.com/-/spec/opensearchrss/1.0/" xmlns:ns1="http://schemas.google.com/g/2005" xmlns:ns0="http://www.w3.org/2005/Atom">
    <ns0:updated>2012-01-25T14:52:12.867Z</ns0:updated>
    <ns0:category term="http://schemas.google.com/contact/2008#profile" scheme="http://schemas.google.com/g/2005#kind"/>
    <ns0:id>domain.com</ns0:id>
    <ns0:generator version="1.0" uri="http://www.google.com/m8/feeds">Contacts</ns0:generator>
    <ns0:author>
        <ns0:name>domain.com</ns0:name>
    </ns0:author>
    <ns0:link type="text/html" rel="alternate" href="http://www.google.com/"/>
    <ns0:link type="application/atom+xml" rel="http://schemas.google.com/g/2005#feed" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full"/>
    <ns0:link type="application/atom+xml" rel="http://schemas.google.com/g/2005#batch" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/batch"/>
    <ns0:link type="application/atom+xml" rel="self" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full?max-results=300"/>
    <ns2:startIndex>1</ns2:startIndex>
    <ns2:itemsPerPage>300</ns2:itemsPerPage>
    <ns0:entry ns1:etag=""CRAPQR4KTit7I2A4"">
        <ns0:category term="http://schemas.google.com/contact/2008#profile" scheme="http://schemas.google.com/g/2005#kind"/>
        <ns0:id>http://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson</ns0:id>
        <ns1:name>
            <ns1:familyName>Person</ns1:familyName>
            <ns1:fullName>Name Person</ns1:fullName>
            <ns1:givenName>Name</ns1:givenName>
        </ns1:name>
        <ns0:updated>2012-01-25T14:52:13.081Z</ns0:updated>
        <ns1:organization rel="http://schemas.google.com/g/2005#work" primary="true">
            <ns1:orgTitle>JobField</ns1:orgTitle>
            <ns1:orgDepartment>DepartmentField</ns1:orgDepartment>
            <ns1:orgName>CompanyField</ns1:orgName>
        </ns1:organization>
        <ns3:status indexed="true"/>
        <ns0:title>Name Person</ns0:title>
        <ns0:link type="image/*" rel="http://schemas.google.com/contacts/2008/rel#photo" href="https://www.google.com/m8/feeds/photos/profile/domain.com/nperson"/>
        <ns0:link type="application/atom+xml" rel="self" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson"/>
        <ns0:link type="application/atom+xml" rel="edit" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson"/>
        <ns1:email rel="http://schemas.google.com/g/2005#other" address="nperson@gapps.domain.com"/>
        <ns1:email rel="http://schemas.google.com/g/2005#other" primary="true" address="nperson@domain.com"/>
        <ns4:edited>2012-01-25T14:52:13.081Z</ns4:edited>
    </ns0:entry>
    <ns0:title>domain.com's Profiles</ns0:title>
</ns0:feed>

我可以使用 beautifulstonesoup 使用以下代码从名称、组织和电子邮件字段中提取数据：

profiles_feed = gd_client.GetProfilesFeed('https://www.google.com/m8/feeds/profiles/domain/domain.com/full?max-results=300')

soup = BeautifulSoup(str(profiles_feed))


for tag in soup.findAll('ns1:name'):
    print tag.find('ns1:familyname').text
    print tag.find('ns1:fullname').text
    print tag.find('ns1:givenname').text

for tag in soup.findAll('ns1:organization'):
    print tag.find('ns1:orgtitle').text
    print tag.find('ns1:orgdepartment').text
    print tag.find('ns1:orgname').text

for tag in soup.findAll('ns1:email',address=True):
    print tag['address']

我希望能够从每个 ns0:entry 节点中一起抓取数据组，因此它会输出如下一行：姓氏、名字、组织名称、组织名称、电子邮件

我尝试过使用：

for tag in soup('ns0:entry'):
    print tag.name.familyName.text

但它把它当作一个属性来对待

我考虑过使用 xpath，但我找不到任何关于 beautifulstonesoup 和 xpath 的文档，所以我不确定它是否支持原生。那么，我如何搜索每个条目节点并返回所有特定于条目的数据，而不是所有按标签分组的数据。

Answer 1

>>> from BeautifulSoup import BeautifulStoneSoup
>>> xml = """<ns0:feed ns1:etag="W/"LIESANDCRAPfyt7I2A9WhHERE."" xmlns:ns4="http://www.w3.org/2007/app" xmlns:ns3="http://schemas.google.com/contact/2008" xmlns:ns2="http://a9.com/-/spec/opensearchrss/1.0/" xmlns:ns1="http://schemas.google.com/g/2005" xmlns:ns0="http://www.w3.org/2005/Atom">
...             <ns0:updated>2012-01-25T14:52:12.867Z</ns0:updated>
...             <ns0:category term="http://schemas.google.com/contact/2008#profile" scheme="http://schemas.google.com/g/2005#kind"/>
...             <ns0:id>domain.com</ns0:id>
...             <ns0:generator version="1.0" uri="http://www.google.com/m8/feeds">Contacts</ns0:generator>
...             <ns0:author>
...                 <ns0:name>domain.com</ns0:name>
...             </ns0:author>
...             <ns0:link type="text/html" rel="alternate" href="http://www.google.com/"/>
...             <ns0:link type="application/atom+xml" rel="http://schemas.google.com/g/2005#feed" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full"/>
...             <ns0:link type="application/atom+xml" rel="http://schemas.google.com/g/2005#batch" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/batch"/>
...             <ns0:link type="application/atom+xml" rel="self" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full?max-results=300"/>
...             <ns2:startIndex>1</ns2:startIndex>
...             <ns2:itemsPerPage>300</ns2:itemsPerPage>
...             <ns0:entry ns1:etag=""CRAPQR4KTit7I2A4"">
...                 <ns0:category term="http://schemas.google.com/contact/2008#profile" scheme="http://schemas.google.com/g/2005#kind"/>
...                 <ns0:id>http://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson</ns0:id>
...                 <ns1:name>
...                     <ns1:familyName>Person</ns1:familyName>
...                     <ns1:fullName>Name Person</ns1:fullName>
...                     <ns1:givenName>Name</ns1:givenName>
...                 </ns1:name>
...                 <ns0:updated>2012-01-25T14:52:13.081Z</ns0:updated>
...                 <ns1:organization rel="http://schemas.google.com/g/2005#work" primary="true">
...                     <ns1:orgTitle>JobField</ns1:orgTitle>
...                     <ns1:orgDepartment>DepartmentField</ns1:orgDepartment>
...                     <ns1:orgName>CompanyField</ns1:orgName>
...                 </ns1:organization>
...                 <ns3:status indexed="true"/>
...                 <ns0:title>Name Person</ns0:title>
...                 <ns0:link type="image/*" rel="http://schemas.google.com/contacts/2008/rel#photo" href="https://www.google.com/m8/feeds/photos/profile/domain.com/nperson"/>
...                 <ns0:link type="application/atom+xml" rel="self" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson"/>
...                 <ns0:link type="application/atom+xml" rel="edit" href="https://www.google.com/m8/feeds/profiles/domain/domain.com/full/nperson"/>
...                 <ns1:email rel="http://schemas.google.com/g/2005#other" address="nperson@gapps.domain.com"/>
...                 <ns1:email rel="http://schemas.google.com/g/2005#other" primary="true" address="nperson@domain.com"/>
...                 <ns4:edited>2012-01-25T14:52:13.081Z</ns4:edited>
...             </ns0:entry>
...             <ns0:title>domain.com's Profiles</ns0:title>
...         </ns0:feed>"""

来自文档的注释 (http://www.crummy.com/software/BeautifulSoup/documentation.html#Parsing XML)：

BeautifulStoneSoup 最常见的缺点是它不知道自闭合标签。 HTML 有一组固定的自闭合标签，但对于 XML，它取决于 DTD 所说的内容。您可以通过将它们的名称作为 selfClosingTags 参数传递给构造函数来告诉 BeautifulStoneSoup 某些标签是自关闭的：

>>> soup = BeautifulStoneSoup(xml, selfClosingTags=['ns0:category','ns3:status', 'ns0:link','ns1:email'])
>>> a = soup.findAll('ns0:entry')
>>> a[0].find('ns1:familyname')
<ns1:familyname>Person</ns1:familyname>
>>> a[0].find('ns1:familyname').text
u'Person'
>>> a[0].find('ns1:givenname')
<ns1:givenname>Name</ns1:givenname>
>>> a[0].find('ns1:givenname').text
u'Name'
>>> for entry in a:
...     print ', '.join([entry.find('ns1:familyname').text, entry.find('ns1:givenname').text, entry.find('ns1:orgtitle').text, entry.find('ns1:orgname').text, entry.find('ns1:email')['address']])
...
Person, Name, JobField, CompanyField, nperson@gapps.domain.com

希望这会有所帮助。