【问题标题】:scraping with python Beautifulsoup用 python Beautifulsoup 抓取
【发布时间】:2018-05-08 20:07:40
【问题描述】:

我想从网站上抓取 resultColumn,但我无法获得结果 我的代码:

from urllib.request import urlopen as uReq
from bs4 import BeautifulSoup as soup

my_url = 'https://www.nab.com.au/locations?return#lunch'

uClient = uReq(my_url)
page_html = uClient.read()
uClient.close()

page_soup = soup(page_html, "html.parser")

containers = page_soup.findAll("div",{"class":"row collapse"})

containers[6].findAll("div","id":"resultColumn") 

result 列有一些结果,它不提供这些结果,只显示"<!-- Results -->" 任何帮助将不胜感激

【问题讨论】:

    标签: python-3.x beautifulsoup


    【解决方案1】:

    这是我在结果列周围的页面源中看到的:

    <div class="row collapse">
            <div class="large-4 small-12 columns tabContent" id="results-list-tab">
                <div id="resultColumn">
                    <!-- Results -->
                </div>                      
                <div id="directionsPanel" class="border cf">
                    <div id="directionsNav" class="cf"> 
                        <h3>Directions</h3>
                        <a href="javascript:closeDirectionsPanel();" class="arrow">Return to Results</a>
                    </div>  
                    <div id="directionsContent" class="cf"></div>
                </div>
            </div>        
            <div class="large-8 small-12 columns tabContent active" id="map-tab">
                <div id="map_canvas" class="border"></div>
                <table class="legend">
                    <tbody>
                        <tr>
                          <td colspan="6"><h3>Legend</h3></td>
                        </tr>
                        <tr>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/atm-with-deposits.png" alt="ATM - with deposit facility"></td>
                            <td class="description">ATM - with deposit facility</td>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/atm.png" alt="ATM - without deposit facility"></td>
                            <td class="description">ATM - without deposit facility</td>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/audio-accessable.png" alt="ATM - with audio access"></td>
                            <td class="description">ATM - with audio access</td>
                        </tr>
                        <tr>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/disabled-access.png" alt="ATM - with disabled access"></td>
                            <td class="description">ATM - with disabled access</td>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/branch.png" alt="Branch"></td>
                            <td class="description">Branch</td>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/business-banking.png" alt="Business Banking Centre"></td>
                            <td class="description">Business Banking Centre</td>
                        </tr>
                        <tr>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/agency.png" alt="Agency"></td>
                            <td class="description">Agency</td>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/financial services-centre.png" alt="Financial Services Centre"></td>
                            <td class="description">Financial Services Centre</td>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/financial-planner.png" alt="Financial Planner"></td>
                            <td class="description">Financial Planner</td>
                        </tr>
                        <tr>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/mobile-banker.png" alt="Mobile Banker"></td>
                            <td class="description">Mobile Banker</td>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/kiosk.png" alt="Internet Banking Kiosk"></td>
                            <td class="description">Internet Banking Kiosk</td>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/coin-swap-machine.png" alt="Coin Swap Machine"></td>
                            <td class="description">Coin Swap Machine</td>
                        </tr>
                        <tr>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/quick-change-machine.png" alt="Quick Change Machine"></td>
                            <td class="description">Quick Change Machine</td>
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/express-business-deposit.png" alt="Express Business Deposit"></td>
                            <td class="description">Express Business Deposit</td>                
                            <td><img src="/etc/designs/nabrwd/clientlibs-locations/images/services/small-business-banker.png" alt="Small Business Banker"></td>
                            <td class="description">Small Business Banker</td>                
                        </tr> 
                    </tbody>
                </table>
            </div>
        </div>
    

    标签内唯一的东西就是你从代码中得到的东西。

    <!-- Results -->
    

    【讨论】:

    • 在搜索中它给出了一些结果,我该如何提取这些结果?
    • 我不明白你的意思。你能详细说明吗?你到底想得到什么?
    • 实际上,当您在搜索栏中使用邮政编码进行搜索时,您会得到一些结果,所以我想要一些有用的结果而不是 ''提取,简而言之,这些结果出现在搜索中
    • 如果结果仅在您进行搜索后显示,那么您将无法仅使用 BeautifulSoup 获得它们。查看Selenium。它将允许您与网页进行交互。
    猜你喜欢
    • 2016-01-01
    • 2013-09-28
    • 2018-06-11
    • 1970-01-01
    • 2016-08-08
    • 2018-04-25
    • 2014-06-20
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多