【发布时间】:2015-11-27 05:51:18
【问题描述】:
我正在尝试自动化我的租赁搜索。我可以获得结果的第一页,但是当我尝试单击下一个按钮时出现错误 - “对象不可调用”我是 Python 新手,只是认为这将是一个有趣的项目来学习 - 任何帮助。
from selenium import webdriver
from bs4 import BeautifulSoup
import datetime
from datetime import timedelta
import time
import re
pages = set()
def getLinks(url):
global pages
# Open web browser and get url - 3 second time delay.
driver = webdriver.Firefox()
driver.get(url)
time.sleep(3)
pageSource = driver.page_source
bsObj = BeautifulSoup(pageSource)
for addr_link in bsObj.findAll("a", href=re.compile("^/homedetails/*")):
if 'href' in addr_link.attrs:
if addr_link['href'] not in pages:
newPage = addr_link.attrs['href']
pages.add(newPage)
print(newPage)
#if bsObj.find('li', {'class': "zsg-pagination-next"}) == True:
next_page = bsObj.find('li', {'class': "zsg-pagination-next"}).find("a")
#next_page.click()
print(next_page)
next_page.click()
getLinks(http://www.zillow.com/homes/for_rent/Jackson-County-MO/house,mobile_type/1804_rid/6m_days/39.198737,-93.6866,38.873394,-95.026932_rect/9_zm/)
【问题讨论】:
-
请发布格式正确的相关HTML。
-
请添加原始问题的链接,以便人们更有可能看到它。
标签: python selenium beautifulsoup