为什么我没有在 BeautifulSoup python 中获得完整的 div？

Question

我的代码

import requests
from bs4 import BeautifulSoup

URL = "https://www.quora.com/profile/Siddhartha-gaur-5"
r = requests.get(URL)
 
soup = BeautifulSoup(r.content,'html5lib')
for data in soup.find("div", id="root"): 
    print(data)

我得到了没有如下内容的空白 div 标签。

<div id="root"></div>

我想提取本示例中给出的所有内容：Complete div......

Answer 1

这是有效的代码

import requests
from bs4 import BeautifulSoup
from selenium import webdriver
# MAIN
driver = webdriver.Chrome('cromedriver path here')
driver.maximize_window()


#Go to link
URL = "https://www.quora.com/profile/Siddhartha-gaur-5"
driver.get(URL)

soup = BeautifulSoup(driver.page_source,'lxml')
driver.close()

for data in soup.find("div", id="root"): 
    print(data)