为了账号安全,请及时绑定邮箱和手机立即绑定

无法使用 BeautifulSoup 获取 div 类

无法使用 BeautifulSoup 获取 div 类

湖上湖 2023-03-08 10:23:16
我正在尝试在课堂上获取 div,但无论出于何种原因我都做不到。有一个 id,但每个产品都不同。如何成功抓取 <div id="feli1062" class="row mqs-prop-inner-wrap with featt">?这是我的代码;from urllib.request import urlopen as uReqfrom bs4 import BeautifulSoup as soupmy_url = "https://meqasa.com/apartments-for-sale-in-Accra"uClient = uReq(my_url)page_html = uClient.read()uClient.close()page_soup = soup(page_html, "html.parser")containers = page_soup.findAll("div", {"class": "row mqs-prop-inner-wrap with featt"})print(len(containers))
查看完整描述

1 回答

?
子衿沉夜

TA贡献1828条经验 获得超3个赞

您可以使用 CSS 选择器div[id^="feli"]。这将选择所有以“feli”开头<div>的标签id=。


例如:


import requests

from bs4 import BeautifulSoup



url = 'https://meqasa.com/apartments-for-sale-in-Accra'

soup = BeautifulSoup(requests.get(url).content, 'html.parser')


for item in soup.select('div[id^="feli"]'):

    print(item.h2.get_text(strip=True))

    print('https://meqasa.com' + item.a['href'])

    print('-' * 80)

印刷:


3 bedroom apartment for sale at Community 25, Tema, Tema, Greater Accra Region

https://meqasa.com/3-bedroom-apartment-for-sale-in-Community 25, Tema, Tema, Greater Accra Region, Ghana-unit-1411

--------------------------------------------------------------------------------

2 bedroom apartment for sale at Sakumono

https://meqasa.com/2-bedroom-apartment-for-sale-in-Sakumono-unit-1385

--------------------------------------------------------------------------------

1 bedroom apartment for sale at East Legon

https://meqasa.com/1-bedroom-apartment-for-sale-in-East Legon-unit-1383

--------------------------------------------------------------------------------

2 bedroom apartment for sale at Accra

https://meqasa.com/2-bedroom-apartment-for-sale-in-Accra-unit-1408

--------------------------------------------------------------------------------

1 bedroom apartment for sale at Sakumono

https://meqasa.com/1-bedroom-apartment-for-sale-in-Sakumono-unit-1363

--------------------------------------------------------------------------------


... and so on.


查看完整回答
反对 回复 2023-03-08
  • 1 回答
  • 0 关注
  • 66 浏览
慕课专栏
更多

添加回答

举报

0/150
提交
取消
意见反馈 帮助中心 APP下载
官方微信