国产精品天干天干,亚洲毛片在线,日韩gay小鲜肉啪啪18禁,女同Gay自慰喷水

歡迎光臨散文網(wǎng) 會(huì)員登陸 & 注冊(cè)

【Python超強(qiáng)爬蟲5天速成】學(xué)完可以接任何爬蟲副業(yè)!來者不拒!目前B站最完整

2023-02-22 23:27 作者:春雨如蘇  | 我要投稿
啦啦啦啦 我來交作業(yè)了


from lxml import etree
import requests
import re
import json

headers = {
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/110.0.0.0 Safari/537.36 Edg/110.0.1587.50',
    'cookie': 'lv=1676985897; vn=1; ip_ck=4MCF4f//j7QuNzc0NjU4LjE2NzY5ODU4OTc=; Hm_lvt_ae5edc2bc4fc71370807f6187f0a2dd0=1676985897; Adshow=0; Hm_lpvt_ae5edc2bc4fc71370807f6187f0a2dd0=1676987325; questionnaire_pv=1676937645'
}

url = 'https://desk.zol.com.cn/meinv/'



def get_home_page(url):
    res = requests.get(url, headers=headers)
    res.encoding = 'GB2312'
    return res.text


def get_urls(html):
    et = etree.HTML(html)
    urls = et.xpath('/html/body/div/div/ul[@class="pic-list2  clearfix"]/li/a/@href')
    return urls


def get_imgs(urls):
    imgsrcs = []
    html = get_home_page(urls)
    obj = re.compile(r'var deskPicArr.*?=(?P<deskPicArr>.*?);', re.S)
    result = obj.search(html)
    deskPicArr = result.group('deskPicArr').strip()
    deskPic = json.loads(deskPicArr)
    msg = deskPic.get('list')
    for item in msg:
        oriSize = item.get('oriSize')
        imgsrc = item.get('imgsrc')
        imgsrc = imgsrc.replace('##SIZE##', oriSize)
        imgsrcs.append(imgsrc)
    return imgsrcs


def download(imgsrc):
    res = requests.get(url=imgsrc, headers=headers)
    name = imgsrc.split('/')[-1]
    with open(f'wallpaper/{name}', 'wb') as f:
        f.write(res.content)


def run():
    html = get_home_page(url)
    urls = get_urls(html)
    for u in urls[2:]:
        urls = 'https://desk.zol.com.cn/' + u[1:]
        imgsrcs = get_imgs(urls)
        for imgsrc in imgsrcs:
            download(imgsrc)


run()


【Python超強(qiáng)爬蟲5天速成】學(xué)完可以接任何爬蟲副業(yè)!來者不拒!目前B站最完整的評(píng)論 (共 條)

分享到微博請(qǐng)遵守國家法律
都昌县| 昭通市| 荥经县| 买车| 虎林市| 修水县| 永登县| 龙州县| 连南| 措美县| 靖西县| 常州市| 海淀区| 渭南市| 禄劝| 纳雍县| 新泰市| 淮北市| 邯郸县| 绥江县| 丰宁| 南安市| 抚顺市| 望谟县| 呼玛县| 甘谷县| 江都市| 雅江县| 临汾市| 年辖:市辖区| 黄梅县| 清苑县| 伊川县| 榆中县| 都江堰市| 新兴县| 和田县| 水富县| 清镇市| 二手房| 大洼县|