大家好，前面給大家分享了關(guān)于采集人人網(wǎng)的相關(guān)代碼的示例，今天給大家?guī)?lái)的也是一個(gè)采集人人網(wǎng)的爬蟲實(shí)例，是通過WebBits和Haskell相結(jié)合，比較簡(jiǎn)潔，也非常易懂，讓我們一起來(lái)學(xué)習(xí)一下。

```haskell

import Web.WebBits

import Network.HTTP.Conduit

import Data.Conduit

import Control.Monad.Trans.Resource

import Data.Maybe

import Data.List

import Data.Char

import System.Environment

main = do

proxy <- getProxy

let url = "http://www.renren.com"

response <- fetchUrl proxy url

case response of

Left err -> print err

Right doc -> do

let title = getTitle doc

print title

getProxy = do

proxies <- getProxyList

case proxies of

[] -> error "沒有可用的代理服務(wù)器"

(x:xs) -> do

let proxy = "http://" ++ x

putStrLn $ "使用代理服務(wù)器: " ++ x

return proxy

getProxyList = do

url <- getUrl "https://www.duoip.cn/get_proxy"

let proxies = filter (not . null) $ map (stripPrefix "http://") $ lines url

return proxies

fetchUrl :: String -> String -> IO (Either String (HtmlUrl (Sink IO ())))

fetchUrl proxy url = do

manager <- newManager (tlsManagerSettings )

response <- fetchUrlWith manager url

return response

getTitle :: HtmlUrl (Sink IO ()) -> String

getTitle = fromMaybe "未知" . listToMaybe . concatMap (getTitle') . htmlUrlElements

getTitle' :: HtmlElement -> [String]

getTitle' (Element (Name "title") _ _) = ["標(biāo)題"]

getTitle' _ = []

getUrl :: String -> IO String

getUrl url = do

response <- simpleHttp url

case response of

Left err -> error $ "請(qǐng)求失敗: " ++ show err

Right doc -> return $ unpack $ responseBody doc

```

這個(gè)程序我們明顯可以看出，不同于之前的代碼，首先它會(huì)獲取一個(gè)可用的代理地址，然后使用這個(gè)代理地址發(fā)送HTTP請(qǐng)求到網(wǎng)站服務(wù)器。接著，程序解析HTML內(nèi)容，提取標(biāo)題元素，并將其打印出來(lái)，除此之外，沒有其他多余的操作。我們?cè)趯?shí)際使用時(shí)根據(jù)需要進(jìn)行改動(dòng)，完全可以直接運(yùn)用，趕緊試試吧。