连续抓取全国建筑市场监管公共服务平台企业注册人员

xd3210

全国建筑市场监管公共服务平台中企业注册人员有多页，如何抓取全部数据？

xd3210

网站地址：http://jzsc.mohurd.gov.cn/asite/jsbpp/index

719404338

http://jzsc.mohurd.gov.cn/dataservice/query/staff/list  这个不难。

liangdinghu

719404338 发表于 2019-5-29 19:49
http://jzsc.mohurd.gov.cn/dataservice/query/staff/list  这个不难。

Sub Main()
    Dim strText As String
    With CreateObject("WinHttp.WinHttpRequest.5.1")
        .Open "POST", "http://jzsc.mohurd.gov.cn/dataservice/query/comp/list, False"

'        .setRequestHeader "Host", "jzsc.mohurd.gov.CN"
'        .setRequestHeader "Upgrade-Insecure-Requests", "1"
'        .setRequestHeader "Connection", "keep-alive"
'        .setRequestHeader "Origin", "http://jzsc.mohurd.gov.cn"
        .setRequestHeader "Cookie", "__guid=180692732.2390543291493264400.1559129120610.8428; Hm_lvt_b1b4b9ea61b6f1627192160766a9c55c=1559129111,1559129138,1559129191; JSESSIONID=8F546285962D7762CFA18C447F779269; monitor_count=13; Hm_lpvt_b1b4b9ea61b6f1627192160766a9c55c=1559133635"
'        .setRequestHeader "User-Agent", "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36"
        .setRequestHeader "Content-Type", "text/html;charset=utf-8"
'        .setRequestHeader "Accept", "text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8"""
        .setRequestHeader "Referer", "http://jzsc.mohurd.gov.cn/dataservice/query/comp/list"
'        .setRequestHeader "Content-Language", "zh-CN"
'        .setRequestHeader "Content-Length", "46"
        .send "%24total=359384&%24reload=0&%24pg=2&%24pgsz=15"

        strText = .responsetext
        Debug.Print strText
        Stop
    End With
End Sub


模拟了好多头信息，都抓不到，能请教下嘛？

liangdinghu

大神来帮帮小白，怎么测试都得不到返回的信息。

xd3210

719404338 发表于 2019-5-29 19:49
http://jzsc.mohurd.gov.cn/dataservice/query/staff/list  这个不难。

多页如何获取？请指教！

屌爆了z

719404338 发表于 2019-5-29 19:49
http://jzsc.mohurd.gov.cn/dataservice/query/staff/list  这个不难。

那就增加点难度，把中间缺失的号码补齐

YZC51

请参考
http://jzsc.mohurd.gov.cn/dataservice/query/staff/list?$pg=6

YZC51

请参考

Kaohsing

liangdinghu 发表于 2019-5-29 20:58
Sub Main()
    Dim strText As String
    With CreateObject("WinHttp.WinHttpRequest.5.1")

Sub Main()
    Dim strText As String
    With CreateObject("WinHttp.WinHttpRequest.5.1")'#仔细看看这句！！
        .Open "POST", "http://jzsc.mohurd.gov.cn/dataservice/query/comp/list, False"

'        .setRequestHeader "Host", "jzsc.mohurd.gov.CN"
'        .setRequestHeader "Upgrade-Insecure-Requests", "1"
'        .setRequestHeader "Connection", "keep-alive"
'        .setRequestHeader "Origin", "http://jzsc.mohurd.gov.cn"
        .setRequestHeader "Cookie", "__guid=180692732.2390