rotateproxy 代理池工具
地址:https://github.com/Liang2580/rotateproxy/tree/2.0
下载地址:https://github.com/Liang2580/rotateproxy/releases/download/2.0/rotateproxy_amd64.zip
使用方式:
└──? #./rotateproxy -h Usage of ./rotateproxy: -email string email address -l string listen address (default ":9999") -page int the page count you want to crawl (default 5) -region int 0: all 1: cannot bypass gfw 2: bypass gfw -rule string search rule (default "protocol==\"socks5\" && \"Version:5 Method:No Authentication(0x00)\" && after=\"2021-11-01\"") -time int Not used for more than milliseconds (default 8000) -token string token
案例:
./rotateproxy -email=xxxx@qq.com -token=xxxx -l=:9999 -page=100
[*] waiting for crawl proxy…
start to parse proxy url from response
get 500 host
Checking
Check done
start to parse proxy url from response
get 500 host
[*] waiting for crawl proxy…
Checking
Check done
start to parse proxy url from response
然后使用代理端口进行访问
优化处理如下:
1.针对当前节点不能连接的时候自动挑选最快的一个节点进行链接
2.默认对于超过800毫秒 则不记录当做代理进行使用
3.默认超时时间为2秒。超过则重新选择节点、
4.默认重新验证时间为180秒