Uburyo bwo gukoresha proxy muri Python Requests (HTTP/HTTPS no guhuriza ama-Session)
Updated:
Isomero rya Python ryitwa requests ryakira za proxy za VinaProxy zifite umwirondoro binyuze mu nyandiko ya proxies ihuza imiyoboro yombi ya 'http' na 'https' kuri http://user:pass@ip:port. Gushyira iyo nyandiko muri requests.Session() ihoraho yongera gukoresha ama-socket ya TCP asanzwe kugira ngo ukore web scraping yihuta kandi itavuna sisitemu.
proxies = {'http': 'http://user:pass@ip:port', 'https': 'http://user:pass@ip:port'}- IP 1₫ 40.000
- IP 5+₫ 35.000
- IP 10+₫ 25.000
- IP 20+₫ 25.000
- IP 50+₫ 25.000
- IP 100+₫ 25.000
- IP 200+₫ 25.000
- IP 500+₫ 25.000
- IP 1000+₫ 22.000
- IP 2000+₫ 20.000
- IP 1₫ 40.000
- IP 5+₫ 35.000
- IP 10+₫ 25.000
- IP 20+₫ 25.000
- IP 50+₫ 25.000
- IP 100+₫ 25.000
- IP 200+₫ 25.000
- IP 500+₫ 25.000
- IP 1000+₫ 22.000
- IP 2000+₫ 20.000
Gutunganya inyandiko ya proxies no kongera gukoresha ama-Session
Gukoresha requests.get() kuri buri URL bishinga ihuza rishya rya TCP na TLS handshake buri nshuro. Guhuza proxy yawe na session = requests.Session() bituma umuyoboro wa proxy ukomeza gufunguka mu byifuzo bikurikirana.
| Ikipimo cya Requests | Imyandikire Isabwa | Intego ya Tekiniki |
|---|---|---|
Urufunguzo rwa 'http' | 'http://user:pass@ip:port' | Iyunzamo ibyifuzo bya HTTP bisanzwe binyuze kuri proxy |
Urufunguzo rwa 'https' | 'http://user:pass@ip:port' | Gukoresha gahunda ya http:// bituma urllib3 itangiza umuyoboro wa HTTP CONNECT wa TLS |
Ugushyira hamwe kwa timeout | timeout=(5, 15) | Igihe cyo guhuza kingana na 5s n'icyo gusoma kingana na 15s birinda imirimo y'ububiko guhagarara |
| Guhinduranya itsinda | itertools.cycle(proxy_list) | Ihinduranya mu buryo bungana mu itsinda ryawe rya za IP zihariye kandi zidahinduka |
Kwirinda amakosa akunze kubaho muri urllib3 na ProxyError
- Buri gihe koresha
http://(aho gukoreshahttps://) nka gahunda ya URL ya proxy ku mpande zombi z'inyandiko ya'http'na'https'keretse niba umuyoboro wa proxy yawe usaba by'umwihariko TLS-over-TLS - Kora URL-encode ku bimenyetso byihariye mu mibare y'ibanga ukoresheje
urllib.parse.quote(password, safe='') - Ikosa rya
407 Proxy Authentication Requiredrisobanura ko izina ry'ukoresha cyangwa ijambo ry'ibanga riri muri URL yawe ritajyanye n'iriri kuri konti yawe - Bikora kimwe neza no kuri
httpx.Client(proxy='http://user:pass@ip:port')hamwe naaiohttpsession.get(url, proxy=...)
Intambwe ku yindi
- 1
Hindura ip:port:user:pass mu myandikire ya URL
Koresha Proxy Format Converter yacu kugira ngo uhindure urutonde rwawe rwa VinaProxy rube imirongo ya
http://user:pass@ip:port. - 2
Kora inyandiko y'amakuru ya proxies
Shyiraho
proxies = {'http': 'http://user:pass@ip:port', 'https': 'http://user:pass@ip:port'}muri script yawe ya Python. - 3
Bishyire muri requests.Session()
Tangiza
s = requests.Session()hanyuma uhamagares.proxies.update(proxies)kugira ngo ukoreshe ihuriro rihoraho ryaKeep-Alive. - 4
Genjura IP isohoka ukoresheje ikigeragezo
Kora
print(s.get('https://vinaproxy.com/api/my-ip', timeout=10).json())kugira ngo wemeze IP ikora ya proxy.
Ibibazo bikunze kubazwa
Kuki urufunguzo rwa 'https' rukoresha 'http://user:pass@ip:port'?
Ijambo ribanza rya http:// ribwira urllib3 uko ihuza na seriveri ya proxy ubwayo (ikoresheje HTTP CONNECT isanzwe), mu gihe amakuru yawe yose yerekeza ku rubuga rwa https:// agumaho ubwirinzi bwuzuye bwa TLS.
Nahinduranya nte za proxy 25 zidahinduka mu byifuzo muri Python?
Shyira URL zawe 25 za proxy muri pool = itertools.cycle(PROXIES) hanyuma ushyireho proxies={'http': p, 'https': p} kuri buri cyifuzo mu gihe ushyizeho igipimo cyoroheje kuri buri IP.
VinaProxy yaba igena ingano y'umurongo ukoreshwa kuri script za Python scraping?
Oya. Gahunda zose za Dedicated IPv4 na Static ISP zikubiyemo umurongo w'amakuru wo gukoresha ku kwezi utarimbye.
Kora itsinda ryo gukora scraping muri Python ritagira umupaka
Za proxy zihuse za Dedicated IPv4 na Static ISP mu bihugu 7.
Gura za Proxy za Python