Search
 
SCRIPT & CODE EXAMPLE
 
CODE EXAMPLE FOR PYTHON

scrapy proxy pool

# Add this lines into settings.py file
PROXY_POOL_ENABLED = True
DOWNLOADER_MIDDLEWARES = {
    'scrapy_proxy_pool.middlewares.ProxyPoolMiddleware': 610,
    'scrapy_proxy_pool.middlewares.BanDetectionMiddleware': 620,
}
 
PREVIOUS NEXT
Tagged: #scrapy #proxy #pool
ADD COMMENT
Topic
Name
3+4 =