Search
 
SCRIPT & CODE EXAMPLE
 
CODE EXAMPLE FOR PYTHON

scrape sitemap

import requests
from urllib.parse import urlencode

list_of_urls = ['http://quotes.toscrape.com/page/1/', 'http://quotes.toscrape.com/page/2/']

for url in list_of_urls: 
    params = {'api_key': API_KEY, 'url': url}
    response = requests.get('http://api.scraperapi.com/', params=urlencode(params))
    print(response.text)
Source by www.scraperapi.com #
 
PREVIOUS NEXT
Tagged: #scrape #sitemap
ADD COMMENT
Topic
Name
9+2 =