Skip to content

Instantly share code, notes, and snippets.

@ian-kerins

ian-kerins/Scrapy_Amazon_P9.py

Created April 8, 2021 13:50
Show Gist options
  • Save ian-kerins/85535b5eada29cbe5595679ef6c2ca44 to your computer and use it in GitHub Desktop.
Save ian-kerins/85535b5eada29cbe5595679ef6c2ca44 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Scrapy_Amazon_P9.py
def start_requests(self):
...
…
yield scrapy.Request(url=get_url(url), callback=self.parse_keyword_response)
def parse_keyword_response(self, response):
...
…
yield scrapy.Request(url=get_url(product_url), callback=self.parse_product_page, meta={'asin': asin})
...
…
yield scrapy.Request(url=get_url(url), callback=self.parse_keyword_response)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment