Skip to content

Instantly share code, notes, and snippets.

@afrazahmad21
Created May 30, 2017 10:44
Show Gist options
  • Save afrazahmad21/70dd7239f4809be236a7708be028c30a to your computer and use it in GitHub Desktop.
Save afrazahmad21/70dd7239f4809be236a7708be028c30a to your computer and use it in GitHub Desktop.
2017-05-30 15:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://www.kmart.com.au/product/womens-placket-top/1263809?imageIndex=2&selectedSwatch=White&selectedSwatchPartnumber=1272386> (referer: http://www.kmart.com.au/category/women/womens-clothing/womens-tops/414008)
2017-05-30 15:39:01 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.kmart.com.au/product/womens-placket-top/1263809?imageIndex=2&selectedSwatch=White&selectedSwatchPartnumber=1272386> (referer: http://www.kmart.com.au/category/women/womens-clothing/womens-tops/414008)
Traceback (most recent call last):
File "/home/afraz/anaconda3/lib/python3.6/site-packages/twisted/internet/defer.py", line 1301, in _inlineCallbacks
result = g.send(result)
File "/home/afraz/anaconda3/lib/python3.6/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request
defer.returnValue((yield download_func(request=request,spider=spider)))
File "/home/afraz/anaconda3/lib/python3.6/site-packages/twisted/internet/defer.py", line 1278, in returnValue
raise _DefGen_Return(val)
twisted.internet.defer._DefGen_Return: <200 http://www.kmart.com.au/product/womens-placket-top/1263809?imageIndex=2&selectedSwatch=White&selectedSwatchPartnumber=1272386>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/afraz/anaconda3/lib/python3.6/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred
result = f(*args, **kw)
File "/home/afraz/anaconda3/lib/python3.6/site-packages/scrapy/core/spidermw.py", line 49, in process_spider_input
return scrape_func(response, request, spider)
File "/home/afraz/anaconda3/lib/python3.6/site-packages/scrapy/core/scraper.py", line 146, in call_spider
dfd.addCallbacks(request.callback or spider.parse, request.errback)
File "/home/afraz/anaconda3/lib/python3.6/site-packages/twisted/internet/defer.py", line 303, in addCallbacks
assert callable(callback)
AssertionError
2017-05-30 15:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://www.kmart.com.au/product/womens-placket-top/1263810> (referer: http://www.kmart.com.au/category/women/womens-clothing/womens-tops/414008)
2017-05-30 15:39:01 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.kmart.com.au/product/womens-placket-top/1263810> (referer: http://www.kmart.com.au/category/women/womens-clothing/womens-tops/414008)
Traceback (most recent call last):
File "/home/afraz/anaconda3/lib/python3.6/site-packages/twisted/internet/defer.py", line 1301, in _inlineCallbacks
result = g.send(result)
File "/home/afraz/anaconda3/lib/python3.6/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request
defer.returnValue((yield download_func(request=request,spider=spider)))
File "/home/afraz/anaconda3/lib/python3.6/site-packages/twisted/internet/defer.py", line 1278, in returnValue
raise _DefGen_Return(val)
twisted.internet.defer._DefGen_Return: <200 http://www.kmart.com.au/product/womens-placket-top/1263810>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/afraz/anaconda3/lib/python3.6/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred
result = f(*args, **kw)
File "/home/afraz/anaconda3/lib/python3.6/site-packages/scrapy/core/spidermw.py", line 49, in process_spider_input
return scrape_func(response, request, spider)
File "/home/afraz/anaconda3/lib/python3.6/site-packages/scrapy/core/scraper.py", line 146, in call_spider
dfd.addCallbacks(request.callback or spider.parse, request.errback)
File "/home/afraz/anaconda3/lib/python3.6/site-packages/twisted/internet/defer.py", line 303, in addCallbacks
assert callable(callback)
AssertionError
2017-05-30 15:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://www.kmart.com.au/product/garment-dyed-joggers/1239803> (referer: http://www.kmart.com.au/category/women/womens-clothing/womens-jeans-&-pants/414009)
2017-05-30 15:39:02 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.kmart.com.au/product/garment-dyed-joggers/1239803> (referer: http://www.kmart.com.au/category/women/womens-clothing/womens-jeans-&-pants/414009)
Traceback (most recent call last):
File "/home/afraz/anaconda3/lib/python3.6/site-packages/twisted/internet/defer.py", line 1301, in _inlineCallbacks
result = g.send(result)
File "/home/afraz/anaconda3/lib/python3.6/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request
defer.returnValue((yield download_func(request=request,spider=spider)))
File "/home/afraz/anaconda3/lib/python3.6/site-packages/twisted/internet/defer.py", line 1278, in returnValue
raise _DefGen_Return(val)
twisted.internet.defer._DefGen_Return: <200 http://www.kmart.com.au/product/garment-dyed-joggers/1239803>
During handling of the above exception, another exception occurred:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment