为了账号安全,请及时绑定邮箱和手机立即绑定

爬取京东商品时只爬取部分图片

爬取京东商品时只爬取部分图片

weibo_YL心向阳光123_0 2019-10-25 20:18:41
2019-10-25 20:12:49 [scrapy.pipelines.files] ERROR: File (unknown-error): Error processing file from <GET https://img11.360buyimg.com/n7/jfs/t1/53330/28/10938/182616/5d7f595eE15c0bf39/4873689f6ab8b464.jpg> referred in <None>Traceback (most recent call last):  File "D:\Anaconda\lib\site-packages\scrapy\pipelines\files.py", line 419, in media_downloaded    checksum = self.file_downloaded(response, request, info)  File "D:\Anaconda\lib\site-packages\scrapy\pipelines\images.py", line 102, in file_downloaded    return self.image_downloaded(response, request, info)  File "D:\Anaconda\lib\site-packages\scrapy\pipelines\images.py", line 106, in image_downloaded    for path, image, buf in self.get_images(response, request, info):  File "D:\Anaconda\lib\site-packages\scrapy\pipelines\images.py", line 120, in get_images    orig_image = Image.open(BytesIO(response.body))  File "D:\Anaconda\lib\site-packages\PIL\Image.py", line 2818, in open    raise IOError("cannot identify image file %r" % (filename if filename else fp))OSError: cannot identify image file <_io.BytesIO object at 0x0000000005C5FDB0>2019-10-25 20:12:49 [scrapy.statscollectors] INFO: Dumping Scrapy stats:{'downloader/response_bytes': 526052, 'downloader/response_count': 31, 'downloader/response_status_count/200': 31, 'file_count': 30, 'file_status_count/downloaded': 30, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2019, 10, 25, 12, 12, 49, 806768), 'item_scraped_count': 30, 'log_count/DEBUG': 420, 'log_count/ERROR': 30, 'log_count/INFO': 9, 'offsite/domains': 1, 'offsite/filtered': 2, 'request_depth_max': 1, 'response_received_count': 31, 'scheduler/dequeued': 1, 'scheduler/dequeued/memory': 1, 'scheduler/enqueued': 1, 'scheduler/enqueued/memory': 1, 'start_time': datetime.datetime(2019, 10, 25, 12, 12, 33, 906859)}2019-10-25 20:12:49 [scrapy.core.engine] INFO: Spider closed (finished)
查看完整描述

3 回答

  • 3 回答
  • 0 关注
  • 1101 浏览
慕课专栏
更多

添加回答

举报

0/150
提交
取消
意见反馈 帮助中心 APP下载
官方微信