Files Store#

class kingfisher_scrapy.extensions.files_store.FilesStore(directory)[source]#

Writes items’ data to individual files in a directory. See the How it works documentation.

classmethod relative_crawl_directory(spider)[source]#

Returns the crawl’s relative directory, in the format <spider_name>[_sample]/<YYMMDD_HHMMSS>.

classmethod from_crawler(crawler)[source]#
spider_opened(spider)[source]#
spider_closed(spider)[source]#
item_scraped(item, spider)[source]#

If the item is a File or FileItem, writes its data to the filename in the crawl’s directory.

Returns a dict with the metadata.