Base Spider ClassesΒΆ
- Base Spider
BaseSpiderBaseSpider.VALID_DATE_FORMATSBaseSpider.date_requiredBaseSpider.dont_truncateBaseSpider.encodingBaseSpider.concatenated_jsonBaseSpider.line_delimitedBaseSpider.validate_jsonBaseSpider.root_pathBaseSpider.unflattenBaseSpider.unflatten_argsBaseSpider.ocds_versionBaseSpider.max_attemptsBaseSpider.retry_http_codesBaseSpider.available_stepsBaseSpider.date_formatBaseSpider.from_crawler()BaseSpider.is_http_success()BaseSpider.is_http_retryable()BaseSpider.get_start_time()BaseSpider.get_retry_wait_time()BaseSpider.build_request()BaseSpider.build_file_from_response()BaseSpider.build_file()BaseSpider.build_file_item()BaseSpider.build_file_error_from_response()BaseSpider.get_default_until_date()
- Compressed File Spider
- Simple Spider
- Big File Spider
- Index Spider
IndexSpiderIndexSpider.use_pageIndexSpider.start_pageIndexSpider.chronological_orderIndexSpider.param_pageIndexSpider.param_limitIndexSpider.param_offsetIndexSpider.base_urlIndexSpider.parse_list_callbackIndexSpider.parse_list()IndexSpider.parse_list_loader()IndexSpider.page_count_range_generator()IndexSpider.pages_url_builder()IndexSpider.limit_offset_range_generator()IndexSpider.limit_offset_url_builder()IndexSpider.result_count_range_generator()
- Links Spider
- Periodic Spider