Spiders¶

In Kingfisher Collect, there is one spider per data source. Each data source exposes its data in different ways, contains data from different years, and covers different stages of the contracting process.

Spider metadata¶

Below, we provide some of this information (metadata) for each spider. The meaning of the metadata is:

Metadata Description

Domain

The name of the IT system, jurisdiction, agency or program that is publishing the data. Some spiders have the same domain, in which case the difference between them is indicated in the suffix to the spider’s name:

Suffix	Description
`_releases`	Downloads individual releases or release packages
`_records`	Downloads individual records or record packages
`_bulk`	The data source is bulk data
`_historical`	The data source is historical data

Caveats Any noteworthy API or dataset limitations.

Spider arguments The Spider arguments the spider supports.

Environment variables

The environment variables required to run the spider. If a data source requires account registration, a link is provided. You can set environment variables as, for example:

env NAME1=VALUE1 NAME2=VALUE2 scrapy crawl spider_name

API documentation The URL of the API’s documentation.

Bulk download documentation The URL of any bulk download documentation.

Swagger API documentation The URL of the API’s documentation, using Swagger.

API endpoints If official API documentation is unavailable, we provide some brief documentation.

Spider arguments¶

A spider’s behavior can be changed by setting spider arguments:

scrapy crawl colombia -a NAME=VALUE

You can set multiple spider arguments:

scrapy crawl colombia -a from_date=2015-01-01 -a until_date=2019-12-31

All spiders support these arguments:

Name	Description	Format
`sample`	Set the number of files and file items to download.	integer

Some spiders support these arguments:

Name	Description	Format
`from_date`	Download data from this date onward. The spider might describe specific semantics (e.g. the relevant date is the date the contract was signed). Otherwise, the relevant date is the release date.	See spider
`until_date`	Download data until this date. The spider might describe specific semantics (e.g. the relevant date is the date the contract was signed). Otherwise, the relevant date is the release date.	See spider
`start_page`	Download data from this page onward.	integer
`publisher`	Download data by this publisher.	See spider
`system`	Download data from this system.	See spider

Afghanistan¶

class kingfisher_scrapy.spiders.afghanistan_record_packages.AfghanistanRecordPackages(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Afghanistan Government Electronic & Open Procurement System (AGEOPS)

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). Defaults to ‘2018-12-15’.
until_date: Download only data until this date (YYYY-MM-DD format). Defaults to today.

API documentation

https://ocds.ageops.net/

scrapy crawl afghanistan_record_packages

class kingfisher_scrapy.spiders.afghanistan_records.AfghanistanRecords(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Afghanistan Government Electronic & Open Procurement System (AGEOPS)
API documentation: https://ocds.ageops.net/

scrapy crawl afghanistan_records

class kingfisher_scrapy.spiders.afghanistan_release_packages.AfghanistanReleasePackages(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Afghanistan Government Electronic & Open Procurement System (AGEOPS)

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). Defaults to ‘2018-12-15’.
until_date: Download only data until this date (YYYY-MM-DD format). Defaults to today.

API documentation

https://ocds.ageops.net/

scrapy crawl afghanistan_release_packages

class kingfisher_scrapy.spiders.afghanistan_releases.AfghanistanReleases(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Afghanistan Government Electronic & Open Procurement System (AGEOPS)
API documentation: https://ocds.ageops.net/

scrapy crawl afghanistan_releases

Argentina¶

class kingfisher_scrapy.spiders.argentina_buenos_aires.ArgentinaBuenosAires(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Ciudad de Buenos Aires
API documentation: https://data.buenosaires.gob.ar/acerca/ckan
Bulk download documentation: https://data.buenosaires.gob.ar/dataset/buenos-aires-compras/archivo/2a3d077c-71b6-4ba7-8924-f3e38cf1b8fc

scrapy crawl argentina_buenos_aires

class kingfisher_scrapy.spiders.argentina_vialidad.ArgentinaVialidad(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Vialidad Nacional of Ministerio de Obras Públicas
API documentation: https://datosabiertos.vialidad.gob.ar/ui/index.html#!/datos_abiertos

scrapy crawl argentina_vialidad

Armenia¶

class kingfisher_scrapy.spiders.armenia.Armenia(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Armenian e-Procurement System (ARMEPS)
Caveats: The API paginates results using an offset query string parameter, which is a timestamp. If a timestamp causes an error, the spider will try to find the nearest timestamp within the following 1024 days that succeeds.

scrapy crawl armenia

Australia¶

class kingfisher_scrapy.spiders.australia.Australia(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: AusTender
API documentation: https://github.com/austender/austender-ocds-api
Swagger API documentation: https://app.swaggerhub.com/apis/austender/ocds-api/1.1

scrapy crawl australia

class kingfisher_scrapy.spiders.australia_nsw.AustraliaNSW(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: New South Wales (NSW)
API documentation: https://github.com/NSW-eTendering/NSW-eTendering-API/blob/master/README.md

scrapy crawl australia_nsw

Bolivia¶

class kingfisher_scrapy.spiders.bolivia_agetic.BoliviaAgetic(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Agencia de Gobierno Electrónico y Tecnologías de Información y Comunicación (AGETIC)
Bulk download documentation: https://datos.gob.bo/id/dataset/contrataciones-agetic-2019-estandar-ocp

scrapy crawl bolivia_agetic

Canada¶

class kingfisher_scrapy.spiders.canada_buyandsell.CanadaBuyAndSell(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Public Works and Government Services Canada
Caveats: The dataset is a pilot.
API documentation: https://buyandsell.gc.ca/procurement-data/open-contracting-data-standard-pilot/download-ocds-pilot-data

scrapy crawl canada_buyandsell

class kingfisher_scrapy.spiders.canada_montreal.CanadaMontreal(*args, **kwargs)[source]¶

Domain: Montréal, Québec
API documentation: http://donnees.ville.montreal.qc.ca/dataset/contrats-et-subventions-api

scrapy crawl canada_montreal

Chile¶

class kingfisher_scrapy.spiders.chile_compra_bulk.ChileCompraBulk(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: ChileCompra
Bulk download documentation: https://desarrolladores.mercadopublico.cl/OCDS/DescargaMasiva

scrapy crawl chile_compra_bulk

class kingfisher_scrapy.spiders.chile_compra_records.ChileCompraRecords(*args, **kwargs)[source]¶

Domain

ChileCompra

Spider arguments

from_date

Download only records from this date onward (YYYY-MM format). If from_date is not provided defaults to 2009-01.

until_date

Download only records until this date (YYYY-MM format). If from_date is not provided defaults to current year and month.

system

Filter by system, if not set gets all:

convenio: Framework agreements only
trato-directo: Direct tenders only
licitacion: Traditional tenders

Swagger API documentation

https://desarrolladores.mercadopublico.cl/docs/services/5a9ed02f718ed712f4403e75/operations/data-listaa-omes-agno-mes

scrapy crawl chile_compra_records

class kingfisher_scrapy.spiders.chile_compra_releases.ChileCompraReleases(*args, **kwargs)[source]¶

Domain

ChileCompra

Spider arguments

from_date

Download only releases from this date onward (YYYY-MM format). If from_date is not provided defaults to 2009-01.

until_date

Download only releases until this date (YYYY-MM format). If from_date is not provided defaults to current year and month.

system

Filter by system, if not set gets all:

convenio: Framework agreements only
trato-directo: Direct tenders only
licitacion: Traditional tenders

Swagger API documentation

https://desarrolladores.mercadopublico.cl/docs/services/5a9ed02f718ed712f4403e75/operations/data-listaa-omes-agno-mes

scrapy crawl chile_compra_releases

Colombia¶

class kingfisher_scrapy.spiders.colombia.Colombia(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Colombia Compra Eficiente (CCE)

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). If until_date is provided, defaults to ‘2011-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). If from_date is provided, defaults to today.
start_page: The page number from which to start crawling.

API documentation

https://www.colombiacompra.gov.co/transparencia/api

Swagger API documentation

https://apiocds.colombiacompra.gov.co:8443/apiCCE2.0/

scrapy crawl colombia

class kingfisher_scrapy.spiders.colombia_bulk.ColombiaBulk(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Colombia Compra Eficiente (CCE)
Bulk download documentation: https://www.colombiacompra.gov.co/transparencia/datos-json

scrapy crawl colombia_bulk

Costa Rica¶

class kingfisher_scrapy.spiders.costa_rica_poder_judicial_records.CostaRicaPoderJudicialRecords(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Poder Judicial de Costa Rica
Bulk download documentation: http://datosabiertospj.eastus.cloudapp.azure.com/dataset/estandar-de-datos-de-contrataciones-abiertas-ocds

scrapy crawl costa_rica_poder_judicial_records

class kingfisher_scrapy.spiders.costa_rica_poder_judicial_releases.CostaRicaPoderJudicialReleases(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Poder Judicial de Costa Rica
Bulk download documentation: http://datosabiertospj.eastus.cloudapp.azure.com/dataset/estandar-de-datos-de-contrataciones-abiertas-ocds

scrapy crawl costa_rica_poder_judicial_releases

Digiwhist¶

class kingfisher_scrapy.spiders.digiwhist_austria.DigiwhistAustria(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_austria

class kingfisher_scrapy.spiders.digiwhist_belgium.DigiwhistBelgium(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_belgium

class kingfisher_scrapy.spiders.digiwhist_bulgaria.DigiwhistBulgaria(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_bulgaria

class kingfisher_scrapy.spiders.digiwhist_croatia.DigiwhistCroatia(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_croatia

class kingfisher_scrapy.spiders.digiwhist_cyprus.DigiwhistCyprus(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_cyprus

class kingfisher_scrapy.spiders.digiwhist_czech_republic.DigiwhistCzechRepublic(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_czech_republic

class kingfisher_scrapy.spiders.digiwhist_denmark.DigiwhistDenmark(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_denmark

class kingfisher_scrapy.spiders.digiwhist_estonia.DigiwhistEstonia(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_estonia

class kingfisher_scrapy.spiders.digiwhist_finland.DigiwhistFinland(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_finland

class kingfisher_scrapy.spiders.digiwhist_france.DigiwhistFrance(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_france

class kingfisher_scrapy.spiders.digiwhist_georgia.DigiwhistGeorgia(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_georgia

class kingfisher_scrapy.spiders.digiwhist_germany.DigiwhistGermany(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_germany

class kingfisher_scrapy.spiders.digiwhist_greece.DigiwhistGreece(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_greece

class kingfisher_scrapy.spiders.digiwhist_hungary.DigiwhistHungary(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_hungary

class kingfisher_scrapy.spiders.digiwhist_iceland.DigiwhistIceland(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_iceland

class kingfisher_scrapy.spiders.digiwhist_ireland.DigiwhistIreland(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_ireland

class kingfisher_scrapy.spiders.digiwhist_italy.DigiwhistItaly(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_italy

class kingfisher_scrapy.spiders.digiwhist_latvia.DigiwhistLatvia(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_latvia

class kingfisher_scrapy.spiders.digiwhist_lithuania.DigiwhistLithuania(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_lithuania

class kingfisher_scrapy.spiders.digiwhist_luxembourg.DigiwhistLuxembourg(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_luxembourg

class kingfisher_scrapy.spiders.digiwhist_malta.DigiwhistMalta(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_malta

class kingfisher_scrapy.spiders.digiwhist_netherlands.DigiwhistNetherlands(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_netherlands

class kingfisher_scrapy.spiders.digiwhist_norway.DigiwhistNorway(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_norway

class kingfisher_scrapy.spiders.digiwhist_poland.DigiwhistPoland(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_poland

class kingfisher_scrapy.spiders.digiwhist_portugal.DigiwhistPortugal(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_portugal

class kingfisher_scrapy.spiders.digiwhist_romania.DigiwhistRomania(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_romania

class kingfisher_scrapy.spiders.digiwhist_slovakia.DigiwhistSlovakia(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_slovakia

class kingfisher_scrapy.spiders.digiwhist_slovenia.DigiwhistSlovenia(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_slovenia

class kingfisher_scrapy.spiders.digiwhist_spain.DigiwhistSpain(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_spain

class kingfisher_scrapy.spiders.digiwhist_sweden.DigiwhistSweden(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_sweden

class kingfisher_scrapy.spiders.digiwhist_switzerland.DigiwhistSwitzerland(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_switzerland

class kingfisher_scrapy.spiders.digiwhist_ted.DigiwhistTED(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_ted

class kingfisher_scrapy.spiders.digiwhist_united_kingdom.DigiwhistUnitedKingdom(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

scrapy crawl digiwhist_united_kingdom

Dominican Republic¶

class kingfisher_scrapy.spiders.dominican_republic.DominicanRepublic(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Dirección General de Contrataciones Públicas (DGCP)
Bulk download documentation: https://www.dgcp.gob.do/estandar-mundial-ocds/

scrapy crawl dominican_republic

class kingfisher_scrapy.spiders.dominican_republic_api.DominicanRepublicPortal(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Dirección General de Contrataciones Públicas (DGCP)

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). If until_date is provided, defaults to ‘2018-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). If from_date is provided, defaults to today.

API documentation

http://148.101.176.123:48080/ocdsdr/docs

scrapy crawl dominican_republic_api

Ecuador¶

class kingfisher_scrapy.spiders.ecuador_emergency.EcuadorEmergency(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Servicio Nacional de Contratación Pública
Bulk download documentation: https://portal.compraspublicas.gob.ec/sercop/data-estandar-ocds/

scrapy crawl ecuador_emergency

France¶

class kingfisher_scrapy.spiders.france.France(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: France
Swagger API documentation: https://doc.data.gouv.fr/api/reference/

scrapy crawl france

Georgia¶

class kingfisher_scrapy.spiders.georgia_opendata.GeorgiaOpenData(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: State Procurement Agency (SPA)

scrapy crawl georgia_opendata

class kingfisher_scrapy.spiders.georgia_records.GeorgiaRecords(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: State Procurement Agency (SPA)
Swagger API documentation: https://odapi.spa.ge/api/swagger.ui

scrapy crawl georgia_records

class kingfisher_scrapy.spiders.georgia_releases.GeorgiaReleases(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: State Procurement Agency (SPA)
Swagger API documentation: https://odapi.spa.ge/api/swagger.ui

scrapy crawl georgia_releases

Honduras¶

class kingfisher_scrapy.spiders.honduras_cost.HondurasCoST(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Systema de Información y Seguimiento de Obras y Contratos (SISOCS)

scrapy crawl honduras_cost

class kingfisher_scrapy.spiders.honduras_oncae.HondurasONCAE(*args, **kwargs)[source]¶

Domain

Oficina Normativa de Contratación y Adquisiciones del Estado (ONCAE)

Spider arguments

from_date

Download only data from this year onward (YYYY format). Defaults to ‘2005’.

until_date

Download only data until this year (YYYY format). Defaults to the current year.

system

Filter by system:

CE: Catálogo Electrónico
DDC: Módulo de Difusión Directa de Contratos
HC1: HonduCompras 1.0 (Módulo de Difusión de Compras y Contrataciones)

Bulk download documentation

http://oncae.gob.hn/datosabiertos

scrapy crawl honduras_oncae

class kingfisher_scrapy.spiders.honduras_portal_bulk.HondurasPortalBulk(*args, **kwargs)[source]¶

Domain

Oficina Normativa de Contratación y Adquisiciones del Estado (ONCAE) / Secretaria de Finanzas de Honduras (SEFIN)

Spider arguments

from_date

Download only data from this month onward (YYYY-MM format). Defaults to ‘2005-11’.

until_date

Download only data until this month (YYYY-MM format). Defaults to the current month.

publisher

Filter by publisher:

oncae: Oficina Normativa de Contratación y Adquisiciones del Estado
sefin: Secretaria de Finanzas de Honduras

system

Filter by oncae system:

CE: Catálogo Electrónico
DDC: Módulo de Difusión Directa de Contratos
HC1: HonduCompras 1.0 (Módulo de Difusión de Compras y Contrataciones)

Bulk download documentation

http://www.contratacionesabiertas.gob.hn/descargas/

scrapy crawl honduras_portal_bulk

class kingfisher_scrapy.spiders.honduras_portal_records.HondurasPortalRecords(*args, **kwargs)[source]¶

Domain

Oficina Normativa de Contratación y Adquisiciones del Estado (ONCAE) / Secretaria de Finanzas de Honduras (SEFIN)

Spider arguments

publisher

Filter by publisher:

oncae: Oficina Normativa de Contratación y Adquisiciones del Estado
sefin: Secretaria de Finanzas de Honduras

API documentation

http://www.contratacionesabiertas.gob.hn/manual_api/

Swagger API documentation

http://www.contratacionesabiertas.gob.hn/servicio/

scrapy crawl honduras_portal_records

class kingfisher_scrapy.spiders.honduras_portal_releases.HondurasPortalReleases(*args, **kwargs)[source]¶

Domain

Oficina Normativa de Contratación y Adquisiciones del Estado (ONCAE) / Secretaria de Finanzas de Honduras (SEFIN)

Spider arguments

publisher

Filter by publisher:

oncae: Oficina Normativa de Contratación y Adquisiciones del Estado
sefin: Secretaria de Finanzas de Honduras

API documentation

http://www.contratacionesabiertas.gob.hn/manual_api/

Swagger API documentation

http://www.contratacionesabiertas.gob.hn/servicio/

scrapy crawl honduras_portal_releases

India¶

class kingfisher_scrapy.spiders.india_civic_data_lab.IndiaCivicDataLab(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Civic Data Lab India
Bulk download documentation: https://github.com/CivicDataLab/himachal-pradesh-health-procurement-OCDS/

scrapy crawl india_civic_data_lab

Indonesia¶

class kingfisher_scrapy.spiders.indonesia_bandung.IndonesiaBandung(*args, **kwargs)[source]¶

Domain

Bandung Integrated Resource Management System (BIRMS)

Spider arguments

from_date: Download only releases from this date onward (YYYY format). If from_date is not provided defaults to 2013.
until_date: Download only releases until this date (YYYY format). If from_date is not provided defaults to current year.

API endpoints

Get contract list by year

Link

https://birms.bandung.go.id/api/contracts/year/{year}?page={page}

Parameters

year: contract year number
page: page number

Get contract detail by OCID

Link

https://birms.bandung.go.id/api/newcontract/ocds-afzrfb-{source-database}-{year}-{uniqid}

Parameters

source-database: (b)irms or (s)pse
year: contract year number
uniqid: release id

scrapy crawl indonesia_bandung

Italy¶

class kingfisher_scrapy.spiders.italy.Italy(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: AppaltiPOP
Bulk download documentation: https://www.appaltipop.it/it/download

scrapy crawl italy

Kenya¶

class kingfisher_scrapy.spiders.kenya_makueni.KenyaMakueni(*args, **kwargs)[source]¶

Domain: Makueni County
Swagger API documentation: https://opencontracting.makueni.go.ke/swagger-ui.html#/ocds-controller

scrapy crawl kenya_makueni

Kosovo¶

class kingfisher_scrapy.spiders.kosovo.Kosovo(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Public Procurement Regulatory Commission

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format). If until_date is provided, defaults to ‘2000-01-01T00:00:00’.
until_date: Download only data until this time (YYYY-MM-DDThh:mm:ss format). If from_date is provided, defaults to now.

API documentation

https://ocdskrpp-test.rks-gov.net/Help

scrapy crawl kosovo

Kyrgyzstan¶

class kingfisher_scrapy.spiders.kyrgyzstan.Kyrgyzstan(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Ministry of Finance
Caveats: The planning endpoint is not implemented because is not completely in OCDS.
Bulk download documentation: https://analytics.zakupki.gov.kg/dashboard/weekly and then to ‘API & EXPORT’. Direct access to https://analytics.zakupki.gov.kg/api-export doesn’t work.
Swagger API documentation: https://app.swaggerhub.com/apis/DPAteam/export-api-documentation/1.0

scrapy crawl kyrgyzstan

Malta¶

class kingfisher_scrapy.spiders.malta.Malta(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Malta
API documentation: https://docs.google.com/document/d/1VnCEywKkkQ7BcVbT7HlW2s_N_QI8W0KE/edit

scrapy crawl malta

Mexico¶

class kingfisher_scrapy.spiders.mexico_administracion_publica_federal.MexicoAdministracionPublicaFederal(*args, **kwargs)[source]¶

Domain: Administración Pública Federal (APF)
Bulk download documentation: https://datos.gob.mx/busca/dataset/concentrado-de-contrataciones-abiertas-de-la-apf

scrapy crawl mexico_administracion_publica_federal

class kingfisher_scrapy.spiders.mexico_grupo_aeroporto.MexicoGrupoAeroporto(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Grupo Aeroportuario de la Ciudad de México (CDMX)

scrapy crawl mexico_grupo_aeroporto

class kingfisher_scrapy.spiders.mexico_inai.MexicoINAI(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Instituto Nacional de Transparencia, Acceso a la Información y Protección de Datos Personales (INAI)
Caveats: Contains data from 2017 only.
Bulk download documentation: https://datos.gob.mx/busca/dataset/contrataciones-abiertas-del-inai

scrapy crawl mexico_inai

class kingfisher_scrapy.spiders.mexico_inai_portal.MexicoINAIPortal(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Instituto Nacional de Transparencia, Acceso a la Información y Protección de Datos Personales (INAI)

scrapy crawl mexico_inai_portal

class kingfisher_scrapy.spiders.mexico_nuevo_leon_records.MexicoNuevoLeonRecords(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Secretaría de Infraestructura del Gobierno del Estado de Nuevo León
Bulk download documentation: http://si.nl.gob.mx/transparencia/acerca-del-proyecto

scrapy crawl mexico_nuevo_leon_records

class kingfisher_scrapy.spiders.mexico_nuevo_leon_releases.MexicoNuevoLeonReleases(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Secretaría de Infraestructura del Gobierno del Estado de Nuevo León
Bulk download documentation: http://si.nl.gob.mx/transparencia/acerca-del-proyecto

scrapy crawl mexico_nuevo_leon_releases

class kingfisher_scrapy.spiders.mexico_plataforma_digital_nacional.MexicoPlataformaDigitalNacional(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Plataforma Digital Nacional
Bulk download documentation: https://plataformadigitalnacional.org/contrataciones

scrapy crawl mexico_plataforma_digital_nacional

class kingfisher_scrapy.spiders.mexico_quien_es_quien.MexicoQuienEsQuien(*args, **kwargs)[source]¶

Domain: QuiénEsQuién.Wiki
API documentation: https://quienesquienapi.readthedocs.io/es/latest/
Swagger API documentation: https://api.quienesquien.wiki/v2/docs/

scrapy crawl mexico_quien_es_quien

Moldova¶

class kingfisher_scrapy.spiders.moldova.Moldova(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: MTender

scrapy crawl moldova

class kingfisher_scrapy.spiders.moldova_old.MoldovaOld(*args, **kwargs)[source]¶

Domain

Public Procurement Agency (PPA)

Spider arguments

from_date: Download only data from this month onward (YYYY format). Defaults to ‘2012’.
until_date: Download only data until this month (YYYY format). Defaults to ‘2018’.

Bulk download documentation

http://opencontracting.date.gov.md/downloads

scrapy crawl moldova_old

class kingfisher_scrapy.spiders.moldova_positive_initiative.MoldovaPositiveInitiative(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Positive Initiative - Moldova
Bulk download documentation: https://www.tender.health/ocdsrelease

scrapy crawl moldova_positive_initiative

Nepal¶

class kingfisher_scrapy.spiders.nepal_dhangadhi.NepalDhangadhi(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Dhangadhi Infrastructure Management System (IMS)
Caveats: Some URLs listed in https://admin.ims.susasan.org/api/static-data/dhangadhi require login and cannot be downloaded
Bulk download documentation: https://ims.susasan.org/dhangadhi/about

scrapy crawl nepal_dhangadhi

class kingfisher_scrapy.spiders.nepal_portal.NepalPortal(*args, **kwargs)[source]¶

Domain

Public Procurement Monitoring Office (PPMO)

Spider arguments

from_date: Download only data from this month onward (YYYY format). Defaults to ‘2012’.
until_date: Download only data until this month (YYYY format). Defaults to ‘2018’.

Bulk download documentation

http://ppip.gov.np/downloads

scrapy crawl nepal_portal

Nicaragua¶

class kingfisher_scrapy.spiders.nicaragua_solid_waste.NicaraguaSolidWaste(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Solid Waste Mitigation Platform (SWMP)

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). Defaults to ‘2000-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). Defaults to today.

scrapy crawl nicaragua_solid_waste

Nigeria¶

class kingfisher_scrapy.spiders.nigeria_budeshi_records.NigeriaBudeshiRecords(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Budeshi Nigeria
API documentation: https://budeshi.ng/Api

scrapy crawl nigeria_budeshi_records

class kingfisher_scrapy.spiders.nigeria_budeshi_releases.NigeriaBudeshiReleases(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Budeshi Nigeria
API documentation: https://budeshi.ng/Api

scrapy crawl nigeria_budeshi_releases

class kingfisher_scrapy.spiders.nigeria_portal.NigeriaPortal(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Nigeria Open Contracting Portal (NOCOPO) of Bureau of Public Procurement (BPP)

scrapy crawl nigeria_portal

Openopps¶

class kingfisher_scrapy.spiders.openopps.OpenOpps(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

OpenOpps

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). If until_date is provided, defaults to ‘2011-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). If from_date is provided, defaults to today.

Environment variables

KINGFISHER_OPENOPPS_USERNAME: To get an API account, contact contact@openopps.com.
KINGFISHER_OPENOPPS_PASSWORD: Your API account password.

API documentation

https://docs.google.com/document/d/1u0da3BTU7fBFjX6i7j_tKXa1YwdXL7hY4Kw9GdsaAr0/edit

Swagger API documentation

https://api.openopps.com/api/schema/

env KINGFISHER_OPENOPPS_USERNAME=... KINGFISHER_OPENOPPS_PASSWORD=... scrapy crawl openopps

Pakistan¶

class kingfisher_scrapy.spiders.pakistan_ppra_bulk.PakistanPPRABulk(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Pakistan Public Procurement Regulatory Authority (PPRA)
API documentation: https://www.ppra.org.pk/api/

scrapy crawl pakistan_ppra_bulk

class kingfisher_scrapy.spiders.pakistan_ppra_releases.PakistanPPRAReleases(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Pakistan Public Procurement Regulatory Authority (PPRA)
API documentation: https://www.ppra.org.pk/api/

scrapy crawl pakistan_ppra_releases

Paraguay¶

class kingfisher_scrapy.spiders.paraguay_dncp_records.ParaguayDNCPRecords(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Dirección Nacional de Contrataciones Públicas (DNCP)

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format). Defaults to ‘2010-01-01T00:00:00’.
until_date: Download only data until this time (YYYY-MM-DDThh:mm:ss format). Defaults to now.

Environment variables

KINGFISHER_PARAGUAY_DNCP_REQUEST_TOKEN: To get an API account and request token go to https://contrataciones.gov.py/datos/adm/login.

Swagger API documentation

https://contrataciones.gov.py/datos/api/v3/doc

env KINGFISHER_PARAGUAY_DNCP_REQUEST_TOKEN=... scrapy crawl paraguay_dncp_records

class kingfisher_scrapy.spiders.paraguay_dncp_releases.ParaguayDNCPReleases(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Dirección Nacional de Contrataciones Públicas (DNCP)

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format). Defaults to ‘2010-01-01T00:00:00’.
until_date: Download only data until this time (YYYY-MM-DDThh:mm:ss format). Defaults to now.

Environment variables

KINGFISHER_PARAGUAY_DNCP_REQUEST_TOKEN: To get an API account and request token go to https://contrataciones.gov.py/datos/adm/login.

Swagger API documentation

https://contrataciones.gov.py/datos/api/v3/doc

env KINGFISHER_PARAGUAY_DNCP_REQUEST_TOKEN=... scrapy crawl paraguay_dncp_releases

class kingfisher_scrapy.spiders.paraguay_hacienda.ParaguayHacienda(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Ministerio de Hacienda

Environment variables

KINGFISHER_PARAGUAY_HACIENDA_REQUEST_TOKEN: To get an API account and request token go to https://datos.hacienda.gov.py/aplicaciones/new.
KINGFISHER_PARAGUAY_HACIENDA_CLIENT_SECRET: Your client secret generated.

Swagger API documentation

https://datos.hacienda.gov.py/odmh-api-v1/api-docs/

env KINGFISHER_PARAGUAY_HACIENDA_REQUEST_TOKEN=... KINGFISHER_PARAGUAY_HACIENDA_CLIENT_SECRET=... scrapy crawl paraguay_hacienda

Portugal¶

class kingfisher_scrapy.spiders.portugal.Portugal(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Instituto dos Mercados Públicos, do Imobiliário e da Construção (IMPIC)
Bulk download documentation: https://dados.gov.pt/pt/datasets/ocds-portal-base-www-base-gov-pt/
API documentation: https://dados.gov.pt/pt/apidoc/
Swagger API documentation: https://dados.gov.pt/pt/apidoc/#/datasets

scrapy crawl portugal

class kingfisher_scrapy.spiders.portugal_records.PortugalRecords(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Instituto dos Mercados Públicos, do Imobiliário e da Construção (IMPIC)

Spider arguments

from_date: Download only data with a contract signing date from this date onward (YYYY-MM-DD format). If until_date is provided, defaults to ‘2010-01-01’.
until_date: Download only data with a contract signing date until this date (YYYY-MM-DD format). If from_date is provided, defaults to today.

Swagger API documentation

http://www.base.gov.pt/swagger/index.html

scrapy crawl portugal_records

class kingfisher_scrapy.spiders.portugal_releases.PortugalReleases(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Instituto dos Mercados Públicos, do Imobiliário e da Construção (IMPIC)

Spider arguments

from_date: Download only data with a contract signing date from this date onward (YYYY-MM-DD format). If until_date is provided, defaults to ‘2010-01-01’.
until_date: Download only data with a contract signing date until this date (YYYY-MM-DD format). If from_date is provided, defaults to today.

Swagger API documentation

http://www.base.gov.pt/swagger/index.html

scrapy crawl portugal_releases

Scotland¶

class kingfisher_scrapy.spiders.scotland_public_contracts.ScotlandPublicContracts(*args, **kwargs)[source]¶

Domain

Public Contracts Scotland

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). Defaults to a year ago.
until_date: Download only data until this month (YYYY-MM format). Defaults to the current month.

API documentation

https://api.publiccontractsscotland.gov.uk/v1

scrapy crawl scotland_public_contracts

Spain¶

class kingfisher_scrapy.spiders.spain_zaragoza.SpainZaragoza(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Ayuntamiento de Zaragoza
Caveats: The API’s before and after query string parameters have no effect and are therefore not implemented.
Swagger API documentation: https://www.zaragoza.es/docs-api_sede/

scrapy crawl spain_zaragoza

Tanzania¶

class kingfisher_scrapy.spiders.tanzania_zabuni.TanzaniaZabuni(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Tanzania Zabuni
API documentation: https://zabuni.co.tz/docs

scrapy crawl tanzania_zabuni

Uganda¶

class kingfisher_scrapy.spiders.uganda_releases.Uganda(*args, **kwargs)[source]¶

Domain: Government Procurement Portal (GPP) of Public Procurement and Disposal of Public Assets Authority (PPDA)
API documentation: https://docs.google.com/spreadsheets/d/10tVioy-VOQa1FwWoRl5e1pMbGpiymA0iycNcoDFkvks/edit#gid=365266172

scrapy crawl uganda_releases

Uk¶

class kingfisher_scrapy.spiders.uk_contracts_finder.UKContractsFinder(*args, **kwargs)[source]¶

Domain: Contracts Finder

scrapy crawl uk_contracts_finder

class kingfisher_scrapy.spiders.uk_fts.UKFTS(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain

Find a Tender Service (FTS)

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format). If until_date is provided, defaults to ‘2021-01-01T00:00:00’.
until_date: Download only data until this time (YYYY-MM-DDThh:mm:ss format). If from_date is provided, defaults to now.

API documentation

https://www.find-tender.service.gov.uk/apidocumentation/1.0/GET-ocdsReleasePackages

scrapy crawl uk_fts

class kingfisher_scrapy.spiders.uk_fts_test.UKFTSTest(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Find a Tender Service (FTS)
Caveats: This spider uses a test service that returns test data. For getting real data see uk_fts instead.

scrapy crawl uk_fts_test

Uruguay¶

class kingfisher_scrapy.spiders.uruguay_historical.UruguayHistorical(*args, **kwargs)[source]¶

Domain

Agencia Reguladora de Compras Estatales (ARCE)

Spider arguments

from_date: Download only data from this month onward (YYYY format). Defaults to ‘2002’.
until_date: Download only data until this month (YYYY format). Defaults to ‘2017’.

Bulk download documentation

https://www.gub.uy/agencia-compras-contrataciones-estado/datos-y-estadisticas/datos/open-contracting

scrapy crawl uruguay_historical

class kingfisher_scrapy.spiders.uruguay_records.UruguayRecords(*args, **kwargs)[source]¶

Domain

Agencia Reguladora de Compras Estatales (ARCE)

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). Defaults to ‘2017-11’.
until_date: Download only data until this month (YYYY-MM format). Defaults to the current year-month.

API documentation

https://www.gub.uy/agencia-compras-contrataciones-estado/datos-y-estadisticas/datos/open-contracting

scrapy crawl uruguay_records

class kingfisher_scrapy.spiders.uruguay_releases.UruguayReleases(*args, **kwargs)[source]¶

Domain

Agencia Reguladora de Compras Estatales (ARCE)

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). Defaults to ‘2017-11’.
until_date: Download only data until this month (YYYY-MM format). Defaults to the current year-month.

API documentation

https://www.gub.uy/agencia-compras-contrataciones-estado/datos-y-estadisticas/datos/open-contracting

scrapy crawl uruguay_releases

Zambia¶

class kingfisher_scrapy.spiders.zambia.Zambia(sample=None, note=None, from_date=None, until_date=None, crawl_time=None, keep_collection_open=None, package_pointer=None, release_pointer=None, truncate=None, *args, **kwargs)[source]¶

Domain: Zambia Public Procurement Authority

scrapy crawl zambia