Spiders¶

In Kingfisher Collect, there is one spider per data source. Each data source exposes its data in different ways, contains data from different years, and covers different stages of the contracting process.

Spider metadata¶

Below, we provide some of this information (metadata) for each spider. The meaning of the metadata is:

Metadata

Description

Domain

The name of the IT system, jurisdiction, agency or program that is publishing the data. Some spiders have the same domain, in which case the difference between them is indicated in the suffix to the spider’s name:

Suffix	Description
`_releases`	Downloads individual releases or release packages
`_records`	Downloads individual records or record packages
`_bulk`	The data source is bulk data
`_historical`	The data source is historical data

Caveats

Any noteworthy API or dataset limitations.

Spider arguments

The Spider arguments the spider supports.

Environment variables

The environment variables required to run the spider. If a data source requires account registration, a link is provided. You can set environment variables as, for example:

env NAME1=VALUE1 NAME2=VALUE2 scrapy crawl spider_name

API documentation

The URL of the API’s documentation.

Bulk download documentation

The URL of any bulk download documentation.

Swagger API documentation

The URL of the API’s documentation, using Swagger.

API endpoints

If official API documentation is unavailable, we provide some brief documentation.

Spider arguments¶

A spider’s behavior can be changed by setting spider arguments:

scrapy crawl spider_name -a NAME=VALUE

You can set multiple spider arguments:

scrapy crawl spider_name -a from_date=2015-01-01 -a until_date=2019-12-31

All spiders support these arguments:

Name	Description	Format
`sample`	Set the number of files and file items to download.	integer
`path`	Path components to append to each URL, if filters are implemented within the path. See also: Filter the data.	string
`qs:*`	Query string parameters to append to each URL, for example: `qs:parameter1=value1`. See also: Filter the data.	string

Note

If a source publishes release packages or record packages, the sample argument refers to the number of packages to download.

However, if a source publishes files that either:

Contain multiple release packages or record packages
Contain multiple releases or records that are not within a package

Each file will be split into multiple file items. In this case, the sample argument refers to the number of file items (packages, releases or records) to download.

Some spiders support these arguments:

Name	Description	Format
`from_date`	Download data from this date onward. The spider might describe specific semantics (e.g. the relevant date is the date the contract was signed). Otherwise, the relevant date is the release date.	See spider
`until_date`	Download data until this date. The spider might describe specific semantics (e.g. the relevant date is the date the contract was signed). Otherwise, the relevant date is the release date.	See spider
`portal`	Download data from this portal.	See spider
`publisher`	Download data by this publisher.	See spider
`system`	Download data from this system.	See spider

Available data sources by country¶

Albania¶

class kingfisher_scrapy.spiders.albania_public_procurement_commission.AlbaniaPublicProcurementCommission(*args, **kwargs)[source]¶

Domain

Komisioni i Prokurimit Publik (KPP) (Public Procurement Commission)

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2021’.
until_date: Download only data until this year (YYYY format). Defaults to the current year.

Bulk download documentation

https://kpp.al/en/Historiku?nrVendimi=&OperatoriEkonmik=&idOperatori=&autoritetiKotraktues=&id=

scrapy crawl albania_public_procurement_commission

class kingfisher_scrapy.spiders.albania_public_procurement_commission_historical.AlbaniaPublicProcurementCommissionHistorical(*args, **kwargs)[source]¶

Domain

Komisioni i Prokurimit Publik (KPP) (Public Procurement Commission)

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2010’.
until_date: Download only data until this year (YYYY format). Defaults to ‘2020’.

Bulk download documentation

https://kpp.al/en/HistorikVendimesh?objektProkurimi=&viti=&vitiId=&muaji=&muajiId=

scrapy crawl albania_public_procurement_commission_historical

Argentina¶

class kingfisher_scrapy.spiders.argentina_mendoza_province_bulk.ArgentinaMendozaProvinceBulk(*args, **kwargs)[source]¶

Domain: Gobierno de la Provincia de Mendoza
Bulk download documentation: https://datosabiertos-compras.mendoza.gov.ar/datasets/

scrapy crawl argentina_mendoza_province_bulk

Armenia¶

class kingfisher_scrapy.spiders.armenia.Armenia(*args, **kwargs)[source]¶

Domain: Armenian e-Procurement System (ARMEPS)
Caveats: The API paginates results using an offset query string parameter, which is a timestamp. If a timestamp causes an error, the spider will try to find the nearest timestamp within the following 1024 days that succeeds.

scrapy crawl armenia

Australia¶

class kingfisher_scrapy.spiders.australia.Australia(*args, **kwargs)[source]¶

Domain

AusTender

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format). Defaults to ‘2004-01-01T00:00:00’.
until_date: Download only data until this time (YYYY-MM-DDThh:mm:ss format). Defaults to now.

API documentation

https://github.com/austender/austender-ocds-api

Swagger API documentation

https://app.swaggerhub.com/apis/austender/ocds-api/1.1

scrapy crawl australia

Austria¶

class kingfisher_scrapy.spiders.austria_digiwhist.AustriaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl austria_digiwhist

Belgium¶

class kingfisher_scrapy.spiders.belgium_digiwhist.BelgiumDigiwhist(*args, **kwargs)[source]¶

scrapy crawl belgium_digiwhist

Brazil¶

class kingfisher_scrapy.spiders.brazil_compras.BrazilCompras(*args, **kwargs)[source]¶

Domain

Portal de Compras do Governo Federal

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). Defaults to ‘2021-08-10’.
until_date: Download only data until this date (YYYY-MM-DD format). Defaults to today.

API documentation

https://dadosabertos.compras.gov.br/swagger-ui/index.html#/11%20-%20OCDS/releases

scrapy crawl brazil_compras

class kingfisher_scrapy.spiders.brazil_medicamentos_transparentes.BrazilMedicamentosTransparentes(*args, **kwargs)[source]¶

Domain: Medicamentos Transparentes by Transparência Brasil
API documentation: https://medicamentos-api.transparencia.org.br/docs#/DadosAbertos
Bulk download documentation: https://medicamentos.transparencia.org.br/dados-abertos

scrapy crawl brazil_medicamentos_transparentes

Bulgaria¶

class kingfisher_scrapy.spiders.bulgaria.Bulgaria(*args, **kwargs)[source]¶

Domain: Public Procurement Agency (PPA)
Caveats: Access to the publication is geo-restricted to Bulgarian IP addresses. Use a VPN to access it from outside.
API documentation: https://data.egov.bg/api-spetsifikatsiya?section=22&item=82

scrapy crawl bulgaria

class kingfisher_scrapy.spiders.bulgaria_digiwhist.BulgariaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl bulgaria_digiwhist

Canada¶

class kingfisher_scrapy.spiders.canada_buyandsell.CanadaBuyandsell(*args, **kwargs)[source]¶

Domain: Public Works and Government Services Canada
Caveats: The dataset is a pilot that ended in 2017.
API documentation: https://open.canada.ca/data/en/dataset/60f22648-c173-446f-aa8a-4929d75d63e3

scrapy crawl canada_buyandsell

class kingfisher_scrapy.spiders.canada_quebec.CanadaQuebec(*args, **kwargs)[source]¶

Domain

Secrétariat du Conseil du trésor

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). If until_date is provided, defaults to ‘2021-03-01’.
until_date: Download only data until this date (YYYY-MM-DD format). If from_date is provided, defaults to today.

Bulk download documentation

https://www.donneesquebec.ca/recherche/dataset/systeme-electronique-dappel-doffres-seao

scrapy crawl canada_quebec

Chile¶

class kingfisher_scrapy.spiders.chile_compra_api_records.ChileCompraAPIRecords(*args, **kwargs)[source]¶

Domain

ChileCompra

Caveats

The API is slow and can take months to download all the data it offers.

Spider arguments

from_date

Download only data from this month onward (YYYY-MM format). Defaults to ‘2022-01’.

until_date

Download only data until this month (YYYY-MM format). Defaults to the current month.

system

Filter by system, if not set gets all:

convenio: Framework agreements only
trato-directo: Direct tenders only
licitacion: Traditional tenders

Swagger API documentation

https://datos-abiertos.chilecompra.cl/descargas/procesos-ocds

scrapy crawl chile_compra_api_records

class kingfisher_scrapy.spiders.chile_compra_api_releases.ChileCompraAPIReleases(*args, **kwargs)[source]¶

Domain

ChileCompra

Caveats

The API is slow and can take months to download all the data it offers.

Spider arguments

from_date

Download only data from this month onward (YYYY-MM format). Defaults to ‘2022-01’.

until_date

Download only data until this month (YYYY-MM format). Defaults to the current month.

system

Filter by system, if not set gets all:

convenio: Framework agreements only
trato-directo: Direct tenders only
licitacion: Traditional tenders

Swagger API documentation

https://datos-abiertos.chilecompra.cl/descargas/procesos-ocds

scrapy crawl chile_compra_api_releases

class kingfisher_scrapy.spiders.chile_compra_bulk.ChileCompraBulk(*args, **kwargs)[source]¶

Domain

ChileCompra

Caveats

This dataset was last updated by the publisher in 2022.

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). Defaults to ‘2009-01’.
until_date: Download only data until this month (YYYY-MM format). Defaults to the current month.

Bulk download documentation

https://desarrolladores.mercadopublico.cl/OCDS/DescargaMasiva

scrapy crawl chile_compra_bulk

Colombia¶

class kingfisher_scrapy.spiders.colombia_ani_records.ColombiaANIRecords(*args, **kwargs)[source]¶

Domain

Agencia Nacional de Infraestructura (ANI)

Caveats

This dataset was last updated by the publisher in 2021.

Bulk download documentation

https://aniscopio.ani.gov.co/datos-abiertos

API endpoints

Get all records

Link: https://apicost.azurewebsites.net/cost/records

scrapy crawl colombia_ani_records

Costa Rica¶

class kingfisher_scrapy.spiders.costa_rica_poder_judicial_records.CostaRicaPoderJudicialRecords(*args, **kwargs)[source]¶

Domain

Poder Judicial de Costa Rica

Spider arguments

from_date: Download only data from this year onward (YYYY format). If until_date is provided, defaults to ‘2018’.
until_date: Download only data until this year (YYYY format). If from_date is provided, defaults to the current year.

Bulk download documentation

https://ckanpj.azurewebsites.net/dataset/estandar-de-datos-de-contrataciones-abiertas-ocds

scrapy crawl costa_rica_poder_judicial_records

class kingfisher_scrapy.spiders.costa_rica_poder_judicial_releases.CostaRicaPoderJudicialReleases(*args, **kwargs)[source]¶

Domain: Poder Judicial de Costa Rica
Bulk download documentation: https://ckanpj.azurewebsites.net/dataset/estandar-de-datos-de-contrataciones-abiertas-ocds

scrapy crawl costa_rica_poder_judicial_releases

Croatia¶

class kingfisher_scrapy.spiders.croatia.Croatia(*args, **kwargs)[source]¶

Domain: Elektronički oglasnik javne nabave (Electronic public procurement notices)
Bulk download documentation: https://eojn.nn.hr/SPIN/application/ipn/Oglasnik/PreuzimanjeUgovoraOCD.aspx

scrapy crawl croatia

class kingfisher_scrapy.spiders.croatia_digiwhist.CroatiaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl croatia_digiwhist

Cyprus¶

class kingfisher_scrapy.spiders.cyprus_digiwhist.CyprusDigiwhist(*args, **kwargs)[source]¶

scrapy crawl cyprus_digiwhist

Czech Republic¶

class kingfisher_scrapy.spiders.czech_republic_digiwhist.CzechRepublicDigiwhist(*args, **kwargs)[source]¶

scrapy crawl czech_republic_digiwhist

Denmark¶

class kingfisher_scrapy.spiders.denmark_digiwhist.DenmarkDigiwhist(*args, **kwargs)[source]¶

scrapy crawl denmark_digiwhist

Dominican Republic¶

class kingfisher_scrapy.spiders.dominican_republic_api.DominicanRepublicAPI(*args, **kwargs)[source]¶

Domain

Dirección General de Contrataciones Públicas (DGCP)

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). Defaults to ‘2015-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). Defaults to today.

Swagger API documentation

https://datosabiertos.dgcp.gob.do/api-dgcp/docs/index.html

scrapy crawl dominican_republic_api

Ecuador¶

class kingfisher_scrapy.spiders.ecuador_sercop_api.EcuadorSERCOPAPI(*args, **kwargs)[source]¶

Domain

Servicio Nacional de Contratación Pública (SERCOP)

Caveats

The publication times out from many countries. It is known to work from: Chile, Colombia, Ecuador, Mexico, Paraguay, and the United States of America.

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2015’.
until_date: Download only data until this year (YYYY format). Defaults to the current year.

API documentation

https://datosabiertos.compraspublicas.gob.ec/PLATAFORMA/datos-abiertos/api

Bulk download documentation

https://datosabiertos.compraspublicas.gob.ec/PLATAFORMA/datos-abiertos

scrapy crawl ecuador_sercop_api

class kingfisher_scrapy.spiders.ecuador_sercop_bulk.EcuadorSERCOPBulk(*args, **kwargs)[source]¶

Domain

Servicio Nacional de Contratación Pública (SERCOP)

Caveats

The publication times out from many countries. It is known to work from: Chile, Colombia, Ecuador, Mexico, Paraguay, and the United States of America.

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). Defaults to ‘2015-01’.
until_date: Download only data until this month (YYYY-MM format). Defaults to the current month.

API documentation

https://datosabiertos.compraspublicas.gob.ec/PLATAFORMA/datos-abiertos/api

Bulk download documentation

https://datosabiertos.compraspublicas.gob.ec/PLATAFORMA/datos-abiertos

scrapy crawl ecuador_sercop_bulk

Estonia¶

class kingfisher_scrapy.spiders.estonia_digiwhist.EstoniaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl estonia_digiwhist

Europe¶

class kingfisher_scrapy.spiders.europe_eu_digiwhist.EuropeEUDigiwhist(*args, **kwargs)[source]¶

scrapy crawl europe_eu_digiwhist

class kingfisher_scrapy.spiders.europe_ted_digiwhist.EuropeTEDDigiwhist(*args, **kwargs)[source]¶

scrapy crawl europe_ted_digiwhist

Finland¶

class kingfisher_scrapy.spiders.finland_digiwhist.FinlandDigiwhist(*args, **kwargs)[source]¶

scrapy crawl finland_digiwhist

France¶

class kingfisher_scrapy.spiders.france.France(*args, **kwargs)[source]¶

Domain: Ministère de l’Économie, des Finances et de l’Industrie
Swagger API documentation: https://doc.data.gouv.fr/api/reference/

scrapy crawl france

class kingfisher_scrapy.spiders.france_digiwhist.FranceDigiwhist(*args, **kwargs)[source]¶

scrapy crawl france_digiwhist

Georgia¶

class kingfisher_scrapy.spiders.georgia_digiwhist.GeorgiaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl georgia_digiwhist

class kingfisher_scrapy.spiders.georgia_opendata.GeorgiaOpendata(*args, **kwargs)[source]¶

Domain: State Procurement Agency (SPA)

scrapy crawl georgia_opendata

class kingfisher_scrapy.spiders.georgia_records.GeorgiaRecords(*args, **kwargs)[source]¶

Domain: State Procurement Agency (SPA)
Caveats: This dataset was last updated by the publisher in 2020.
Bulk download documentation: https://odapi.spa.ge/publication-policy
Swagger API documentation: https://odapi.spa.ge/api/swagger.ui

scrapy crawl georgia_records

class kingfisher_scrapy.spiders.georgia_releases.GeorgiaReleases(*args, **kwargs)[source]¶

Domain: State Procurement Agency (SPA)
Caveats: This dataset was last updated by the publisher in 2020.
Bulk download documentation: https://odapi.spa.ge/publication-policy
Swagger API documentation: https://odapi.spa.ge/api/swagger.ui

scrapy crawl georgia_releases

Germany¶

class kingfisher_scrapy.spiders.germany.Germany(*args, **kwargs)[source]¶

Domain

Bekanntmachungsservice - Procurement Office of the Federal Ministry of the Interior (BMI)

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). Defaults to ‘2022-12’.
until_date: Download only data until this month (YYYY-MM format). Defaults to the current month.

Swagger API documentation

https://www.oeffentlichevergabe.de/documentation/swagger-ui/opendata/index.html

scrapy crawl germany

class kingfisher_scrapy.spiders.germany_digiwhist.GermanyDigiwhist(*args, **kwargs)[source]¶

scrapy crawl germany_digiwhist

Ghana¶

class kingfisher_scrapy.spiders.ghana.Ghana(*args, **kwargs)[source]¶

Domain

Ghana Electronic Procurement System (GHANEPS)

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). If until_date is provided, defaults to ‘2019-07’.
until_date: Download only data until this month (YYYY-MM format). If from_date is provided, defaults to the current month.

scrapy crawl ghana

Greece¶

class kingfisher_scrapy.spiders.greece_digiwhist.GreeceDigiwhist(*args, **kwargs)[source]¶

scrapy crawl greece_digiwhist

Guatemala¶

class kingfisher_scrapy.spiders.guatemala_bulk.GuatemalaBulk(*args, **kwargs)[source]¶

Domain

Ministerio de Finanzas Públicas - Dirección General de Adquisiciones del Estado

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). If until_date is provided, defaults to ‘2020-01’.
until_date: Download only data until this month (YYYY-MM format). If from_date is provided, defaults to the current month.

API documentation

https://ocds.guatecompras.gt/api-ocds

Bulk download documentation

https://ocds.guatecompras.gt/descarga-datos

scrapy crawl guatemala_bulk

Honduras¶

class kingfisher_scrapy.spiders.honduras_iaip.HondurasIAIP(*args, **kwargs)[source]¶

Domain

Instituto de Acceso a la Información Publica (IAIP)

Spider arguments

portal

Filter by portal:

covid19
IAIP Emergencia Covid-19

huracanes
Emergencia Huracán ETA

oficio
Portal Único de Transparencia

Bulk download documentation

https://portalunico.iaip.gob.hn/datosabierto/

scrapy crawl honduras_iaip

class kingfisher_scrapy.spiders.honduras_oncae.HondurasONCAE(*args, **kwargs)[source]¶

Domain

Oficina Normativa de Contratación y Adquisiciones del Estado (ONCAE)

Spider arguments

from_date

Download only data from this year onward (YYYY format). Defaults to ‘2005’.

until_date

Download only data until this year (YYYY format). Defaults to the current year.

system

Filter by system:

CE: Catálogo Electrónico
DDC: Módulo de Difusión Directa de Contratos
HC1: HonduCompras 1.0 (Módulo de Difusión de Compras y Contrataciones)

Bulk download documentation

https://oncae.gob.hn/datos-abiertos/

scrapy crawl honduras_oncae

class kingfisher_scrapy.spiders.honduras_portal_api_records.HondurasPortalAPIRecords(*args, **kwargs)[source]¶

Domain

Oficina Normativa de Contratación y Adquisiciones del Estado (ONCAE) / Secretaria de Finanzas de Honduras (SEFIN)

Caveats

Cloudflare responds with HTTP 502 on deep pages (like page 5000).

Spider arguments

publisher

Filter by publisher:

oncae: Oficina Normativa de Contratación y Adquisiciones del Estado
sefin: Secretaria de Finanzas de Honduras

API documentation

http://www.contratacionesabiertas.gob.hn/manual_api/

Swagger API documentation

http://www.contratacionesabiertas.gob.hn/servicio/

scrapy crawl honduras_portal_api_records

class kingfisher_scrapy.spiders.honduras_portal_api_releases.HondurasPortalAPIReleases(*args, **kwargs)[source]¶

Domain

Oficina Normativa de Contratación y Adquisiciones del Estado (ONCAE) / Secretaria de Finanzas de Honduras (SEFIN)

Caveats

Cloudflare responds with HTTP 502 on deep pages (like page 5000).

Spider arguments

publisher

Filter by publisher:

oncae: Oficina Normativa de Contratación y Adquisiciones del Estado
sefin: Secretaria de Finanzas de Honduras

API documentation

http://www.contratacionesabiertas.gob.hn/manual_api/

Swagger API documentation

http://www.contratacionesabiertas.gob.hn/servicio/

scrapy crawl honduras_portal_api_releases

class kingfisher_scrapy.spiders.honduras_portal_bulk.HondurasPortalBulk(*args, **kwargs)[source]¶

Domain

Oficina Normativa de Contratación y Adquisiciones del Estado (ONCAE) / Secretaria de Finanzas de Honduras (SEFIN)

Spider arguments

from_date

Download only data from this month onward (YYYY-MM format). If until_date is provided, defaults to ‘2005-11’.

until_date

Download only data until this month (YYYY-MM format). If from_date is provided, defaults to the current month.

publisher

Filter by publisher:

oncae: Oficina Normativa de Contratación y Adquisiciones del Estado
sefin: Secretaria de Finanzas de Honduras

system

Filter by oncae system:

CE: Catálogo Electrónico
DDC: Módulo de Difusión Directa de Contratos
HC1: HonduCompras 1.0 (Módulo de Difusión de Compras y Contrataciones)

Bulk download documentation

http://www.contratacionesabiertas.gob.hn/descargas/

scrapy crawl honduras_portal_bulk

class kingfisher_scrapy.spiders.honduras_sefin_api.HondurasSEFINAPI(*args, **kwargs)[source]¶

Domain

Secretaria de Finanzas de Honduras (SEFIN)

Caveats

The API returns HTTP 500 errors for 2012-2018 data. Use honduras_sefin_bulk for that range.

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2019’.
until_date: Download only data until this year (YYYY format). Defaults to the current year.

Bulk download documentation

https://www.sefin.gob.hn/edca/

Swagger API documentation

https://guancasco.sefin.gob.hn/EDCA_WEBAPI/swagger/ui/index

scrapy crawl honduras_sefin_api

class kingfisher_scrapy.spiders.honduras_sefin_bulk.HondurasSEFINBulk(*args, **kwargs)[source]¶

Domain

Secretaria de Finanzas de Honduras (SEFIN)

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2012’.
until_date: Download only data until this year (YYYY format). Defaults to the current year.

Bulk download documentation

https://www.sefin.gob.hn/edca/

Swagger API documentation

https://guancasco.sefin.gob.hn/EDCA_WEBAPI/swagger/ui/index

scrapy crawl honduras_sefin_bulk

Hungary¶

class kingfisher_scrapy.spiders.hungary_digiwhist.HungaryDigiwhist(*args, **kwargs)[source]¶

scrapy crawl hungary_digiwhist

Iceland¶

class kingfisher_scrapy.spiders.iceland_digiwhist.IcelandDigiwhist(*args, **kwargs)[source]¶

scrapy crawl iceland_digiwhist

India¶

class kingfisher_scrapy.spiders.india_assam_civic_data_lab.IndiaAssamCivicDataLab(*args, **kwargs)[source]¶

Domain: Assam State Government Finance Department
Caveats: The archived file contains a __MACOSX directory with a temporary ._package.json file that is omitted.
Bulk download documentation: https://github.com/CivicDataLab/assam-tenders-data/tree/main/data

scrapy crawl india_assam_civic_data_lab

class kingfisher_scrapy.spiders.india_himachal_pradesh_civic_data_lab.IndiaHimachalPradeshCivicDataLab(*args, **kwargs)[source]¶

Domain: Himachal Pradesh State Government Finance Department
Caveats: This dataset was last updated by the publisher in 2020.
Bulk download documentation: https://github.com/CivicDataLab/himachal-pradesh-health-procurement-OCDS/

scrapy crawl india_himachal_pradesh_civic_data_lab

Indonesia¶

class kingfisher_scrapy.spiders.indonesia_opentender.IndonesiaOpentender(*args, **kwargs)[source]¶

Domain

Opentender.net

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2008’.
until_date: Download only data until this year (YYYY format). Defaults to the current year.

Bulk download documentation

https://v3.opentender.net/#/ocds

scrapy crawl indonesia_opentender

Ireland¶

class kingfisher_scrapy.spiders.ireland_digiwhist.IrelandDigiwhist(*args, **kwargs)[source]¶

scrapy crawl ireland_digiwhist

Italy¶

class kingfisher_scrapy.spiders.italy_anac.ItalyANAC(*args, **kwargs)[source]¶

Domain

Autorità Nazionale Anticorruzione (ANAC)

Caveats

If the OCID is missing, the spider derives the ocid field from the id field.

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). If until_date is provided, defaults to ‘2018-01’.
until_date: Download only data until this month (YYYY-MM format). If from_date is provided, defaults to the current month.

API documentation

https://dati.anticorruzione.it/opendata/about

Bulk download documentation

https://dati.anticorruzione.it/opendata/organization/anticorruzione

scrapy crawl italy_anac

class kingfisher_scrapy.spiders.italy_digiwhist.ItalyDigiwhist(*args, **kwargs)[source]¶

scrapy crawl italy_digiwhist

Kenya¶

class kingfisher_scrapy.spiders.kenya_ppra.KenyaPPRA(*args, **kwargs)[source]¶

Domain: Public Procurement Regulation Authority (PPRA)
Bulk download documentation: https://tenders.go.ke/ocds

scrapy crawl kenya_ppra

Kosovo¶

class kingfisher_scrapy.spiders.kosovo.Kosovo(*args, **kwargs)[source]¶

Domain

Public Procurement Regulatory Commission (PPRC)

Spider arguments

from_date: Download only data with a tender period end date from this time onward (YYYY-MM-DD format). Defaults to ‘2000-01-01’.
until_date: Download only data with a tender period end date until this time (YYYY-MM-DD format). Defaults to now. Note: This date is non-inclusive.

API documentation

https://ocdskrpp.rks-gov.net/Help

scrapy crawl kosovo

Latvia¶

class kingfisher_scrapy.spiders.latvia_digiwhist.LatviaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl latvia_digiwhist

Liberia¶

class kingfisher_scrapy.spiders.liberia_records.LiberiaRecords(*args, **kwargs)[source]¶

Domain

Public Procurement and Concessions Commission (PPCC)

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). If until_date is provided, defaults to ‘2024-11’.
until_date: Download only data until this month (YYYY-MM format). If from_date is provided, defaults to the current month.

Bulk download documentation

https://eprocurement.ppcc.gov.lr/ocds/report/home.action#/recordPackages

scrapy crawl liberia_records

class kingfisher_scrapy.spiders.liberia_releases.LiberiaReleases(*args, **kwargs)[source]¶

Domain: Public Procurement and Concessions Commission (PPCC)
Bulk download documentation: https://eprocurement.ppcc.gov.lr/ocds/report/home.action#/record

scrapy crawl liberia_releases

Lithuania¶

class kingfisher_scrapy.spiders.lithuania_digiwhist.LithuaniaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl lithuania_digiwhist

Luxembourg¶

class kingfisher_scrapy.spiders.luxembourg_digiwhist.LuxembourgDigiwhist(*args, **kwargs)[source]¶

scrapy crawl luxembourg_digiwhist

Malta¶

class kingfisher_scrapy.spiders.malta.Malta(*args, **kwargs)[source]¶

Domain

Electronic Public Procurement System (e-PPS)

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). If until_date is provided, defaults to ‘2019-10’.
until_date: Download only data until this month (YYYY-MM format). If from_date is provided, defaults to the current month.

API documentation

https://docs.google.com/document/d/1rV_1VoJT3StzMk2Pf0i2-9uN3lD_VjhFQKyfaGUXZ6I/edit

scrapy crawl malta

class kingfisher_scrapy.spiders.malta_digiwhist.MaltaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl malta_digiwhist

Mexico¶

class kingfisher_scrapy.spiders.mexico_aguascalientes_plataforma_digital_estatal.MexicoAguascalientesPlataformaDigitalEstatal(*args, **kwargs)[source]¶

Domain: Mexico Aguascalientes Plataforma Digital Estatal
Bulk download documentation: https://plataformadigitalestatal.org/Publica/contratacionesPublicas/index.html

scrapy crawl mexico_aguascalientes_plataforma_digital_estatal

class kingfisher_scrapy.spiders.mexico_aguascalientes_sesea_plataforma_digital_nacional.MexicoAguascalientesSESEAPlataformaDigitalNacional(*args, **kwargs)[source]¶

Domain: Secretaría Ejecutiva del Sistema Estatal Anticorrupción de Aguascalientes (SESEA) - Plataforma Digital Nacional
Bulk download documentation: https://plataformadigitalnacional.org/contrataciones

scrapy crawl mexico_aguascalientes_sesea_plataforma_digital_nacional

class kingfisher_scrapy.spiders.mexico_guadalajara.MexicoGuadalajara(*args, **kwargs)[source]¶

Domain

Municipio de Guadalajara

Caveats

This dataset was last updated by the publisher in 2025.

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2022’.
until_date: Download only data until this year (YYYY format). Defaults to the current year.

API documentation

https://contratacionesabiertas.guadalajara.gob.mx:4000/contratacionesabiertas/datosabiertos

scrapy crawl mexico_guadalajara

class kingfisher_scrapy.spiders.mexico_mexico_city_infocdmx.MexicoMexicoCityINFOCDMX(*args, **kwargs)[source]¶

Domain

Instituto de Transparencia, Acceso a la Información Pública, Protección de Datos Personales y Rendición de Cuentas de la Ciudad de México (INFOCDMX)

Spider arguments

from_date: Download only data from this year onward (YYYY format). If until_date is provided, defaults to ‘2019’.
until_date: Download only data until this year (YYYY format). If from_date is provided, defaults to the current year.

API documentation

https://dashboard.infocdmx.org.mx/contratacionesabiertas/datosabiertos

scrapy crawl mexico_mexico_city_infocdmx

class kingfisher_scrapy.spiders.mexico_mexico_state_sesaemm_plataforma_digital_nacional.MexicoMexicoStateSESAEMMPlataformaDigitalNacional(*args, **kwargs)[source]¶

Domain: Secretaría Ejecutiva del Sistema Estatal Anticorrupción del Estado de México y Municipios (SESAEMM) (Mexico) - Plataforma Digital Nacional
Bulk download documentation: https://plataformadigitalnacional.org/contrataciones

scrapy crawl mexico_mexico_state_sesaemm_plataforma_digital_nacional

class kingfisher_scrapy.spiders.mexico_michoacan_sesea_plataforma_digital_nacional.MexicoMichoacanSESEAPlataformaDigitalNacional(*args, **kwargs)[source]¶

Domain: Secretaría Ejecutiva del Sistema Estatal Anticorrupción del Estado de Michoacán (SESEA) (Mexico) - Plataforma Digital Nacional
Bulk download documentation: https://plataformadigitalnacional.org/contrataciones

scrapy crawl mexico_michoacan_sesea_plataforma_digital_nacional

class kingfisher_scrapy.spiders.mexico_nuevo_leon.MexicoNuevoLeon(*args, **kwargs)[source]¶

Domain

Nuevo León - Dirección General de Adquisiciones y Servicios - Secretaría de Administración

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). If until_date is provided, defaults to ‘2024-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). If from_date is provided, defaults to today.

Bulk download documentation

https://catalogodatos.nl.gob.mx/dataset/contrataciones-abiertas-direccion-general-de-adquisiciones-y-servicios

scrapy crawl mexico_nuevo_leon

class kingfisher_scrapy.spiders.mexico_nuevo_leon_infra_abierta_records.MexicoNuevoLeonInfraAbiertaRecords(*args, **kwargs)[source]¶

Domain

Secretaría de Movilidad y Planeación Urbana de Nuevo León

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2013’.
until_date: Download only data until this year (YYYY format). Defaults to the current year.

Bulk download documentation

https://smpu.nl.gob.mx/transparencia/publicaciones

scrapy crawl mexico_nuevo_leon_infra_abierta_records

class kingfisher_scrapy.spiders.mexico_nuevo_leon_infra_abierta_releases.MexicoNuevoLeonInfraAbiertaReleases(*args, **kwargs)[source]¶

Domain

Secretaría de Movilidad y Planeación Urbana de Nuevo León

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2013’.
until_date: Download only data until this year (YYYY format). Defaults to the current year.

Bulk download documentation

https://smpu.nl.gob.mx/transparencia/acerca-del-proyecto

scrapy crawl mexico_nuevo_leon_infra_abierta_releases

class kingfisher_scrapy.spiders.mexico_puebla_state_seseap_plataforma_digital_nacional.MexicoPueblaStateSESEAPPlataformaDigitalNacional(*args, **kwargs)[source]¶

Domain: Secretaría Ejecutiva del Sistema Estatal Anticorrupción del Estado de Puebla (SESEAP) (Mexico) - Plataforma Digital Nacional
Bulk download documentation: https://plataformadigitalnacional.org/contrataciones

scrapy crawl mexico_puebla_state_seseap_plataforma_digital_nacional

class kingfisher_scrapy.spiders.mexico_quien_es_quien_releases.MexicoQuienEsQuienReleases(*args, **kwargs)[source]¶

Domain

QuiénEsQuién.Wiki

Caveats

This dataset was last updated by the publisher in 2021.

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). Defaults to ‘1999-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). Defaults to ‘2021-12-31’.

API documentation

https://qqwapi-elastic.readthedocs.io/es/latest/

Swagger API documentation

https://api.quienesquien.wiki/v3/docs/

scrapy crawl mexico_quien_es_quien_releases

class kingfisher_scrapy.spiders.mexico_quintana_roo_sesaeqroo_plataforma_digital_nacional.MexicoQuintanaRooSESAEQROOPlataformaDigitalNacional(*args, **kwargs)[source]¶

Domain: Secretaría Ejecutiva del Sistema Anticorrupción del Estado de Quintana Roo (SESAEQROO) (Mexico) - Plataforma Digital Nacional
Bulk download documentation: https://plataformadigitalnacional.org/contrataciones

scrapy crawl mexico_quintana_roo_sesaeqroo_plataforma_digital_nacional

class kingfisher_scrapy.spiders.mexico_shcp_plataforma_digital_nacional.MexicoSHCPPlataformaDigitalNacional(*args, **kwargs)[source]¶

Domain: Secretaría de Hacienda y Crédito Público (SHCP) (Mexico) - Plataforma Digital Nacional
Bulk download documentation: https://plataformadigitalnacional.org/contrataciones

scrapy crawl mexico_shcp_plataforma_digital_nacional

class kingfisher_scrapy.spiders.mexico_veracruz_state_sesea_plataforma_digital_nacional.MexicoVeracruzStateSESEAPlataformaDigitalNacional(*args, **kwargs)[source]¶

Domain: Secretaría Ejecutiva del Sistema Estatal Anticorrupción de Veracruz de Ignacio de la Llave (SESEA) (Mexico) - Plataforma Digital Nacional
Bulk download documentation: https://plataformadigitalnacional.org/contrataciones

scrapy crawl mexico_veracruz_state_sesea_plataforma_digital_nacional

class kingfisher_scrapy.spiders.mexico_yucatan_inaip.MexicoYucatanINAIP(*args, **kwargs)[source]¶

Domain

Instituto Estatal de Transparencia, Acceso a la Información Pública y Protección de Datos Personales (INAIP) - Yucatán

Spider arguments

from_date: Download only data from this year onward (YYYY format). If until_date is provided, defaults to ‘2020’.
until_date: Download only data until this year (YYYY format). If from_date is provided, defaults to the current year.

API documentation

https://contratacionesabiertas.inaipyucatan.org.mx/contratacionesabiertas/datosabiertos#

scrapy crawl mexico_yucatan_inaip

Moldova¶

class kingfisher_scrapy.spiders.moldova_multi_record.MoldovaMultiRecord(*args, **kwargs)[source]¶

Domain

MTender

Caveats

The https://public.mtender.gov.md/tenders/{ocid} endpoint returns a record package in which each record has a different ocid value (as expected), but these actually represent the same contracting process (not expected). To fix this, we reformat the record package as a release package, using each record’s compiledRelease as an individual release, and replacing the release’s ocid value with the OCID from the URL.

The compliant OCDS endpoint http://public.eprocurement.systems/ocds/tenders/{ocid} returns error messages.

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format).

scrapy crawl moldova_multi_record

Nepal¶

class kingfisher_scrapy.spiders.nepal_dhangadhi.NepalDhangadhi(*args, **kwargs)[source]¶

Domain: Infrastructure Management System (IMS)
Caveats: Some downloads require a login.
Bulk download documentation: https://ims.susasan.org/dhangadhi/about

scrapy crawl nepal_dhangadhi

Netherlands¶

class kingfisher_scrapy.spiders.netherlands.Netherlands(*args, **kwargs)[source]¶

Domain

TenderNed

Spider arguments

from_date: Download only data from this year onward (YYYY format). If until_date is provided, defaults to ‘2016’.
until_date: Download only data until this year (YYYY format). If from_date is provided, defaults to the current year.

Bulk download documentation

https://www.tenderned.nl/cms/nl/aanbesteden-in-cijfers/datasets-aanbestedingen

scrapy crawl netherlands

class kingfisher_scrapy.spiders.netherlands_digiwhist.NetherlandsDigiwhist(*args, **kwargs)[source]¶

scrapy crawl netherlands_digiwhist

Nigeria¶

class kingfisher_scrapy.spiders.nigeria_anambra_state.NigeriaAnambraState(*args, **kwargs)[source]¶

Domain: Anambra State e-Procurement Portal
API documentation: https://eprocure.bpp.an.gov.ng/awarded_contracts.php

scrapy crawl nigeria_anambra_state

class kingfisher_scrapy.spiders.nigeria_ebonyi_state.NigeriaEbonyiState(*args, **kwargs)[source]¶

Domain

Ebonyi State e-Procurement System

Caveats

The JSON data sometimes contains unescaped tab characters within strings.

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2018’.
until_date: Download only data until this year (YYYY format). Defaults to the current year.

Bulk download documentation

https://ebonyieprocure.eb.gov.ng/ocds_report.php

scrapy crawl nigeria_ebonyi_state

class kingfisher_scrapy.spiders.nigeria_ekiti_state.NigeriaEkitiState(*args, **kwargs)[source]¶

Domain: Ekiti State Open Contracting Portal

scrapy crawl nigeria_ekiti_state

class kingfisher_scrapy.spiders.nigeria_osun_state.NigeriaOsunState(*args, **kwargs)[source]¶

Domain: Osun State e-Procurement System
Bulk download documentation: https://egp.osunstate.gov.ng/awarded_contracts.php

scrapy crawl nigeria_osun_state

class kingfisher_scrapy.spiders.nigeria_plateau_state.NigeriaPlateauState(*args, **kwargs)[source]¶

Domain: Plateau State Open Contracting Portal
Bulk download documentation: https://plateaustatebpp.com/ocds

scrapy crawl nigeria_plateau_state

class kingfisher_scrapy.spiders.nigeria_portal.NigeriaPortal(*args, **kwargs)[source]¶

Domain: Nigeria Open Contracting Portal (NOCOPO) - Bureau of Public Procurement (BPP)
Bulk download documentation: https://nocopo.bpp.gov.ng/Open-Data

scrapy crawl nigeria_portal

North Macedonia¶

class kingfisher_scrapy.spiders.north_macedonia_digiwhist.NorthMacedoniaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl north_macedonia_digiwhist

Norway¶

class kingfisher_scrapy.spiders.norway_digiwhist.NorwayDigiwhist(*args, **kwargs)[source]¶

scrapy crawl norway_digiwhist

Paraguay¶

class kingfisher_scrapy.spiders.paraguay_dncp_records.ParaguayDNCPRecords(*args, **kwargs)[source]¶

Domain

Dirección Nacional de Contrataciones Públicas (DNCP)

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format). Defaults to ‘2010-01-01T00:00:00’.
until_date: Download only data until this time (YYYY-MM-DDThh:mm:ss format). Defaults to now.

Environment variables

KINGFISHER_PARAGUAY_DNCP_REQUEST_TOKEN: To get an API account and request token go to https://contrataciones.gov.py/datos/adm/login.

Swagger API documentation

https://contrataciones.gov.py/datos/api/v3/doc

env KINGFISHER_PARAGUAY_DNCP_REQUEST_TOKEN=... scrapy crawl paraguay_dncp_records

class kingfisher_scrapy.spiders.paraguay_dncp_releases.ParaguayDNCPReleases(*args, **kwargs)[source]¶

Domain

Dirección Nacional de Contrataciones Públicas (DNCP)

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format). Defaults to ‘2010-01-01T00:00:00’.
until_date: Download only data until this time (YYYY-MM-DDThh:mm:ss format). Defaults to now.

Environment variables

KINGFISHER_PARAGUAY_DNCP_REQUEST_TOKEN: To get an API account and request token go to https://contrataciones.gov.py/datos/adm/login.

Swagger API documentation

https://contrataciones.gov.py/datos/api/v3/doc

env KINGFISHER_PARAGUAY_DNCP_REQUEST_TOKEN=... scrapy crawl paraguay_dncp_releases

class kingfisher_scrapy.spiders.paraguay_hacienda.ParaguayHacienda(*args, **kwargs)[source]¶

Domain

Ministerio de Hacienda

Caveats

This dataset was last updated by the publisher in 2018.

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2011’.
until_date: Download only data until this year (YYYY format). Defaults to ‘2018’.

Environment variables

KINGFISHER_PARAGUAY_HACIENDA_REQUEST_TOKEN: To get an API account and request token go to https://datos.hacienda.gov.py/aplicaciones/new.
KINGFISHER_PARAGUAY_HACIENDA_CLIENT_SECRET: Your client secret generated.

Swagger API documentation

https://datos.hacienda.gov.py/odmh-api-v1/api-docs/

env KINGFISHER_PARAGUAY_HACIENDA_REQUEST_TOKEN=... KINGFISHER_PARAGUAY_HACIENDA_CLIENT_SECRET=... scrapy crawl paraguay_hacienda

Peru¶

class kingfisher_scrapy.spiders.peru_compras_api.PeruComprasAPI(*args, **kwargs)[source]¶

Domain

Peru Compras (contracts within framework agreements)

Caveats

The JSON data sometimes contains unescaped newline characters within strings.

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). Defaults to ‘2017-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). Defaults to today.

scrapy crawl peru_compras_api

class kingfisher_scrapy.spiders.peru_compras_bulk.PeruComprasBulk(*args, **kwargs)[source]¶

Domain

Peru Compras (contracts within framework agreements)

Caveats

The JSON data sometimes contains unescaped newline characters within strings. The peru_compras spider contains more updated data.

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). Defaults to ‘2021-08’.
until_date: Download only data until this month (YYYY-MM format). Defaults to the current month.

scrapy crawl peru_compras_bulk

class kingfisher_scrapy.spiders.peru_oece_api_records.PeruOECEAPIRecords(*args, **kwargs)[source]¶

Domain: Organismo Especializado para las Contrataciones Públicas Eficientes (OECE)
API documentation: https://contratacionesabiertas.oece.gob.pe/api

scrapy crawl peru_oece_api_records

class kingfisher_scrapy.spiders.peru_oece_api_releases.PeruOECEAPIReleases(*args, **kwargs)[source]¶

Domain: Organismo Especializado para las Contrataciones Públicas Eficientes (OECE)
API documentation: https://contratacionesabiertas.oece.gob.pe/api

scrapy crawl peru_oece_api_releases

class kingfisher_scrapy.spiders.peru_oece_bulk.PeruOECEBulk(*args, **kwargs)[source]¶

Domain: Organismo Especializado para las Contrataciones Públicas Eficientes (OECE)
API documentation: https://contratacionesabiertas.oece.gob.pe/api
Bulk download documentation: https://contratacionesabiertas.oece.gob.pe/descargas

scrapy crawl peru_oece_bulk

Poland¶

class kingfisher_scrapy.spiders.poland_digiwhist.PolandDigiwhist(*args, **kwargs)[source]¶

scrapy crawl poland_digiwhist

Portugal¶

class kingfisher_scrapy.spiders.portugal_digiwhist.PortugalDigiwhist(*args, **kwargs)[source]¶

scrapy crawl portugal_digiwhist

Romania¶

class kingfisher_scrapy.spiders.romania_digiwhist.RomaniaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl romania_digiwhist

Rwanda¶

class kingfisher_scrapy.spiders.rwanda_api.RwandaAPI(*args, **kwargs)[source]¶

Domain

Rwanda Public Procurement Authority (RPPA)

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). Defaults to ‘2016-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). Defaults to today.

Swagger API documentation

https://ocds.umucyo.gov.rw/opendata/api/docs

scrapy crawl rwanda_api

class kingfisher_scrapy.spiders.rwanda_bulk.RwandaBulk(*args, **kwargs)[source]¶

Domain

Rwanda Public Procurement Authority (RPPA)

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). If until_date is provided, defaults to ‘2013-12’.
until_date: Download only data until this month (YYYY-MM format). If from_date is provided, defaults to the current month.

Bulk download documentation

https://ocds.umucyo.gov.rw/OpenData

scrapy crawl rwanda_bulk

Serbia¶

class kingfisher_scrapy.spiders.serbia_digiwhist.SerbiaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl serbia_digiwhist

Slovakia¶

class kingfisher_scrapy.spiders.slovakia_digiwhist.SlovakiaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl slovakia_digiwhist

Slovenia¶

class kingfisher_scrapy.spiders.slovenia.Slovenia(*args, **kwargs)[source]¶

Domain: Ministry of Public Administration
Bulk download documentation: http://tbfy.ijs.si/?m=tenders&a=list_data&t=si_ocds

scrapy crawl slovenia

class kingfisher_scrapy.spiders.slovenia_digiwhist.SloveniaDigiwhist(*args, **kwargs)[source]¶

scrapy crawl slovenia_digiwhist

South Africa¶

class kingfisher_scrapy.spiders.south_africa_national_treasury_api.SouthAfricaNationalTreasuryAPI(*args, **kwargs)[source]¶

Domain

National Treasury

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). Defaults to ‘2017-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). Defaults to today.

Swagger API documentation

https://ocds-api.etenders.gov.za/swagger/index.html

scrapy crawl south_africa_national_treasury_api

Spain¶

class kingfisher_scrapy.spiders.spain_digiwhist.SpainDigiwhist(*args, **kwargs)[source]¶

scrapy crawl spain_digiwhist

class kingfisher_scrapy.spiders.spain_zaragoza.SpainZaragoza(*args, **kwargs)[source]¶

Domain: Ayuntamiento de Zaragoza
Caveats: The API’s before and after query string parameters have no effect and are therefore not implemented.
Swagger API documentation: https://www.zaragoza.es/docs-api_sede/

scrapy crawl spain_zaragoza

Sweden¶

class kingfisher_scrapy.spiders.sweden_digiwhist.SwedenDigiwhist(*args, **kwargs)[source]¶

scrapy crawl sweden_digiwhist

Switzerland¶

class kingfisher_scrapy.spiders.switzerland_digiwhist.SwitzerlandDigiwhist(*args, **kwargs)[source]¶

scrapy crawl switzerland_digiwhist

Taiwan¶

class kingfisher_scrapy.spiders.taiwan_aac.TaiwanAAC(*args, **kwargs)[source]¶

Domain: Agency Against Corruption, Ministry of Justice, ROC (Taiwan)
Bulk download documentation: https://gpip.aac.moj.gov.tw/cht/index.php?code=list&ids=6&page=1

scrapy crawl taiwan_aac

Tanzania¶

class kingfisher_scrapy.spiders.tanzania_api_records.TanzaniaAPIRecords(*args, **kwargs)[source]¶

Domain: Public Procurement Regulatory Authority (PPRA) NeST Data Portal
API documentation: https://data.nest.go.tz/ocds

scrapy crawl tanzania_api_records

class kingfisher_scrapy.spiders.tanzania_api_releases.TanzaniaAPIReleases(*args, **kwargs)[source]¶

Domain: Public Procurement Regulatory Authority (PPRA) NeST Data Portal
API documentation: https://data.nest.go.tz/ocds

scrapy crawl tanzania_api_releases

class kingfisher_scrapy.spiders.tanzania_bulk_records.TanzaniaBulkRecords(*args, **kwargs)[source]¶

Domain

Public Procurement Regulatory Authority (PPRA) NeST Data Portal

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). If until_date is provided, defaults to ‘2022-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). If from_date is provided, defaults to today.

Bulk download documentation

https://data.nest.go.tz/ocds

scrapy crawl tanzania_bulk_records

class kingfisher_scrapy.spiders.tanzania_bulk_releases.TanzaniaBulkReleases(*args, **kwargs)[source]¶

Domain

Public Procurement Regulatory Authority (PPRA) NeST Data Portal

Spider arguments

from_date: Download only data from this date onward (YYYY-MM-DD format). If until_date is provided, defaults to ‘2022-01-01’.
until_date: Download only data until this date (YYYY-MM-DD format). If from_date is provided, defaults to today.

Bulk download documentation

https://data.nest.go.tz/ocds

scrapy crawl tanzania_bulk_releases

Thailand¶

class kingfisher_scrapy.spiders.thailand_bangkok.ThailandBangkok(*args, **kwargs)[source]¶

Domain

Bangkok Metropolitan Administration (BMA)

Spider arguments

from_date: Download only data from this year onward (YYYY format). Defaults to ‘2023’.
until_date: Download only data until this year (YYYY format). Defaults to the current year.

Bulk download documentation

https://opencontract.bangkok.go.th/ocds.html

scrapy crawl thailand_bangkok

Uganda¶

class kingfisher_scrapy.spiders.uganda_releases.UgandaReleases(*args, **kwargs)[source]¶

Domain

Government Procurement Portal (GPP) - Public Procurement and Disposal of Public Assets Authority (PPDA)

Spider arguments

from_date: Download only data from this year onward (YYYY format). If until_date is provided, defaults to ‘2019’. The year refers to the start of the fiscal year range, e.g. if from_date = ‘2019’ then the fiscal year is ‘2019-2020’
until_date: Download only data until this year (YYYY format). If from_date is provided, defaults to the current year. The year refers to the start of the fiscal year range, e.g. if until_date = ‘2019’ then the fiscal year is ‘2019-2020’

Bulk download documentation

https://gpp.ppda.go.ug/public/open-data/ocds/ocds-datasets

scrapy crawl uganda_releases

Ukraine¶

class kingfisher_scrapy.spiders.ukraine.Ukraine(*args, **kwargs)[source]¶

Domain

ProZorro OpenProcurement API

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format). Defaults to ‘2016-01-01T00:00:00’.

API documentation

https://prozorro-api-docs.readthedocs.io/uk/latest/tendering/index.html

scrapy crawl ukraine

United Kingdom¶

class kingfisher_scrapy.spiders.united_kingdom_contracts_finder_records.UnitedKingdomContractsFinderRecords(*args, **kwargs)[source]¶

Domain

Contracts Finder

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format). Defaults to ‘2014-01-01T00:00:00’.
until_date: Download only data until this time (YYYY-MM-DDThh:mm:ss format). Defaults to now.

API documentation

https://www.contractsfinder.service.gov.uk/apidocumentation/home

scrapy crawl united_kingdom_contracts_finder_records

class kingfisher_scrapy.spiders.united_kingdom_contracts_finder_releases.UnitedKingdomContractsFinderReleases(*args, **kwargs)[source]¶

Domain

Contracts Finder

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format). Defaults to ‘2014-01-01T00:00:00’.
until_date: Download only data until this time (YYYY-MM-DDThh:mm:ss format). Defaults to now.

API documentation

https://www.contractsfinder.service.gov.uk/apidocumentation/home

scrapy crawl united_kingdom_contracts_finder_releases

class kingfisher_scrapy.spiders.united_kingdom_digiwhist.UnitedKingdomDigiwhist(*args, **kwargs)[source]¶

scrapy crawl united_kingdom_digiwhist

class kingfisher_scrapy.spiders.united_kingdom_fts.UnitedKingdomFTS(*args, **kwargs)[source]¶

Domain

Find a Tender Service (FTS)

Spider arguments

from_date: Download only data from this time onward (YYYY-MM-DDThh:mm:ss format). Defaults to ‘2021-01-01T00:00:00’.
until_date: Download only data until this time (YYYY-MM-DDThh:mm:ss format). Defaults to now.

API documentation

https://www.find-tender.service.gov.uk/apidocumentation/1.0/GET-ocdsReleasePackages

scrapy crawl united_kingdom_fts

class kingfisher_scrapy.spiders.united_kingdom_scotland.UnitedKingdomScotland(*args, **kwargs)[source]¶

Domain

Public Contracts Scotland

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). Defaults to ‘2019-01’.
until_date: Download only data until this month (YYYY-MM format). Defaults to the current month.

API documentation

https://api.publiccontractsscotland.gov.uk/v1

Bulk download documentation

https://www.publiccontractsscotland.gov.uk/NoticeDownload/Download.aspx

scrapy crawl united_kingdom_scotland

class kingfisher_scrapy.spiders.united_kingdom_wales.UnitedKingdomWales(*args, **kwargs)[source]¶

Domain

Sell2Wales

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). Defaults to ‘2019-01’.
until_date: Download only data until this month (YYYY-MM format). Defaults to the current month.

API documentation

https://api.sell2wales.gov.wales/v1

Bulk download documentation

https://www.sell2wales.gov.wales/Notice/Download/Download.aspx

scrapy crawl united_kingdom_wales

United States¶

class kingfisher_scrapy.spiders.united_states_portland.UnitedStatesPortland(*args, **kwargs)[source]¶

Domain: City of Portland
Bulk download documentation: https://www.portland.gov/business-opportunities/ocds/ocds-data-publication

scrapy crawl united_states_portland

Uruguay¶

class kingfisher_scrapy.spiders.uruguay_historical.UruguayHistorical(*args, **kwargs)[source]¶

Domain

Agencia Reguladora de Compras Estatales (ARCE)

Spider arguments

from_date: Download only data from this year onward (YYYY format). If until_date is provided, defaults to ‘2002’.
until_date: Download only data until this year (YYYY format). If from_date is provided, defaults to the current year.

Bulk download documentation

https://www.gub.uy/agencia-compras-contrataciones-estado/datos-y-estadisticas/datos/open-contracting

scrapy crawl uruguay_historical

class kingfisher_scrapy.spiders.uruguay_records.UruguayRecords(*args, **kwargs)[source]¶

Domain

Agencia Reguladora de Compras Estatales (ARCE)

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). Defaults to ‘2017-11’.
until_date: Download only data until this month (YYYY-MM format). Defaults to the current month.

API documentation

https://www.gub.uy/agencia-compras-contrataciones-estado/datos-y-estadisticas/datos/open-contracting

scrapy crawl uruguay_records

class kingfisher_scrapy.spiders.uruguay_releases.UruguayReleases(*args, **kwargs)[source]¶

Domain

Agencia Reguladora de Compras Estatales (ARCE)

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). Defaults to ‘2017-11’.
until_date: Download only data until this month (YYYY-MM format). Defaults to the current month.

API documentation

https://www.gub.uy/agencia-compras-contrataciones-estado/datos-y-estadisticas/datos/open-contracting

scrapy crawl uruguay_releases

Zambia¶

class kingfisher_scrapy.spiders.zambia.Zambia(*args, **kwargs)[source]¶

Domain

Zambia Public Procurement Authority (ZPPA)

Spider arguments

from_date: Download only data from this month onward (YYYY-MM format). If until_date is provided, defaults to ‘2016-07’.
until_date: Download only data until this month (YYYY-MM format). If from_date is provided, defaults to the current month.

scrapy crawl zambia