loren / mca_data

MCA trade leads from dgMarket

Scrapes www.dgmarket.com

dgMarket - Tenders worldwide - dgMarket is the largest portal for tenders and consulting opportunities worldwide, with solicitations from national governments and international donor agencies


This is a scraper of MCA Trade Lead data from dgMarket that runs on Morph. It extracts country name, country code, deadline, and type from the multi-value attribute.

Contributors loren

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Data

Downloaded 608 times by loren

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (322 KB) Use the API

rows 10 / 491

title link description pubDate guid categories country_code country_name
Information systems and servers
Buyer: <a href="https://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=6972679">Agence MCA-Morocco</a>
2018-05-23T06:22:42-04:00
type/spn,CPV/48800000,deadline/2018/Jul/10
MA
Morocco
Fraunhofer portugal challenge 2018
Buyer: <a href="https://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=7648803">FRAUNHOFER PORTUGAL AICOS</a>
2018-05-12T07:41:09-04:00
type/spn,CPV/45214600,CPV/45214631,deadline/2018/Jul/29
PT
Portugal
GENERAL PROCUREMENT NOTICE
Buyer: <a href="https://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=1318386">MCA-Georgia</a>
2018-01-11T06:11:48-05:00
type/gpn,CPV/30200000,CPV/30230000,CPV/30191000,CPV/45222000,CPV/55110000,CPV/72314000,CPV/72262000
GE
Georgia
Commercial and industrial carbon challenge
Buyer: <a href="https://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=7568826">NYSERDA</a>
2018-05-12T07:47:53-04:00
type/spn,CPV/24112100,deadline/2018/Jul/10
US
United States
Rfp 18.0086 millennium place pool shutdown
Buyer: <a href="https://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=7536759">STRATHCONA COUNTY</a>
2018-05-02T20:10:00-04:00
type/spn,CPV/45212212,deadline/2018/May/29
CA
Canada
General Procurement Notice No 12
Buyer: <a href="https://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=6614069">MCA-Zambia</a>
2018-02-13T04:16:24-05:00
type/gpn,CPV/45240000,CPV/90710000,CPV/30200000,CPV/73200000,CPV/79212000,deadline/2018/Jun/30
ZM
Zambia
PACIFIC DISTRICT(OAK) - FY18 Shrine/Millennium Project for Golden Gate National Cemetery - Headstone Support System
Buyer: <a href="https://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=7519286">VA National Cemetery Administration Centralized Contracting Division</a>
2018-05-17T21:01:24-04:00
type/spn,CPV/45112700,CPV/71421000,deadline/2018/Jun/05
US
United States
General Procurement Notice No 12 - Revised
Buyer: <a href="https://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=6614069">MCA-Zambia</a>
2018-05-21T07:48:45-04:00
type/gpn,CPV/45240000,CPV/45340000,CPV/79200000,CPV/34100000,CPV/30200000,CPV/73200000
ZM
Zambia
Providing reforms and sciences curriculum requirement programs - national millennium development.
Buyer: <a href="https://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=7538266">KABUL MUNICIPALITY</a>
2018-05-25T00:23:39-04:00
type/spn,CPV/75121000,deadline/2018/Jun/12
AF
Afghanistan
Innovation challenge housing police
Buyer: <a href="https://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=7273407">POLITIE NEDERLAND</a>
2018-02-08T21:15:21-05:00
type/gpn,CPV/45211300,CPV/45211370,deadline/2018/Jun/28
NL
Netherlands

Statistics

Average successful run time: half a minute

Total run time: about 6 hours

Total cpu time used: 11 minutes

Total disk space used: 346 KB

History

  • Auto ran revision 74670372 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 74670372 and completed successfully .
    400 records updated in the database
    1 page scraped
  • Auto ran revision 74670372 and completed successfully .
    471 records updated in the database
    1 page scraped
  • Auto ran revision 74670372 and completed successfully .
    480 records updated in the database
    4 pages scraped
  • Auto ran revision 74670372 and completed successfully .
    368 records updated in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

mca_data / scraper.rb