loren / mca_data

MCA trade leads from dgMarket


This is a scraper of MCA Trade Lead data from dgMarket that runs on Morph. It extracts country name, country code, deadline, and type from the multi-value attribute.

Contributors loren

The scraper is queued to run. It was queued automatically .

Console output of last run

Data

Downloaded 267 times by loren

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26 KB) Use the API

rows 10 / 29

title link description pubDate guid categories country_code country_name
Health Insurance Services
Buyer: <a href="http://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=6938903">MILLENNIUM CHALLENGE ACCOUNT</a>
2017-01-04T21:03:42-05:00
type/spn,CPV/66512200,CPV/66000000,deadline/2017/Jan/27
BJ
Benin
Procurement of Consultant Services for Senior Compact Closure Advisor
Buyer: <a href="http://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=6938903">MILLENNIUM CHALLENGE ACCOUNT</a>
2017-01-04T21:03:50-05:00
type/spn,CPV/79410000,CPV/79700000,deadline/2017/Jan/23
MW
Malawi
Procurement of Consultant Services(Senior Resettlement Advisor)
Buyer: <a href="http://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=6938903">MILLENNIUM CHALLENGE ACCOUNT</a>
2017-01-13T21:05:16-05:00
type/spn,CPV/71530000,CPV/71000000,deadline/2017/Jan/27
MW
Malawi
Health insurance services
Buyer: <a href="http://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=1277964">MCA-Benin II</a>
2016-12-28T12:29:29-05:00
type/spn,CPV/66512200,deadline/2017/Jan/27
BJ
Benin
Construction management services
Buyer: <a href="http://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=1277964">MCA-Benin II</a>
2016-11-24T12:05:50-05:00
type/spn,CPV/71540000,CPV/71700000,CPV/90700000,CPV/90500000,CPV/71530000,CPV/09310000,deadline/2017/Jan/31
BJ
Benin
Electricity
Buyer: <a href="http://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=1277964">MCA-Benin II</a>
2017-01-17T13:57:31-05:00
type/pp,CPV/09310000,CPV/79212200,CPV/79314000,CPV/66512200,CPV/66511000,CPV/35121000,CPV/39130000,CPV/39000000,CPV/79212100,CPV/72224000,CPV/79720000,CPV/71351810,CPV/79220000,CPV/79111000
BJ
Benin
General Procurement Notice N°2 (Amendment 3
Buyer: <a href="http://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=1277964">MCA-Benin II</a>
2016-08-24T07:48:18-04:00
type/pp,CPV/09310000,CPV/51110000,CPV/48219300,CPV/48810000,CPV/48000000,CPV/48931000,CPV/79212200,CPV/79314000
BJ
Benin
Selection of a Program, Environmental and Social Management Consultant (PESMC)
Buyer: <a href="http://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=1277964">MCA-Benin II</a>
2016-11-24T12:06:21-05:00
type/spn,CPV/71540000,CPV/71700000,CPV/90700000,CPV/90500000,CPV/71530000,CPV/09310000,deadline/2017/Jan/31
BJ
Benin
General Procurement Notice N°2 (Amendment 2)
Buyer: <a href="http://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=1277964">MCA-Benin II</a>
2016-07-22T04:01:17-04:00
type/pp,CPV/09310000,CPV/51110000,CPV/48219300,CPV/48810000,CPV/48000000,CPV/48931000,CPV/79212200,CPV/79314000
BJ
Benin
General Procurement Notice N°3
Buyer: <a href="http://www.dgmarket.com/tenders/adminShowBuyer.do?buyerId=1277964">MCA-Benin II</a>
2017-01-17T13:24:01-05:00
type/pp,CPV/09310000,CPV/79212200,CPV/79314000,CPV/66512200,CPV/66511000,CPV/35113000,CPV/39130000,CPV/39000000,CPV/85312320,CPV/79212100,CPV/72224000,CPV/79311000,CPV/79221000,CPV/71351810
BJ
Benin

Statistics

Average successful run time: half a minute

Total run time: about 1 hour

Total cpu time used: 3 minutes

Total disk space used: 67.5 KB

History

  • Auto ran revision 639d14e0 and completed successfully .
    19 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and failed .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 15 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    3 records updated in the database
    40 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 15 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 8 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 9 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 6 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    6 records added, 20 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and failed .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 2 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and failed .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 20 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    15 records removed, 20 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    24 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    19 records added, 15 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records removed, 7 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 16 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    3 records removed, 17 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 19 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    3 records removed, 20 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    210 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records removed, 23 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records removed, 14 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    16 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records removed, 15 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    3 records added, 24 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 24 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 19 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    12 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    3 records removed, 25 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    5 records removed, 28 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    8 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    33 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 14 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 30 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 1 record updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    3 records removed, 32 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 26 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 13 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 22 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    5 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    3 records added, 20 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 23 records updated in the database
    2 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    9389 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records removed, 31 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    5 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    3 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    8 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 33 records updated in the database
    102 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 14 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    5 records added, 27 records updated in the database
    3 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    5 records added, 24 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    80 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 22 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 10 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records removed, 21 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 23 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 9 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    3 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    12 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records removed, 25 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    3 records removed, 22 records updated in the database
    3 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    12 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 14 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 3 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 5 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    24 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    29 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 30 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 28 records updated in the database
    7694 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 10 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 20 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    9 records removed, 25 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    14 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 17 records updated in the database
    2 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 28 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    6 records updated in the database
    37 pages scraped
  • Auto ran revision 639d14e0 and completed successfully .
    33 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    5 records updated in the database
    1 page scraped
  • Auto ran revision 639d14e0 and completed successfully .
    4 records added, 23 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 11 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 8 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 15 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    2 records removed, 34 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 6 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    1 record added, 18 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    5 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 21 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    2 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    2 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    4 records removed, 30 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    2 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Manually ran revision 639d14e0 and completed successfully .
    37 records added in the database
  • Auto ran revision 639d14e0 and failed .
    37 records removed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    1 record removed, 21 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    15 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    18 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    22 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    7 records added, 30 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 13 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 25 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    27 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    3 records added in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    5 records removed, 24 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    2 records removed, 18 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    5 records added, 26 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    2 records added, 24 records updated in the database
  • Auto ran revision 639d14e0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 639d14e0 and completed successfully .
    2 records removed, 20 records updated in the database
  • Manually ran revision 639d14e0 and completed successfully .
    26 records added in the database
  • Manually ran revision 26f62640 and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Ruby

mca_data / scraper.rb