tmtmtmtm / afghanistan-assembly

Scrapes github.com and wolesi.website

Build software better, together.


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm octopusinvitro

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Data

Downloaded 431 times by everypolitician MikeRalphson chrismytton

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (53 KB) Use the API

rows 10 / 258

id name image term source
4237
Haji Ehsan Sahebzada
2010
4236
Engineer Zakaria Khan Zakria-Kabul
2010
4235
Abdul Qader zazai Watandost
2010
4234
Haji Qudratullah Sahak-Kabul
2010
4230
Abdul Sabor Khidmat-Farah
2010
4229
Semin Barakzai-Herat
2010
4228
Haji Hashim Mehdawi-Kabul
2010
4227
Zemarak Padkhabi-Kabul
2010
4222
Fawzia Nasiryar Guldaraye-Kabul
2010
4221
Abdul Sabor Khidmat-Farah
2010

Statistics

Average successful run time: about 3 hours

Total run time: 6 days

Total cpu time used: 1 day

Total disk space used: 107 MB

History

  • Auto ran revision 2b238ba9 and completed successfully .
    nothing changed in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    nothing changed in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    nothing changed in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    105 records added in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and failed .
    105 records removed in the database
    739 pages scraped
  • Auto ran revision 2b238ba9 and failed .
    nothing changed in the database
    39 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    nothing changed in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    nothing changed in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    27 records added in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and failed .
    27 records removed in the database
    2357 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    34 records added in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and failed .
    34 records removed in the database
    1079 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    nothing changed in the database
    2492 pages scraped
  • Auto ran revision 2b238ba9 and failed .
    14900 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    175 records added in the database
    1860 pages scraped
  • Auto ran revision 2b238ba9 and failed .
    175 records removed in the database
    403 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    nothing changed in the database
    1253 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    nothing changed in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and failed .
    nothing changed in the database
  • Auto ran revision 2b238ba9 and failed .
    nothing changed in the database
  • Auto ran revision 2b238ba9 and failed .
    nothing changed in the database
  • Auto ran revision 2b238ba9 and failed .
    nothing changed in the database
  • Auto ran revision 2b238ba9 and failed .
    nothing changed in the database
  • Auto ran revision 2b238ba9 and completed successfully .
    46 records added in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and failed .
    131 records added in the database
    1023 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    nothing changed in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and failed .
    177 records removed in the database
    395 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    nothing changed in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and completed successfully .
    248 records added in the database
    1242 pages scraped
  • Auto ran revision 2b238ba9 and failed .
    248 records removed in the database
    50 pages scraped
  • Manually ran revision 2b238ba9 and completed successfully .
    30 records added, 228 records updated in the database
    1242 pages scraped
  • Manually ran revision 0bccb197 and completed successfully .
    228 records added in the database
    46 pages scraped
  • Created on morph.io

Scraper code

Ruby

afghanistan-assembly / scraper.rb