tmtmtmtm / syria-peoples-council

Scrapes github.com and parliament.gov.sy

Build software better, together.


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm octopusinvitro

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Data

Downloaded 64 times by everypolitician ondenman MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (186 KB) Use the API

rows 0 / 0

Statistics

Average successful run time: about 5 hours

Total run time: 5 days

Total cpu time used: 3 days

Total disk space used: 166 MB

History

  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    399 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    467 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    311 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    455 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    695 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    391 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    451 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    379 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    355 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records removed in the database
    5 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records added in the database
    1063 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    205 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    906 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    879 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    751 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records removed in the database
    735 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    262 records added in the database
    3037 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    843 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    904 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records removed in the database
    5 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records added in the database
    1647 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    159 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    226 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records removed in the database
    9 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    249 records added in the database
    1124 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    736 pages scraped
  • Auto ran revision 9ce08c1b and failed .
    nothing changed in the database
    83 pages scraped
  • Manually ran revision 9ce08c1b and failed .
    426 records removed in the database
    59 pages scraped
  • Auto ran and failed .
  • Auto ran revision 9ce08c1b and failed .
    nothing changed in the database
  • Auto ran revision 9ce08c1b and failed .
    437 records added in the database
    1767 pages scraped
  • Auto ran revision 9ce08c1b and failed .
    47 records removed in the database
    15 pages scraped
  • Auto ran revision 9ce08c1b and failed .
    nothing changed in the database
    142 pages scraped
  • Auto ran revision b0028b6c and failed .
    10 records added in the database
    203 pages scraped
  • Auto ran revision b0028b6c and failed .
    5 records removed in the database
    163 pages scraped
  • Auto ran revision b0028b6c and failed .
    11 records added in the database
    183 pages scraped
  • Auto ran revision b0028b6c and failed .
    476 records removed in the database
    139 pages scraped
  • Auto ran revision b0028b6c and completed successfully .
    nothing changed in the database
    2046 pages scraped
  • Auto ran revision b0028b6c and completed successfully .
    197 records added in the database
    2046 pages scraped
  • Auto ran revision b0028b6c and failed .
    38 records added, 274 records updated in the database
    1259 pages scraped
  • Auto ran revision b0028b6c and failed .
    nothing changed in the database
  • Manually ran revision ff851862 and failed .
    nothing changed in the database
  • Manually ran revision ff851862 and failed .
    nothing changed in the database
  • Manually ran and failed .
  • Manually ran revision 8c9d1df1 and completed successfully .
    274 records added in the database
    277 pages scraped
  • Created on morph.io

Scraper code

Ruby

syria-peoples-council / scraper.rb