This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm octopusinvitro ondenman

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.13.7  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/scraped.git  Fetching https://github.com/everypolitician/scraped_page_archive.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/table_unspanner.git  Installing ast 2.3.0  Installing rake 12.0.0  Installing public_suffix 2.0.4  Installing safe_yaml 1.0.4  Installing unf_ext 0.0.7.2 with native extensions  Installing field_serializer 0.3.0  Installing git 1.3.0  Installing hashdiff 0.3.1  Installing httpclient 2.6.0.1  Installing method_source 0.8.2  Installing mime-types-data 3.2016.0521  Installing coderay 1.1.0  Installing mini_portile2 2.1.0  Installing minitest 5.10.1  Installing netrc 0.11.0  Installing vcr 3.0.3  Installing open-uri-cached 0.0.5  Installing powerpack 0.1.1  Installing slop 3.6.0  Installing rainbow 2.1.0  Installing require_all 1.3.3  Installing unicode-display_width 1.1.2  Installing ruby-progressbar 1.8.1  Installing sqlite3 1.3.10 with native extensions  Using bundler 1.13.7  Installing parser 2.3.3.1  Installing addressable 2.5.0  Installing crack 0.4.3  Installing mime-types 3.1  Installing nokogiri 1.7.0.1 with native extensions  Installing minispec-metadata 2.0.0  Installing minitest-around 0.4.0  Installing pry 0.10.1  Installing rubocop 0.46.0  Installing webmock 2.0.3  Installing unf 0.1.4  Installing minitest-vcr 1.4.0  Installing vcr-archive 0.3.0  Installing domain_name 0.5.20161129  Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@28f93d7)  Installing http-cookie 1.0.3  Installing sqlite_magic 0.0.3  Installing rest-client 2.0.0  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Using scraped 0.2.0 from https://github.com/everypolitician/scraped.git (at master@c3fc06e)  Using table_unspanner 0.1.0 from https://github.com/everypolitician/table_unspanner.git (at master@a70a98a)  Bundle complete! 15 Gemfile dependencies, 46 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu  Bundle completed (31.29s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 283 times by everypolitician ondenman MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (186 KB) Use the API

rows 10 / 512

id name area category party deceased source birth_date email image term
144
آل حسن بري
حلب
(ب) قطاع باقي فئات الشعب
مستقل
1972-01-01
2012
255
أحمد ابراهيم
مناطق محافظة حلب
(أ) قطاع عمال وفلاحين
حزب البعث العربي الاشتراكي
1960-01-01
2012
109
أحمد الحميدي
الرقة
(ب) قطاع باقي فئات الشعب
حزب البعث العربي الاشتراكي
1964-01-01
2012
256
أحمد العلي الحمرة
مناطق محافظة حلب
(أ) قطاع عمال وفلاحين
مستقل
1977-01-01
2012
78
أحمد الفرج
إدلب
(أ) قطاع عمال وفلاحين
حزب البعث العربي الاشتراكي
1967-01-01
2012
79
أحمد المبارك
إدلب
(أ) قطاع عمال وفلاحين
حزب البعث العربي الاشتراكي
1959-01-01
2012
143
أحمد جريخ
حلب
(أ) قطاع عمال وفلاحين
مستقل
1948-01-01
2012
229
أحمد كزبري
دمشق
(ب) قطاع باقي فئات الشعب
مستقل
1971-01-01
ahmad@alkezbari.com
2012
77
أحمد الحسن الهلال
إدلب
(أ) قطاع عمال وفلاحين
حزب البعث العربي الاشتراكي
1951-01-01
2012
80
أحمد ديب قباني
إدلب
(أ) قطاع عمال وفلاحين
حزب البعث العربي الاشتراكي
1962-01-01
2012

Statistics

Average successful run time: 32 minutes

Total run time: 7 days

Total cpu time used: 3 days

Total disk space used: 193 MB

History

  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    250 records added in the database
  • Auto ran revision 0052deff and failed .
    250 records removed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    512 records added in the database
  • Auto ran revision 0052deff and failed .
    512 records removed in the database
  • Auto ran revision 0052deff and completed successfully .
    512 records added in the database
  • Auto ran revision 0052deff and failed .
    512 records removed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    512 records added in the database
  • Auto ran revision 0052deff and failed .
    512 records removed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and failed .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    250 records added in the database
  • Auto ran revision 0052deff and failed .
    262 records added in the database
  • Auto ran revision 0052deff and failed .
    512 records removed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    nothing changed in the database
  • Auto ran revision 0052deff and completed successfully .
    512 records updated in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    250 records added in the database
  • Auto ran revision e38b48d6 and failed .
    250 records removed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    250 records added in the database
  • Auto ran revision e38b48d6 and failed .
    250 records removed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    250 records added in the database
  • Auto ran revision e38b48d6 and failed .
    250 records removed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    512 records added in the database
  • Auto ran revision e38b48d6 and failed .
    512 records removed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    512 records added in the database
  • Auto ran revision e38b48d6 and failed .
    512 records removed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    250 records added in the database
  • Auto ran revision e38b48d6 and failed .
    250 records removed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    512 records added in the database
  • Auto ran revision e38b48d6 and failed .
    nothing changed in the database
  • Auto ran revision e38b48d6 and failed .
    512 records removed in the database
  • Auto ran revision e38b48d6 and completed successfully .
    nothing changed in the database
  • Manually ran revision e38b48d6 and completed successfully .
    512 records added in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    7 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    7 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    7 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    227 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    399 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    467 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    311 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    455 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    695 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    391 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    451 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    379 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    355 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records removed in the database
    5 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records added in the database
    1063 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    205 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    906 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    879 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    751 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records removed in the database
    735 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
  • Auto ran revision 76ba1ba0 and failed .
    262 records added in the database
    3037 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    843 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    904 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records removed in the database
    5 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records added in the database
    1647 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    159 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    226 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    262 records removed in the database
    9 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    249 records added in the database
    1124 pages scraped
  • Auto ran revision 76ba1ba0 and failed .
    nothing changed in the database
    736 pages scraped
  • Auto ran revision 9ce08c1b and failed .
    nothing changed in the database
    83 pages scraped
  • Manually ran revision 9ce08c1b and failed .
    426 records removed in the database
    59 pages scraped
  • Auto ran and failed .
  • Auto ran revision 9ce08c1b and failed .
    nothing changed in the database
  • Auto ran revision 9ce08c1b and failed .
    437 records added in the database
    1767 pages scraped
  • Auto ran revision 9ce08c1b and failed .
    47 records removed in the database
    15 pages scraped
  • Auto ran revision 9ce08c1b and failed .
    nothing changed in the database
    142 pages scraped
  • Auto ran revision b0028b6c and failed .
    10 records added in the database
    203 pages scraped
  • Auto ran revision b0028b6c and failed .
    5 records removed in the database
    163 pages scraped
  • Auto ran revision b0028b6c and failed .
    11 records added in the database
    183 pages scraped
  • Auto ran revision b0028b6c and failed .
    476 records removed in the database
    139 pages scraped
  • Auto ran revision b0028b6c and completed successfully .
    nothing changed in the database
    2046 pages scraped
  • Auto ran revision b0028b6c and completed successfully .
    197 records added in the database
    2046 pages scraped
  • Auto ran revision b0028b6c and failed .
    38 records added, 274 records updated in the database
    1259 pages scraped
  • Auto ran revision b0028b6c and failed .
    nothing changed in the database
  • Manually ran revision ff851862 and failed .
    nothing changed in the database
  • Manually ran revision ff851862 and failed .
    nothing changed in the database
  • Manually ran and failed .
  • Manually ran revision 8c9d1df1 and completed successfully .
    274 records added in the database
    277 pages scraped
  • Created on morph.io

Scraper code

Ruby

syria-peoples-council / scraper.rb