tmtmtmtm / laos-national-assembly

Scrapes na.gov.la

Joomla! - the dynamic portal engine and content management system


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm ondenman

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.1 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/..........  Fetching version metadata from https://rubygems.org/...  Fetching dependency metadata from https://rubygems.org/..  Fetching https://github.com/everypolitician/field_serializer.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Installing ast 2.3.0  Installing public_suffix 2.0.4  Installing coderay 1.1.0  Installing colorize 0.7.7  Installing safe_yaml 1.0.4  Installing execjs 2.5.2  Installing multipart-post 2.0.0  Using field_serializer 0.1.0 from https://github.com/everypolitician/field_serializer.git (at master@5de2b58)  Installing excon 0.45.4  Installing fuzzy_match 2.1.0  Installing git 1.3.0  Installing hashdiff 0.3.1  Installing hashie 3.4.2  Installing method_source 0.8.2  Installing httpclient 2.6.0.1  Installing open-uri-cached 0.0.5  Installing mini_portile 0.6.2  Installing powerpack 0.1.1  Installing slop 3.6.0  Installing rainbow 2.1.0  Installing require_all 1.3.3  Installing ruby-progressbar 1.8.1  Installing unicode-display_width 1.1.1  Using bundler 1.11.2  Installing sqlite3 1.3.10 with native extensions  Installing vcr 3.0.3  Installing parser 2.3.1.4  Installing addressable 2.5.0  Installing faraday 0.9.1  Installing crack 0.4.3  Installing pry 0.10.1  Installing rubocop 0.44.1  Installing nokogiri 1.6.6.2 with native extensions  Installing faraday_middleware 0.10.0  Installing webmock 2.0.3  Installing wikidata-client 0.0.7  Installing vcr-archive 0.3.0  Installing scraped_page_archive 0.5.0  Installing sqlite_magic 0.0.3  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 12 Gemfile dependencies, 40 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu  Bundle completed (24.81s)  Cleaning up the bundler cache.  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/open-uri.rb:359:in `open_http': 500 Internal Server Error (OpenURI::HTTPError) from /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/open-uri.rb:737:in `buffer_open' from /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/open-uri.rb:212:in `block in open_loop' from /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/open-uri.rb:210:in `catch' from /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/open-uri.rb:210:in `open_loop' from /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/open-uri.rb:151:in `open_uri' from /app/vendor/bundle/ruby/2.3.0/gems/open-uri-cached-0.0.5/lib/open-uri/cached.rb:10:in `open_uri' from /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/open-uri.rb:717:in `open' from /app/vendor/ruby-2.3.1/lib/ruby/2.3.0/open-uri.rb:35:in `open' from scraper.rb:15:in `noko_for' from scraper.rb:20:in `<main>'

Data

Downloaded 245 times by everypolitician ondenman MikeRalphson mhl

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (29 KB) Use the API

rows 10 / 281

name honorific_prefix area_id area term
Khampheuy Panmalaythong
Dr
1
Vientiane Capital
2011
Kikeo Khaykhamphithoune
Prof. Dr
1
Vientiane Capital
2011
Duangsavat Souphanouvong
Dr
1
Vientiane Capital
2011
Souvanpheng Bouphanouvong
Dr
1
Vientiane Capital
2011
Bua-Ngeun Xaphouvong
Mr
1
Vientiane Capital
2011
Vanpheng Keonakhone
Ms
1
Vientiane Capital
2011
Koukeo Akkhamonti
Dr
1
Vientiane Capital
2011
Bounyong Boupha
Prof. Dr
1
Vientiane Capital
2011
Somvang Thammasith
Colonel Dr
1
Vientiane Capital
2011
Buakham Thipphavong
Dr
1
Vientiane Capital
2011

Statistics

Average successful run time: 1 minute

Total run time: about 1 hour

Total cpu time used: less than a minute

Total disk space used: 89 KB

History

  • Auto ran revision 2e61ddc9 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 2e61ddc9 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 2e61ddc9 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 2e61ddc9 and completed successfully .
    149 records added, 149 records removed in the database
    68 pages scraped
  • Auto ran revision 2e61ddc9 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 2e61ddc9 and failed .
    nothing changed in the database
  • Auto ran revision 2e61ddc9 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 2e61ddc9 and completed successfully .
    149 records added, 149 records removed in the database
  • Auto ran revision 2e61ddc9 and completed successfully .
    nothing changed in the database
    19 pages scraped
  • Auto ran revision 2e61ddc9 and completed successfully .
    nothing changed in the database
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Manually ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran and failed .
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 6b4f8009 and failed .
    nothing changed in the database
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    63 pages scraped
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 6b4f8009 and completed successfully .
    nothing changed in the database
    19 pages scraped
  • Auto ran and failed .
  • Auto ran revision 6b4f8009 and failed .
    nothing changed in the database
  • Auto ran revision 6b4f8009 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6b4f8009 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6b4f8009 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6b4f8009 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6b4f8009 and failed .
    nothing changed in the database
    53 pages scraped
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    26 pages scraped
  • Auto ran revision 6b4f8009 and failed .
    nothing changed in the database
  • Auto ran revision 6b4f8009 and failed .
    nothing changed in the database
  • Auto ran revision 6b4f8009 and failed .
    nothing changed in the database
  • Auto ran revision 6b4f8009 and completed successfully .
    149 records added, 149 records removed in the database
    19 pages scraped
  • Manually ran revision 6b4f8009 and completed successfully .
    149 records added in the database
    19 pages scraped
  • Manually ran revision 0be9ec88 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 0be9ec88 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 0be9ec88 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 0be9ec88 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 93cfe2a6 and completed successfully .
    132 records added in the database
    19 pages scraped
  • Created on morph.io

Scraper code

Ruby

laos-national-assembly / scraper.rb