duncanparkes / papuanewguinea

Morph scraper for Papua New Guinea politicians


Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.6  $ pip install -r requirements.txt  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r requirements.txt (line 8))  /app/.heroku/python/lib/python2.7/site-packages/pip-8.1.2-py2.7.egg/pip/_vendor/requests/packages/urllib3/util/ssl_.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#snimissingwarning.  SNIMissingWarning  /app/.heroku/python/lib/python2.7/site-packages/pip-8.1.2-py2.7.egg/pip/_vendor/requests/packages/urllib3/util/ssl_.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.  InsecurePlatformWarning  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting awesome-slugify==1.6.4 (from -r requirements.txt (line 13))  Downloading awesome-slugify-1.6.4.tar.gz  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r requirements.txt (line 6))  Downloading requests-2.13.0-py2.py3-none-any.whl (584kB)  Collecting regex (from awesome-slugify==1.6.4->-r requirements.txt (line 13))  Downloading regex-2017.02.08.tar.gz (600kB)  Collecting Unidecode<0.05,>=0.04.14 (from awesome-slugify==1.6.4->-r requirements.txt (line 13))  Downloading Unidecode-0.04.20-py2.py3-none-any.whl (228kB)  Installing collected packages: dumptruck, requests, scraperwiki, lxml, cssselect, regex, Unidecode, awesome-slugify  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Running setup.py install for regex: started  Running setup.py install for regex: finished with status 'done'  Running setup.py install for awesome-slugify: started  Running setup.py install for awesome-slugify: finished with status 'done'  Successfully installed Unidecode-0.4.20 awesome-slugify-1.6.4 cssselect-0.9.1 dumptruck-0.1.6 lxml-3.4.4 regex-2017.2.8 requests-2.13.0 scraperwiki   ! Hello! It looks like your application is using an outdated version of Python.  ! This caused the security warning you saw above during the 'pip install' step.  ! We recommend 'python-2.7.12', which you can specify in a 'runtime.txt' file.  ! -- Much Love, Heroku.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Handling Region: Highlands Region - Handling Province: Eastern Highlands Province - Handling District: Governor PNC People's National Congress - Handling District: Daulo District PNC People's National Congress - Handling District: Goroka District NG New Generation - Handling District: Henganofi District PNC People's National Congress - Handling District: Kainantu District PPP People's Progress - Handling District: Lufa District PNC People's National Congress - Handling District: Obura Wonenara District SA Star Alliance - Handling District: Okapa District PNC People's National Congress - Handling District: Unggai Bena District PNC People's National Congress - Handling Province: Enga Province - Handling District: Governor PP People's Party - Handling District: Kandep District THE Triumph Heritage Empowerment - Handling District: Kompiam Ambum District PNC People's National Congress - Handling District: Lagaip-Porgera District I Independent - Handling District: Wabag District PNC People's National Congress - Handling District: Wapenamanda District U United - Handling Province: Chimbu Province - Handling District: Governor PNC People's National Congress - Handling District: Chuave District THE Triumph Heritage Empowerment - Handling District: Gumine District PNC People's National Congress - Handling District: Karimui-Nomane District PNC People's National Congress - Handling District: Kerowagi District I Independent - Handling District: Kundiawa District PPP People's Progress - Handling District: Sinasina-Yonggamugl District NA National Alliance - Handling Province: Southern Highlands Province - Handling District: Governor PNC People's National Congress - Handling District: Ialibu Pangia District PNC People's National Congress - Handling District: Imbonggu District PNC People's National Congress - Handling District: Kagua Erave District I Independent - Handling District: Mendi District PNC People's National Congress - Handling District: Nipa Kutubu District PNC People's National Congress - Handling Province: Hela Province - Handling District: Governor Traceback (most recent call last): File "scraper.py", line 110, in <module> member['name'] = member_root.cssselect('.section-head h1')[0].text_content().strip() IndexError: list index out of range

Data

Downloaded 279 times by everypolitician duncanparkes tmtmtmtm

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (40 KB) Use the API

rows 10 / 111

name area province fax email party region party_id phone id image term_id executive district
Hon. Daniel Mona, MP (Deceased)
Goilala District
Central Province
3277480
People's National Congress
Southern Region
PNC
3277626
Daniel-Mona
2012
Goilala District
Hon. Julie Soso, MP
Eastern Highlands Province
Eastern Highlands Province
3277480
ehpacs@online.net.pg
Triumph Heritage Empowerment
Highlands Region
THE
3277213
Julie-Soso
2012
Governor
Hon. Ron Ganarafo, MP
Daulo District
Eastern Highlands Province
3297101
rganarafo@gmail.com
People's National Congress
Highlands Region
PNC
327777/667
Ron-Ganarafo
2012
Daulo District
Hon. Bire Kimisopa, MP
Goroka District
Eastern Highlands Province
New Generation
Highlands Region
NG
3277664
Bire-Kimisopa
2012
Goroka District
Hon. Robert Atiyafa, MP
Henganofi District
Eastern Highlands Province
3277480
meneamatere@gmail.com
People's National Congress
Highlands Region
PNC
3277532/3226333
Robert-Atiyafa
2012
Henganofi District
Hon. Johnson Tuke, MP
Kainantu District
Eastern Highlands Province
3277743
johnsontuke@gmail.com
People's Progress
Highlands Region
PPP
3277671
Johnson-Tuke
2012
Kainantu District
Hon. Jeffery Kuave, MP
Lufa District
Eastern Highlands Province
3277480
People's National Congress
Highlands Region
PNC
3277628
Jeffery-Kuave
2012
Lufa District
Hon. Mehrra Minne Kipefa, MP
Obura Wonenara District
Eastern Highlands Province
3277480
admin@obura-wonenara.com
Star Alliance
Highlands Region
SA
3277695
Mehrra-Minne-Kipefa
2012
Obura Wonenara District
Hon. Isaac Waigavara, MP
Okapa District
Eastern Highlands Province
3277480
okpoff@gmail.com
People's National Congress
Highlands Region
PNC
3277694/721
Isaac-Waigavara
2012
Okapa District
Hon. Benny Allan, MP
Unggai Bena District
Eastern Highlands Province
3277480
unggaibena2012@gmail.com
People's National Congress
Highlands Region
PNC
3277553
Benny-Allan
2012
Unggai Bena District

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (40 KB) Use the API

rows 1 / 1

id name start_date end_date
2012
2012-2017
2012
2017

Statistics

Average successful run time: 4 minutes

Total run time: about 1 month

Total cpu time used: 7 minutes

Total disk space used: 97.9 KB

History

  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    32 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    30 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
  • Auto ran revision 6a2caf4e and completed successfully .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and completed successfully .
    nothing changed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    nothing changed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    27 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    918 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    78 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    23 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    45 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    36 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    10 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    41 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    38 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    46 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    111 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    143 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    76 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    121 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    111 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
    7 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and failed .
    nothing changed in the database
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Auto ran revision 6a2caf4e and completed successfully .
    111 records added, 111 records removed in the database
    112 pages scraped
  • Manually ran revision 6a2caf4e and completed successfully .
    111 records added, 108 records removed in the database
    112 pages scraped
  • Manually ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    51 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    51 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    51 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    231 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    43 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    48 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    126 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    48 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    28 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Auto ran revision bea99cd1 and failed .
    nothing changed in the database
    50 pages scraped
  • Manually ran revision 20361476 and completed successfully .
    109 records added in the database
    112 pages scraped
  • Manually ran revision 8c65d059 and completed successfully .
    109 records added, 109 records removed in the database
    112 pages scraped
  • Manually ran revision 59780481 and completed successfully .
    109 records added in the database
    112 pages scraped
  • Manually ran revision 59780481 and completed successfully .
    109 records added, 109 records removed, 1 record updated in the database
    112 pages scraped
  • Manually ran revision a8c3bfb8 and completed successfully .
    110 records added, 110 records removed in the database
    112 pages scraped
  • Manually ran revision a8c3bfb8 and completed successfully .
    110 records added in the database
    112 pages scraped
  • Created on morph.io

Scraper code

Python

papuanewguinea / scraper.py