IPINST / PPP_Scraper

ScraperWiki implementation to extract data from PPP monthly pdf docs. For use by Morph.io.

Scrapes www.un.org

الأمم المتحدة 联合国 United Nations Nations Unies Организация Объединенных Наций Las Naciones Unidas


PPP_Scraper

This is an implementation of the scraperwiki package. The app connects to the UN Department of Peacekeeping (DPKO) report on troop contributions for the previous month hosted on their website. The url pattern uses the pattern http://www.un.org/en/peacekeeping/contributors/<year>/<3 or 4 letter month abbr><last 2 numbers of year>_3.pdf. March 2014's file would be at http://www.un.org/en/peacekeeping/contributors/2014/mar14_3.pdf for instance.

The app then converts the pdf to xml and uses page position to parse into a sqllite db. Country names are positioned between 130 and 140 px left, mission designations are between 276 and 280 px left, and data is anything more than 350 px left. This app is built to run on the Morph.io platform which contains an API that is used by the PPP_Loader app. It is also possible to run scraperwiki locally, though I've had trouble getting it to work.

Morph.io runs this script directly from GitHub once daily and data is only inserted if it doesnt exist in db.

Dependencies

  • scraperwiki - Web scraping library. The PDF to XML functionality to convert into parsable format.
  • Request - Python HTTP library to check connection
  • lxml - Python XML library to navigate the XML tree
  • python native modules: time, datetime, calendar, urllib2
  • Data source: DPKO website

Contributors byndcivilization IPINST

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... http://www.un.org/en/peacekeeping/contributors/2016/octo16_3.pdf Traceback (most recent call last): File "scraper.py", line 55, in <module> pdfdata = urllib2.urlopen(url).read() File "/app/.heroku/python/lib/python2.7/urllib2.py", line 127, in urlopen return _opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 448, in error return self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 531, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 404: Not Found

Data

Downloaded 845 times by IPINST MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.47 MB) Use the API

rows 10 / 28897

F M mission dateString tccIso3Alpha T date tccIso3Num type tcc
0
1
UNMISS
3/31/14
ALB
1
20140331
008
Individual Police
Albania
0
5
MONUSCO
3/31/14
DZA
5
20140331
012
Experts on Mission
Algeria
0
3
MINURSO
3/31/14
ARG
3
20140331
032
Experts on Mission
Argentina
1
11
MINUSTAH
3/31/14
ARG
12
20140331
032
Individual Police
Argentina
40
528
MINUSTAH
3/31/14
ARG
568
20140331
032
Contingent Troop
Argentina
16
249
UNFICYP
3/31/14
ARG
265
20140331
032
Contingent Troop
Argentina
1
10
UNMIL
3/31/14
ARG
11
20140331
032
Individual Police
Argentina
0
4
UNMISS
3/31/14
ARG
4
20140331
032
Individual Police
Argentina
0
3
UNOCI
3/31/14
ARG
3
20140331
032
Individual Police
Argentina
0
3
UNTSO
3/31/14
ARG
3
20140331
032
Experts on Mission
Argentina

Statistics

Average successful run time: less than a minute

Total run time: about 6 hours

Total cpu time used: 10 minutes

Total disk space used: 3.71 MB

History

  • Manually ran revision f8ca08db and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision f8ca08db and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision f8ca08db and completed successfully .
    996 records added in the database
    2 pages scraped
  • Manually ran revision 5980ad9e and completed successfully .
    995 records added in the database
    2 pages scraped
  • Manually ran revision 3f681129 and failed .
    nothing changed in the database
  • Manually ran revision 3f681129 and completed successfully .
    992 records added in the database
  • Manually ran revision f910c34d and completed successfully .
    997 records added, 997 records removed in the database
  • Manually ran revision f910c34d and completed successfully .
    997 records added in the database
  • Manually ran revision 37889d34 and failed .
    nothing changed in the database
  • Manually ran revision 37889d34 and completed successfully .
    997 records added in the database
  • Manually ran revision 37889d34 and completed successfully .
    1003 records added in the database
  • Manually ran revision 37889d34 and completed successfully .
    1002 records added in the database
  • Manually ran revision 4f394ac2 and completed successfully .
    994 records added in the database
    2 pages scraped
  • Manually ran revision 456a95c1 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 38497fa4 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision b2d59e99 and failed .
    nothing changed in the database
  • Manually ran revision b2d59e99 and failed .
    nothing changed in the database
  • Manually ran revision c7f4090a and completed successfully .
    993 records added in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    996 records added, 996 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    996 records added, 996 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    996 records added, 996 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    996 records added, 996 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    996 records added, 996 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    996 records added, 996 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    996 records added, 996 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    996 records added, 996 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    996 records added, 996 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    996 records added in the database
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    12 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    997 records added, 997 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    997 records added, 997 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    997 records added, 997 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    997 records added, 997 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    997 records added, 997 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    997 records added, 997 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    997 records added, 997 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    997 records added, 997 records removed in the database
  • Auto ran revision c4e78d33 and completed successfully .
    997 records added, 997 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    997 records added, 997 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    997 records added in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    6 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    8 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added, 981 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    981 records added in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    10 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added, 968 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    968 records added in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision c4e78d33 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    15 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    3 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    3 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    2 pages scraped
  • Auto ran revision c4e78d33 and completed successfully .
    960 records added, 960 records removed in the database
    2 pages scraped
  • Manually ran revision c4e78d33 and completed successfully .
    960 records added in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    8 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
  • Auto ran revision 46980b42 and failed .
    nothing changed in the database
    10 pages scraped
  • Auto ran revision 46980b42 and completed successfully .
    975 records added, 975 records removed in the database
  • Auto ran revision 46980b42 and completed successfully .
    975 records added, 975 records removed in the database
  • Auto ran revision 46980b42 and completed successfully .
    975 records added, 975 records removed in the database
    1 page scraped
  • Auto ran revision 46980b42 and completed successfully .
    975 records added, 975 records removed in the database
  • Auto ran revision 46980b42 and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 46980b42 and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Manually ran revision 46980b42 and completed successfully .
    975 records added in the database
    2 pages scraped
  • Manually ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    9 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    3 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added, 977 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    977 records added in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    74 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added, 975 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    975 records added in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added, 969 records removed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and completed successfully .
    969 records added in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 57d9ae2a and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 76da87e6 and completed successfully .
    961 records added in the database
    2 pages scraped
  • Manually ran revision 2eb6af96 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 7d0e3048 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 524e00d8 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 7d03eb64 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 6e11d4f5 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision fcf70cfa and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 2c85d07c and completed successfully .
    955 records added in the database
    2 pages scraped
  • Manually ran revision 01872d8a and completed successfully .
    956 records added in the database
    2 pages scraped
  • Manually ran revision d0c18493 and completed successfully .
    957 records added in the database
    2 pages scraped
  • Manually ran revision 77b7b94a and completed successfully .
    959 records added, 959 records removed in the database
    2 pages scraped
  • Auto ran revision 77b7b94a and completed successfully .
    959 records added, 959 records removed in the database
  • Manually ran revision 77b7b94a and completed successfully .
    959 records added in the database
  • Manually ran revision cc57b55f and failed .
    nothing changed in the database
  • Auto ran revision cc57b55f and failed .
    nothing changed in the database
  • Auto ran revision cc57b55f and failed .
    nothing changed in the database
  • Auto ran revision cc57b55f and failed .
    nothing changed in the database
  • Auto ran revision cc57b55f and failed .
    nothing changed in the database
  • Auto ran revision cc57b55f and failed .
    nothing changed in the database
  • Manually ran revision cc57b55f and failed .
    nothing changed in the database
  • Manually ran revision cc57b55f and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision cc57b55f and failed .
    nothing changed in the database
    74 pages scraped
  • Manually ran revision cc57b55f and failed .
    nothing changed in the database
  • Auto ran revision cc57b55f and failed .
    nothing changed in the database
  • Manually ran revision cc57b55f and failed .
    nothing changed in the database
  • Manually ran revision cc57b55f and failed .
    nothing changed in the database
  • Manually ran revision cc57b55f and failed .
    nothing changed in the database
  • Manually ran revision cc57b55f and completed successfully .
    940 records added in the database
  • Manually ran revision 3195d696 and completed successfully .
    904 records added in the database
  • Manually ran revision bf1b6510 and completed successfully .
    900 records added in the database
  • Manually ran revision 0d09699e and completed successfully .
    910 records added in the database
  • Manually ran revision c8f8bf6d and completed successfully .
    902 records added in the database
  • Manually ran revision fed0d17c and completed successfully .
    891 records added in the database
  • Manually ran revision 76f891c0 and completed successfully .
    895 records added in the database
  • Created on morph.io

Scraper code

Python

PPP_Scraper / scraper.py