Contributors psychemedia

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.9  $ pip install -r requirements.txt  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting lxml (from -r requirements.txt (line 8))  Downloading lxml-3.7.1-cp27-cp27m-manylinux1_x86_64.whl (6.7MB)  Collecting cssselect (from -r requirements.txt (line 9))  Downloading cssselect-1.0.0-py2.py3-none-any.whl  Collecting beautifulsoup4 (from -r requirements.txt (line 11))  Downloading beautifulsoup4-4.5.3-py2-none-any.whl (85kB)  Collecting html5lib (from -r requirements.txt (line 12))  Downloading html5lib-0.999999999-py2.py3-none-any.whl (112kB)  Collecting mechanize (from -r requirements.txt (line 13))  Downloading mechanize-0.2.5.tar.gz (383kB)  Collecting pandas (from -r requirements.txt (line 14))  Downloading pandas-0.19.2-cp27-cp27m-manylinux1_x86_64.whl (17.2MB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r requirements.txt (line 6))  Downloading requests-2.12.4-py2.py3-none-any.whl (576kB)  Collecting six (from html5lib->-r requirements.txt (line 12))  Downloading six-1.10.0-py2.py3-none-any.whl  Collecting webencodings (from html5lib->-r requirements.txt (line 12))  Downloading webencodings-0.5.tar.gz  Collecting pytz>=2011k (from pandas->-r requirements.txt (line 14))  Downloading pytz-2016.10-py2.py3-none-any.whl (483kB)  Collecting python-dateutil (from pandas->-r requirements.txt (line 14))  Downloading python_dateutil-2.6.0-py2.py3-none-any.whl (194kB)  Collecting numpy>=1.7.0 (from pandas->-r requirements.txt (line 14))  Downloading numpy-1.11.3-cp27-cp27m-manylinux1_x86_64.whl (15.4MB)  Installing collected packages: dumptruck, requests, scraperwiki, lxml, cssselect, beautifulsoup4, six, webencodings, html5lib, mechanize, pytz, python-dateutil, numpy, pandas  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for webencodings: started  Running setup.py install for webencodings: finished with status 'done'  Running setup.py install for mechanize: started  Running setup.py install for mechanize: finished with status 'done'  Successfully installed beautifulsoup4-4.5.3 cssselect-1.0.0 dumptruck-0.1.6 html5lib-0.999999999 lxml-3.7.1 mechanize-0.2.5 numpy-1.11.3 pandas-0.19.2 python-dateutil-2.6.0 pytz-2016.10 requests-2.12.4 scraperwiki six-1.10.0 webencodings-0.5   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... First seen: APP/P2114/W/16/3164744 First seen: APP/P2114/W/16/3164027 First seen: APP/P2114/W/16/3163093 First seen: APP/P2114/W/16/3162880 First seen: APP/P2114/W/16/3160289 First seen: APP/P2114/W/16/3159822 First seen: APP/P2114/D/16/3159624 First seen: APP/P2114/W/16/3157762 First seen: APP/P2114/X/16/3156444 First seen: APP/P2114/W/16/3155436 First seen: APP/P2114/D/16/3155276 First seen: APP/P2114/W/16/3155274 First seen: APP/P2114/W/16/3154831 First seen: APP/P2114/W/16/3154694 First seen: APP/P2114/W/16/3153839 First seen: APP/P2114/Y/16/3152877 First seen: APP/P2114/W/16/3152873 First seen: APP/P2114/W/16/3152692 First seen: APP/P2114/W/16/3151599 First seen: APP/P2114/D/16/3150200 First seen: APP/P2114/W/16/3150174 First seen: APP/P2114/W/16/3149735 First seen: APP/P2114/D/16/3148603 First seen: APP/P2114/W/16/3148557 First seen: APP/P2114/Y/16/3148499 First seen: APP/P2114/C/16/3147618 First seen: APP/P2114/D/16/3145714 First seen: APP/P2114/W/16/3145162 First seen: APP/P2114/W/16/3144508 First seen: APP/P2114/W/16/3143825 First seen: APP/P2114/W/16/3143749 First seen: APP/P2114/W/16/3143703 First seen: APP/P2114/W/15/3134495 First seen: APP/P2114/W/15/3133766 First seen: APP/P2114/W/15/3133682 First seen: APP/P2114/C/15/3132479 First seen: APP/P2114/C/15/3132475 First seen: APP/P2114/C/15/3132471 First seen: APP/P2114/C/15/3132466 First seen: APP/P2114/W/15/3067597 First seen: APP/P2114/W/15/3063785 First seen: APP/P2114/W/15/3032514 First seen: APP/P2114/Y/15/3029734 First seen: APP/P2114/C/15/3017937 First seen: APP/P2114/W/15/3015601 First seen: APP/P2114/W/15/3014399 First seen: APP/P2114/D/15/3007924 First seen: APP/P2114/W/15/3006152 First seen: APP/P2114/W/15/3003964 First seen: APP/P2114/W/15/3003751 First seen: APP/P2114/W/15/3003527 First seen: APP/P2114/D/15/3002712 First seen: APP/P2114/W/14/3001672 First seen: APP/P2114/W/14/3001495 First seen: APP/P2114/W/14/3001191 First seen: APP/P2114/W/14/3001004 First seen: APP/P2114/W/14/3000986 First seen: APP/P2114/W/14/3000751 First seen: APP/P2114/W/14/2229248 First seen: APP/P2114/W/14/2228992 First seen: APP/P2114/W/14/2228818 First seen: APP/P2114/W/14/2228374 First seen: APP/P2114/W/14/2227919 First seen: APP/P2114/D/14/2227121 First seen: APP/P2114/W/14/2226373 First seen: APP/P2114/W/14/2225576 First seen: APP/P2114/D/14/2225292 First seen: APP/P2114/W/14/2225184 First seen: APP/P2114/Y/14/2225062 First seen: APP/P2114/W/14/2225061 First seen: APP/P2114/W/14/2223661 First seen: APP/P2114/Z/14/2223293 First seen: APP/P2114/W/14/2223277 First seen: APP/P2114/D/14/2223064 First seen: APP/P2114/W/14/2223011 First seen: APP/P2114/D/14/2222730 First seen: APP/P2114/W/14/2222288 First seen: APP/P2114/C/14/2221958 First seen: APP/P2114/W/14/2221599 First seen: APP/P2114/D/14/2221137 First seen: APP/P2114/W/14/2220585 First seen: APP/P2114/W/14/2220430 First seen: APP/P2114/C/14/2220409 First seen: APP/P2114/W/14/2219914 First seen: APP/P2114/W/14/2219601 First seen: APP/P2114/W/14/2218955 First seen: APP/P2114/D/14/2218918 First seen: APP/P2114/W/14/2218754 First seen: APP/P2114/C/14/2217453 First seen: APP/P2114/W/14/2217437 First seen: APP/P2114/W/14/2217433 First seen: APP/P2114/W/14/2217355 First seen: APP/P2114/W/14/2215671 First seen: APP/P2114/W/14/2215662 First seen: APP/P2114/W/14/2215497 First seen: APP/P2114/W/14/2214509 First seen: APP/P2114/C/14/2214112 First seen: APP/P2114/C/14/2214001 First seen: APP/P2114/W/14/2213826 First seen: APP/P2114/W/14/2213806 First seen: APP/P2114/A/14/2213591 First seen: APP/P2114/A/14/2213134 First seen: APP/P2114/W/14/2212156 First seen: APP/P2114/E/14/2212103 First seen: APP/P2114/A/14/2211476 First seen: APP/P2114/A/13/2210421 First seen: APP/P2114/A/13/2210292 First seen: APP/P2114/Y/13/2209584 First seen: APP/P2114/W/13/2209570 First seen: APP/P2114/A/13/2208196 First seen: APP/P2114/E/13/2207027 First seen: APP/P2114/A/13/2207019 First seen: APP/P2114/A/13/2206928 First seen: APP/P2114/C/13/2205262 First seen: APP/P2114/D/13/2205123 First seen: APP/P2114/A/13/2204863 First seen: APP/P2114/E/13/2204828 First seen: APP/P2114/A/13/2204478 First seen: APP/P2114/A/13/2202293 First seen: APP/P2114/C/13/2201324 First seen: APP/P2114/A/13/2201026 First seen: APP/P2114/A/13/2200651 First seen: APP/P2114/A/13/2200404 First seen: APP/P2114/A/13/2199921 First seen: APP/P2114/A/13/2199699 First seen: APP/P2114/A/13/2199587 First seen: APP/P2114/A/13/2199133 First seen: APP/P2114/X/13/2198362 First seen: APP/P2114/A/13/2197697 First seen: APP/P2114/X/13/2197255 First seen: APP/P2114/C/13/2196431 First seen: APP/P2114/A/13/2195615 First seen: APP/P2114/A/13/2195583 First seen: APP/P2114/D/13/2195017 First seen: APP/P2114/A/13/2194691 First seen: APP/P2114/A/13/2193967 First seen: APP/P2114/D/13/2193902 First seen: APP/P2114/A/13/2193719 First seen: APP/P2114/A/13/2193376 First seen: APP/P2114/A/13/2192300 First seen: APP/P2114/A/13/2192285 First seen: APP/P2114/X/13/2192135 First seen: APP/P2114/E/13/2191656 First seen: APP/P2114/A/13/2191653 First seen: APP/P2114/A/13/2191196 First seen: APP/P2114/A/13/2190657 First seen: APP/P2114/A/12/2190204 First seen: APP/P2114/A/12/2190005 First seen: APP/P2114/A/12/2189048 First seen: APP/P2114/A/12/2188835 First seen: APP/P2114/A/12/2188148 First seen: APP/P2114/A/12/2186799 First seen: APP/P2114/E/12/2185940 First seen: APP/P2114/A/12/2185864 First seen: APP/P2114/F/12/2185488 First seen: APP/P2114/A/12/2185440 First seen: APP/P2114/E/12/2185017 First seen: APP/P2114/A/12/2185013 First seen: APP/P2114/D/12/2184487 First seen: APP/P2114/F/12/2183932 First seen: APP/P2114/D/12/2182971 First seen: APP/P2114/D/12/2182900 First seen: APP/P2114/A/12/2182860 First seen: APP/P2114/A/12/2182760 First seen: APP/P2114/C/12/2182250 First seen: APP/P2114/E/12/2181416 First seen: APP/P2114/A/12/2181202 First seen: APP/P2114/X/12/2181195 First seen: APP/P2114/D/12/2180920 First seen: APP/P2114/H/12/2180919 First seen: APP/P2114/A/12/2180688 First seen: APP/P2114/A/12/2180061 First seen: APP/P2114/A/12/2180051 First seen: APP/P2114/A/12/2179053 First seen: APP/P2114/A/12/2178970 First seen: APP/P2114/D/12/2178505 First seen: APP/P2114/A/12/2178203 First seen: APP/P2114/A/12/2177984 First seen: APP/P2114/A/12/2177602 First seen: APP/P2114/D/12/2176821 First seen: APP/P2114/A/12/2176576 First seen: APP/P2114/A/12/2176500 First seen: APP/P2114/A/12/2176194 First seen: APP/P2114/E/12/2176134 First seen: APP/P2114/A/12/2176133 First seen: APP/P2114/A/12/2174748 First seen: APP/P2114/A/12/2174611 First seen: APP/P2114/A/12/2174106 First seen: APP/P2114/C/12/2174085 First seen: APP/P2114/D/12/2173516 First seen: APP/P2114/D/12/2173470 First seen: APP/P2114/A/12/2173417 First seen: APP/P2114/C/12/2172727 First seen: APP/P2114/C/12/2172642 First seen: APP/P2114/C/12/2172641 First seen: APP/P2114/A/12/2171498 First seen: APP/P2114/A/12/2171314 First seen: APP/P2114/C/12/2171302 First seen: APP/P2114/A/12/2171021 First seen: APP/P2114/A/12/2170651 First seen: APP/P2114/D/12/2170284 First seen: APP/P2114/X/12/2168933 First seen: APP/P2114/A/12/2168251 First seen: APP/P2114/C/11/2167548 First seen: APP/P2114/C/11/2167546 First seen: APP/P2114/C/11/2167545 First seen: APP/P2114/A/11/2166465 First seen: APP/P2114/A/11/2165915 First seen: APP/P2114/E/11/2165127 First seen: APP/P2114/A/11/2161796 First seen: APP/P2114/C/11/2157938 First seen: APP/P2114/E/11/2156134 First seen: APP/P2114/A/11/2155955 First seen: APP/P2114/A/11/2155802 First seen: APP/P2114/A/11/2155314 First seen: APP/P2114/C/11/2154150 First seen: APP/P2114/C/10/2137066 First seen: APP/P2114/A/10/2137029 First seen: APP/P2114/X/10/2136569 First seen: APP/P2114/A/10/2135256 First seen: APP/P2114/D/10/2134724 First seen: APP/P2114/D/10/2133124 First seen: APP/P2114/A/10/2132124 First seen: APP/P2114/A/10/2129874 First seen: APP/P2114/D/10/2128846 First seen: APP/P2114/A/10/2128585 First seen: APP/P2114/D/10/2127847 First seen: APP/P2114/A/10/2127126 First seen: APP/P2114/A/10/2127044 First seen: APP/P2114/A/10/2125714 First seen: APP/P2114/A/10/2124040 First seen: APP/P2114/D/10/2123295 First seen: APP/P2114/C/10/2122936 First seen: APP/P2114/D/10/2122707 First seen: APP/P2114/A/10/2122475 First seen: APP/P2114/A/10/2121859 First seen: APP/P2114/A/10/2120814 First seen: APP/P2114/A/09/2119418 First seen: APP/P2114/A/09/2118199 First seen: APP/P2114/A/09/2118098 First seen: APP/P2114/A/09/2116778 First seen: APP/P2114/A/09/2112976 First seen: APP/P2114/C/09/2111444 First seen: APP/P2114/C/09/2111443 First seen: APP/P2114/C/09/2110441 First seen: APP/P2114/A/09/2109996 First seen: APP/P2114/C/09/2109906 First seen: APP/P2114/C/09/2109905 First seen: APP/P2114/X/09/2109865 First seen: APP/P2114/C/09/2106623 Adding 250 new records Getting details for APP/P2114/W/16/3164744 /app/.heroku/python/lib/python2.7/site-packages/bs4/__init__.py:181: UserWarning: No parser was explicitly specified, so I'm using the best available HTML parser for this system ("lxml"). This usually isn't a problem, but if you run this code on another system, or in a different virtual environment, it may use a different parser and behave differently. The code that caused this warning is on line 133 of the file scraper.py. To get rid of this warning, change code that looks like this: BeautifulSoup([your markup]) to this: BeautifulSoup([your markup], "lxml") markup_type=markup_type)) Traceback (most recent call last): File "scraper.py", line 133, in <module> zz=df[df['CaseReference'].isin(grabber)]['CaseReference'].apply(lambda x: appealScrape(x)) File "/app/.heroku/python/lib/python2.7/site-packages/pandas/core/series.py", line 2294, in apply mapped = lib.map_infer(values, f, convert=convert_dtype) File "pandas/src/inference.pyx", line 1207, in pandas.lib.map_infer (pandas/lib.c:66124) File "scraper.py", line 133, in <lambda> zz=df[df['CaseReference'].isin(grabber)]['CaseReference'].apply(lambda x: appealScrape(x)) File "scraper.py", line 91, in appealScrape d[cells[0].text.strip()]=cells[1].text.strip() IndexError: list index out of range

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (65 KB) Use the API

rows 10 / 250

CaseReference SiteAddress AppellantApplicant Authority Case Type Status firstSeen CaseType
APP/P2114/W/16/3164744
13 Shore Road, COWES, PO31 8LD,
Mr Anthony Schirmer
Isle of Wight Council
In Progress
2017-01-05T01:48:10+00:00
Planning (W)
APP/P2114/W/16/3164027
The Country Garden, TOTLAND BAY, PO39 0ET,
Mr A Parr and Mrs T Tomkinson
Isle of Wight Council
In Progress
2017-01-05T01:48:10+00:00
Planning (W)
APP/P2114/W/16/3163093
65 Station Road, RYDE, PO33 4RE,
Mr Peter Lazell
Isle of Wight Council
In Progress
2017-01-05T01:48:10+00:00
Planning (W)
APP/P2114/W/16/3162880
Flat 4, Merrifield, FRESHWATER, PO40 9LJ,
Ms Meredith Buddry
Isle of Wight Council
In Progress
2017-01-05T01:48:10+00:00
Planning (W)
APP/P2114/W/16/3160289
Land off Embassy Way, Sandown, Ilse of Wight, PO36 0JP,
Mr J Woodhouse (Embassy Air Services)
Isle of Wight Council
In Progress
2017-01-05T01:48:10+00:00
Planning (W)
APP/P2114/W/16/3159822
Top Flat, Former Builders Yard, VENTNOR, PO38 1EH,
Mr J Kerr
Isle of Wight Council
In Progress
2017-01-05T01:48:10+00:00
Planning (W)
APP/P2114/D/16/3159624
100 Avenue Road, SANDOWN, PO36 8BE,
Mr William O'Meara
Isle of Wight Council
Complete: Decision issued
2017-01-05T01:48:10+00:00
Householder (HAS)
APP/P2114/W/16/3157762
Land rear of 53 Horsebridge Hill, NEWPORT, Isle of Wight, PO30 5TJ,
Island Builders
Isle of Wight Council
In Progress
2017-01-05T01:48:10+00:00
Planning (W)
APP/P2114/X/16/3156444
Roadside Inn, SEAVIEW, PO34 5DX,
Questmap Limited
Isle of Wight Council
In Progress
2017-01-05T01:48:10+00:00
Lawful Development Certificate
APP/P2114/W/16/3155436
Former Upper Chine School sports pitch, Shanklin, Isle of Wight, PO37 6RR,
Ryde School with Upper Chine
Isle of Wight Council
In Progress
2017-01-05T01:48:10+00:00
Planning (W)

Statistics

Total run time: 13 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 102 KB

History

  • Manually ran revision cd9595b8 and failed .
    250 records added in the database
    4 pages scraped
  • Manually ran revision cd9595b8 and failed .
  • Manually ran revision fdd6d6b8 and failed .
    nothing changed in the database
  • Manually ran revision c5b5497c and failed .
    nothing changed in the database
  • Created on morph.io