This is a scraper that runs on Morph. To get started see the documentation

Contributors rustyb

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.12, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.12 -----> Installing pip -----> Installing requirements with pip  DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support  Collecting beautifulsoup4==4.5.1  Downloading beautifulsoup4-4.5.1-py2-none-any.whl (83 kB)  Collecting dumptruck==0.1.6  Downloading dumptruck-0.1.6.tar.gz (15 kB)  Collecting requests==2.10.0  Downloading requests-2.10.0-py2.py3-none-any.whl (506 kB)  Collecting scraperwiki==0.3.7  Downloading scraperwiki-0.3.7.tar.gz (6.2 kB)  Building wheels for collected packages: dumptruck, scraperwiki  Building wheel for dumptruck (setup.py): started  Building wheel for dumptruck (setup.py): finished with status 'done'  Created wheel for dumptruck: filename=dumptruck-0.1.6-py2-none-any.whl size=11842 sha256=f6b4ed49b6401819dd0bba0d038058e56ff0e83e30a6e3293ce65d1ff7095722  Stored in directory: /tmp/pip-ephem-wheel-cache-S3ctl8/wheels/dc/75/e9/1e61c4080c73e7bda99614549591f83b53bcc2d682f26fce62  Building wheel for scraperwiki (setup.py): started  Building wheel for scraperwiki (setup.py): finished with status 'done'  Created wheel for scraperwiki: filename=scraperwiki-0.3.7-py2-none-any.whl size=5355 sha256=ee9ee580726428b4b1955a928ef60fa00149d089e10d3dc5d1daae7081d0076f  Stored in directory: /tmp/pip-ephem-wheel-cache-S3ctl8/wheels/2d/7d/d3/ec321967a4c05d45055aaec3d55a39c06959079d007a3854b0  Successfully built dumptruck scraperwiki  Installing collected packages: beautifulsoup4, dumptruck, requests, scraperwiki  Successfully installed beautifulsoup4-4.5.1 dumptruck-0.1.6 requests-2.10.0 scraperwiki-0.3.7 DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support    -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 433, in <module> parser.saveResults(day.day, day.month, day.year) File "scraper.py", line 351, in saveResults return self.getResultsByDayMonthYear(int(day), int(month), int(year)).save() File "scraper.py", line 259, in getResultsByDayMonthYear response = urllib2.urlopen(self.search_url, post_data) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 154, in urlopen return opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 435, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 548, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 473, in error return self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 407, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 556, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 502: Bad Gateway

Data

Downloaded 25 times by rustyb jaymes88 MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (8.28 MB) Use the API

rows 10 / 19600

description info_url date_received council_reference postcode address comment_url
Permission for Retention of an existing development at this site.
2014-09-15
D14A/0598
No Postcode
Taylorsgrange Td, College Road, Rathfarnham, Co Dublin
Permission for Retention of 'as constructed' unauthorised boundary walls
2014-09-15
D14A/0597
No Postcode
Maranatha, Shanganagh Road, Dublin 18
Permission for a new extension (floor area 9 sqm) at first floor level to the
2014-09-15
D14B/0316
No Postcode
Trentham, Nerano Road, Dalkey, Co Dublin
Permission to demolish the existing rear conservatory and utility area
2014-09-15
D14B/0317
No Postcode
Lus Mor, Torquay Road, Foxrock, Co Dublin
Permission for the provision of a 2-storey, 2 bedroom mews house within
2014-09-15
D14A/0600
No Postcode
The Bungalow, Sandycove East Lane, Sandycove, Co Dublin
Compliance re condition nos. 6 & 11
2014-09-15
D13A/0091/C2
No Postcode
34, Drummartin Terrace, Goatstown, Dublin 14
Compliance re condition nos. 5 & 6
2014-09-15
D14A/0152/C1
No Postcode
Amgen Technology Ireland, Pottery Road, Dun Laoghaire, Co. Dublin
application of insulation / render system to external walls at 50 & 52 Trees Roa
2014-09-12
Ref 11914
No Postcode
50 & 52, Trees Road Lower, Mount Merrion, Co. Dublin
Permission Retention permission and planning permission. The application site
2014-09-12
D14A/0594
No Postcode
Saint Josephs Of Cluny School Secondary School, Avondale Road, Killiney, Co Dublin
Permission for a two storey extension to side of house currently under
2014-09-12
D14B/0315
No Postcode
7 Alderman Road, Belmont, Stepaside, Co Dublin

Statistics

Average successful run time: 1 minute

Total run time: 14 days

Total cpu time used: about 1 hour

Total disk space used: 8.48 MB

History

  • Auto ran revision 313cd533 and failed .
    nothing changed in the database
  • Auto ran revision 313cd533 and failed .
    nothing changed in the database
  • Auto ran revision 313cd533 and failed .
    nothing changed in the database
  • Auto ran revision 313cd533 and failed .
    nothing changed in the database
  • Auto ran revision 313cd533 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

dlrcoco-planning-apps / scraper.py