This is a scraper that runs on Morph. To get started see the documentation

Contributors rustyb

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.12, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.12 -----> Installing pip -----> Installing requirements with pip  DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support  Collecting beautifulsoup4==4.5.1  Downloading https://files.pythonhosted.org/packages/dc/27/8919b7a505b00f410c1c113c6c93b3253784375797976272e4198f4e455a/beautifulsoup4-4.5.1-py2-none-any.whl (83kB)  Collecting dumptruck==0.1.6  Downloading https://files.pythonhosted.org/packages/15/27/3330a343de80d6849545b6c7723f8c9a08b4b104de964ac366e7e6b318df/dumptruck-0.1.6.tar.gz  Collecting requests==2.10.0  Downloading https://files.pythonhosted.org/packages/99/b4/63d99ba8e189c47d906b43bae18af4396e336f2b1bfec86af31efe2d2cb8/requests-2.10.0-py2.py3-none-any.whl (506kB)  Collecting scraperwiki==0.3.7  Downloading https://files.pythonhosted.org/packages/e0/ae/d30f414307b4098d951cef809fd8ebd6406af698db2fbb8e2bbbad45c62c/scraperwiki-0.3.7.tar.gz  Building wheels for collected packages: dumptruck, scraperwiki  Building wheel for dumptruck (setup.py): started  Building wheel for dumptruck (setup.py): finished with status 'done'  Created wheel for dumptruck: filename=dumptruck-0.1.6-cp27-none-any.whl size=11845 sha256=efdb70489a9ff5a9dc08b5cf6aa3521711ad5e7917b550ac1a8914293daa4b2a  Stored in directory: /tmp/pip-ephem-wheel-cache-GDTIzV/wheels/57/df/83/32654ae89119876c7a7db66829bbdb646caa151589dbaf226e  Building wheel for scraperwiki (setup.py): started  Building wheel for scraperwiki (setup.py): finished with status 'done'  Created wheel for scraperwiki: filename=scraperwiki-0.3.7-cp27-none-any.whl size=5356 sha256=66d5d68f4b3b560199f2181ee69678fec1671bf84d16345addaf2dc79d1f4d87  Stored in directory: /tmp/pip-ephem-wheel-cache-GDTIzV/wheels/67/aa/60/947673312fec41a348bd21be4fe6dd01809babb07669613966  Successfully built dumptruck scraperwiki  Installing collected packages: beautifulsoup4, dumptruck, requests, scraperwiki  Successfully installed beautifulsoup4-4.5.1 dumptruck-0.1.6 requests-2.10.0 scraperwiki-0.3.7 DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support    -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... /app/.heroku/python/lib/python2.7/site-packages/bs4/__init__.py:181: UserWarning: No parser was explicitly specified, so I'm using the best available HTML parser for this system ("html.parser"). This usually isn't a problem, but if you run this code on another system, or in a different virtual environment, it may use a different parser and behave differently. The code that caused this warning is on line 433 of the file scraper.py. To get rid of this warning, change code that looks like this: BeautifulSoup([your markup]) to this: BeautifulSoup([your markup], "html.parser") markup_type=markup_type))

Data

Downloaded 25 times by rustyb jaymes88 MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (8.28 MB) Use the API

rows 10 / 19600

description info_url date_received council_reference postcode address comment_url
Permission for Retention of an existing development at this site.
2014-09-15
D14A/0598
No Postcode
Taylorsgrange Td, College Road, Rathfarnham, Co Dublin
Permission for Retention of 'as constructed' unauthorised boundary walls
2014-09-15
D14A/0597
No Postcode
Maranatha, Shanganagh Road, Dublin 18
Permission for a new extension (floor area 9 sqm) at first floor level to the
2014-09-15
D14B/0316
No Postcode
Trentham, Nerano Road, Dalkey, Co Dublin
Permission to demolish the existing rear conservatory and utility area
2014-09-15
D14B/0317
No Postcode
Lus Mor, Torquay Road, Foxrock, Co Dublin
Permission for the provision of a 2-storey, 2 bedroom mews house within
2014-09-15
D14A/0600
No Postcode
The Bungalow, Sandycove East Lane, Sandycove, Co Dublin
Compliance re condition nos. 6 & 11
2014-09-15
D13A/0091/C2
No Postcode
34, Drummartin Terrace, Goatstown, Dublin 14
Compliance re condition nos. 5 & 6
2014-09-15
D14A/0152/C1
No Postcode
Amgen Technology Ireland, Pottery Road, Dun Laoghaire, Co. Dublin
application of insulation / render system to external walls at 50 & 52 Trees Roa
2014-09-12
Ref 11914
No Postcode
50 & 52, Trees Road Lower, Mount Merrion, Co. Dublin
Permission Retention permission and planning permission. The application site
2014-09-12
D14A/0594
No Postcode
Saint Josephs Of Cluny School Secondary School, Avondale Road, Killiney, Co Dublin
Permission for a two storey extension to side of house currently under
2014-09-12
D14B/0315
No Postcode
7 Alderman Road, Belmont, Stepaside, Co Dublin

Statistics

Average successful run time: 1 minute

Total run time: 14 days

Total cpu time used: about 1 hour

Total disk space used: 8.48 MB

History

  • Auto ran revision 313cd533 and completed successfully .
    nothing changed in the database
  • Auto ran revision 313cd533 and completed successfully .
    nothing changed in the database
  • Auto ran revision 313cd533 and completed successfully .
    nothing changed in the database
  • Auto ran revision 313cd533 and completed successfully .
    nothing changed in the database
  • Auto ran revision 313cd533 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

dlrcoco-planning-apps / scraper.py