planningalerts-scrapers / multiple_epathway_scraper

Scrape multiple authorities with epathway scraper


This is a scraper that runs on Morph. To get started see the documentation

Contributors mlandauer jamezpolley

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.5.1 -----> Installing dependencies using bundler version 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/planningalerts-scrapers/epathway_scraper.git  Fetching public_suffix 3.1.1  Using bundler 1.15.2  Fetching connection_pool 2.2.2  Fetching safe_yaml 1.0.5  Installing connection_pool 2.2.2  Installing safe_yaml 1.0.5  Installing public_suffix 3.1.1  Fetching unf_ext 0.0.7.6  Installing unf_ext 0.0.7.6 with native extensions  Fetching mime-types-data 3.2019.1009  Installing mime-types-data 3.2019.1009  Fetching net-http-digest_auth 1.4.1  Installing net-http-digest_auth 1.4.1  Fetching mini_portile2 2.4.0  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Installing mini_portile2 2.4.0  Fetching webrobots 0.1.2  Installing webrobots 0.1.2  Fetching httpclient 2.8.3  Fetching sqlite3 1.4.1  Installing sqlite3 1.4.1 with native extensions  Installing httpclient 2.8.3  Fetching hashdiff 1.0.0  Installing hashdiff 1.0.0  Fetching timecop 0.9.1  Installing timecop 0.9.1  Fetching vcr 5.0.0  Installing vcr 5.0.0  Fetching net-http-persistent 3.1.0  Installing net-http-persistent 3.1.0  Fetching addressable 2.6.0  Installing addressable 2.6.0  Fetching crack 0.4.3  Installing crack 0.4.3  Fetching mime-types 3.3  Installing mime-types 3.3  Fetching nokogiri 1.10.5  Installing nokogiri 1.10.5 with native extensions  Fetching webmock 3.6.2  Installing webmock 3.6.2  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20190701  Installing domain_name 0.5.20190701  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Using epathway_scraper 0.1.0 from https://github.com/planningalerts-scrapers/epathway_scraper.git (at master@74a6b5e)  Bundle complete! 5 Gemfile dependencies, 28 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (30.52s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 6252 times by openaustralia DevAppProject mlandauer jesse-a-reilly

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (9.64 MB) Use the API

rows 10 / 25089

council_reference address description info_url date_scraped date_received authority_label on_notice_from on_notice_to
3335/2018/DA-M
41 Maidenhair Avenue, DENHAM COURT NSW 2565
Construction of a two storey attached dual occupancy and Torrens title subdivision into two allotments
2019-06-05
2018-09-24
campbelltown
2254/2013/DA-CW/A
Lot 3003 Stowe Avenue, CAMPBELLTOWN NSW 2560
Modification of an existing development consent for the construction of a park
2019-06-05
2019-01-22
campbelltown
1040/2016/DA-U/B
170 Menangle Road, MENANGLE PARK NSW 2563
Modification to construct an external addition comprising of cool rooms, store rooms, freezer room, kitchen and loading zone
2019-06-05
2019-03-01
campbelltown
1040/2016/DA-U/C
170 Menangle Road, MENANGLE PARK NSW 2563
Alterations to function centre and bathrooms
2019-06-05
2019-03-01
campbelltown
1802/2019/DA-SW
107 St Johns Road, BRADBURY NSW 2560
Subdivision to create two allotments and construction of a carport and ancillary structure and associated driveways
2019-06-05
2019-05-29
campbelltown
PLP/2019/124
36 Icon Drive, DELACOMBE VIC 3356
Use of the land for place of assembly (fitness studio) and a reduction car parking
2019-06-05
2019-02-21
ballarat
GE/VS-96/2019
13-14 Sir John Monash Drive CAULFIELD EAST VIC 3145
Buildings and works to existing KFC Restaurant including alterations to signage on Commercial 1 Zone land affected by the Heritage Overlay
2019-06-05
2019-05-06
glen_eira
GE/PP-22788/2010/C
304 Hawthorn Road CAULFIELD VIC 3162
1. Use of the land at 304 Hawthorn Road, Caulfield for the purpose of a place of assembly (library) and associated car parking, construction of buildings and works and alter access to a road within a Road Zone, Category 1 2. Construction of buildings and works, reduction in the car parking requirement associated with the office use and alter access to a road within a Road Zone, Category 1 on land at 306 Hawthorn Road, Caulfield
2019-06-05
2019-05-06
glen_eira
GE/PP-30985/2017/A
214 Bambra Road CAULFIELD SOUTH VIC 3162
Additions and alterations to dwelling on a lot less than 300m2 Proposed amendment: Single storey extension in lieu of previously approved double storey extension
2019-06-05
2019-05-06
glen_eira
GE/PP-32827/2019
2 Rosella Street MURRUMBEENA VIC 3163
3 Lot Subdivision
2019-06-05
2019-05-06
glen_eira

Statistics

Average successful run time: 35 minutes

Total run time: 5 days

Total cpu time used: about 1 hour

Total disk space used: 31.2 MB

History

  • Auto ran revision 52fd8467 and completed successfully .
    nothing changed in the database
  • Auto ran revision 52fd8467 and completed successfully .
    9974 records added, 9664 records removed in the database
  • Auto ran revision 52fd8467 and completed successfully .
    9885 records added, 9851 records removed in the database
  • Auto ran revision 52fd8467 and completed successfully .
    9859 records added, 9688 records removed in the database
  • Auto ran revision 52fd8467 and completed successfully .
    9813 records added, 9614 records removed in the database
  • ...
  • Created on morph.io

Show complete history