Contributors mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby/Rack -----> Using Ruby version: ruby-2.5.8 -----> Installing dependencies using bundler version 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.......  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching concurrent-ruby 1.1.9  Fetching minitest 5.14.4  Fetching zeitwerk 2.4.2  Installing zeitwerk 2.4.2  Installing minitest 5.14.4  Installing concurrent-ruby 1.1.9  Fetching public_suffix 4.0.6  Installing public_suffix 4.0.6  Using bundler 1.15.2  Fetching mini_mime 1.1.0  Installing mini_mime 1.1.0  Fetching mini_portile2 2.5.3  Installing mini_portile2 2.5.3  Fetching racc 1.5.2  Installing racc 1.5.2 with native extensions  Fetching rack 2.2.3  Installing rack 2.2.3  Fetching regexp_parser 2.1.1  Installing regexp_parser 2.1.1  Fetching childprocess 3.0.0  Installing childprocess 3.0.0  Fetching httpclient 2.8.3  Installing httpclient 2.8.3  Fetching rubyzip 2.3.0  Fetching sqlite3 1.4.2  Installing sqlite3 1.4.2 with native extensions  Installing rubyzip 2.3.0  Fetching addressable 2.7.0  Installing addressable 2.7.0  Fetching rack-test 1.1.0  Installing rack-test 1.1.0  Fetching i18n 1.8.10  Installing i18n 1.8.10  Fetching tzinfo 2.0.4  Installing tzinfo 2.0.4  Fetching selenium-webdriver 3.142.7  Installing selenium-webdriver 3.142.7  Fetching launchy 2.5.0  Installing launchy 2.5.0  Fetching activesupport 6.1.4  Installing activesupport 6.1.4  Fetching nokogiri 1.11.7 (x86_64-linux)  Installing nokogiri 1.11.7 (x86_64-linux)  Fetching xpath 3.2.0  Installing xpath 3.2.0  Fetching capybara 3.35.3  Installing capybara 3.35.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 5 Gemfile dependencies, 26 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (9.19s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Configuring filter... Filtering by code PDDA... Filtering by code PDDAEXTIME... Filtering by code PDDAMODS... Filtering by code PDDAPRELDG... Filtering by code PDDATREE... Expecting 572 applications in total Scrolled to 40... Scrolled to 80... Scrolled to 120... Scrolled to 160... Scrolled to 200... Scrolled to 240... Scrolled to 280... Scrolled to 320... Scrolled to 360... Scrolled to 400... Scrolled to 440... Scrolled to 480... Scrolled to 520... Scrolled to 560... Scrolled to 572...

Data

Downloaded 143 times by openaustralia dcalde

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (540 KB) Use the API

rows 10 / 1030

council_reference address description info_url date_scraped date_received authority_label
DA/2021/0426
6/19 Nicholson Street BALMAIN EAST NSW 2041
Alterations and additions to rear ground floor of existing townhouse
2021-06-29 14:16:55 +1000
2021-05-31 13:34:10 +1000
inner_west
MOD/2021/0204
349 Liverpool Road ASHFIELD NSW 2131
Modification of approved massage parlour including restriction of trading hours to allow trading until midnight, signage and internal modification requirements.
2021-06-29 14:17:03 +1000
2021-05-26 13:24:26 +1000
inner_west
DA/2021/0405
13 Dudley Street HABERFIELD NSW 2045
Alterations and additions to existing dwelling including rear modifications and new carport
2021-06-29 14:17:04 +1000
2021-05-25 12:52:05 +1000
inner_west
PDA/2021/0190
5 Henry Street BALMAIN NSW 2041
Construction of detached studio in rear garden.
2021-06-29 14:17:06 +1000
2021-05-23 23:28:55 +1000
inner_west
PDA/2021/0182
96 Douglas Street STANMORE NSW 2048
To demolish part of the premises and carry out alterations and additions to a residential dual occupancy
2021-06-29 14:17:12 +1000
2021-05-14 15:14:51 +1000
inner_west
PDA/2021/0179
32 Fletcher Street MARRICKVILLE NSW 2204
Subdivision of existing lot into 3 Torrens Title lots. Construction of a dwelling on each lot with parking, landscaping and associated works.
2021-06-29 14:17:14 +1000
2021-05-13 10:26:54 +1000
inner_west
DA/2021/0373
22 Dickson Street NEWTOWN NSW 2042
Demolition of existing carport and construction of a studio at the rear.
2021-06-29 14:17:14 +1000
2021-05-12 15:35:02 +1000
inner_west
PDA/2021/0178
4 Warwick Street STANMORE NSW 2048
To demolish part of the premises and carry our ground and first floor alterations and additions to a dwelling house
2021-06-29 14:17:15 +1000
2021-05-12 13:11:33 +1000
inner_west
PDA/2021/0156
43 Reiby Street NEWTOWN NSW 2042
To demolish part of the premises and carry out ground and first floor alterations and additions to a dwelling house
2021-06-29 14:17:31 +1000
2021-04-30 09:44:12 +1000
inner_west
DA/2021/0270
37 Nicholson Street BALMAIN EAST NSW 2041
Strata Subdivision of the existing lot into 28 lots.
2021-06-29 14:17:36 +1000
2021-04-26 10:42:51 +1000
inner_west

Statistics

Average successful run time: 4 minutes

Total run time: 1 day

Total cpu time used: about 1 hour

Total disk space used: 577 KB

History

  • Auto ran revision 78bed74f and completed successfully .
    557 records added, 542 records removed in the database
  • Auto ran revision 78bed74f and failed .
    168 records added, 158 records removed in the database
  • Auto ran revision 78bed74f and failed .
    169 records added, 155 records removed in the database
  • Auto ran revision 78bed74f and failed .
    157 records added, 150 records removed in the database
  • Auto ran revision 78bed74f and failed .
    176 records added, 176 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_cianywhere / scraper.rb