Contributors mlandauer Taz17

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping inner_west... Configuring filter by status... Filtering by status code L... Filtering by status code C... Configuring filter by application type... Filtering by application type code PDDA... Filtering by application type code PDDAEXTIME... Filtering by application type code PDDAMODS... Filtering by application type code PDDAPRELDG... Filtering by application type code PDDATREE... Expecting 668 applications in total Scrolled to 40... Scrolled to 80... Scrolled to 120... Scrolled to 160... Scrolled to 200... Scraping inner_west... Configuring filter by status... Filtering by status code L... Filtering by status code C... Configuring filter by application type... Filtering by application type code PDDA... Filtering by application type code PDDAEXTIME... Filtering by application type code PDDAMODS... Filtering by application type code PDDAPRELDG... Filtering by application type code PDDATREE... Expecting 668 applications in total Scrolled to 40... Scrolled to 80... Scrolled to 120... Scrolled to 160... Scrolled to 200... #0 0x560f77b2db13 <unknown>: invalid session id (Selenium::WebDriver::Error::InvalidSessionIdError) from #1 0x560f7793451f <unknown> from #2 0x560f7795ea7b <unknown> from #3 0x560f7798982c <unknown> from #4 0x560f779874e1 <unknown> from #5 0x560f77986d17 <unknown> from #6 0x560f7790c644 <unknown> from #7 0x560f7790d4a3 <unknown> from #8 0x560f77b752dd <unknown> from #9 0x560f77b792c7 <unknown> from #10 0x560f77b5f22e <unknown> from #11 0x560f77b7a0a8 <unknown> from #12 0x560f77b53bc0 <unknown> from #13 0x560f7790c1b9 <unknown> from #14 0x7f4f8d706f45 <unknown> from /app/vendor/bundle/ruby/2.5.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remote/response.rb:72:in `assert_ok' from /app/vendor/bundle/ruby/2.5.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remote/response.rb:34:in `initialize' from /app/vendor/bundle/ruby/2.5.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remote/http/common.rb:88:in `new' from /app/vendor/bundle/ruby/2.5.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remote/http/common.rb:88:in `create_response' from /app/vendor/bundle/ruby/2.5.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remote/http/default.rb:114:in `request' from /app/vendor/bundle/ruby/2.5.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remote/http/common.rb:64:in `call' from /app/vendor/bundle/ruby/2.5.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remote/bridge.rb:167:in `execute' from /app/vendor/bundle/ruby/2.5.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remote/w3c/bridge.rb:567:in `execute' from /app/vendor/bundle/ruby/2.5.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/remote/w3c/bridge.rb:556:in `find_elements_by' from /app/vendor/bundle/ruby/2.5.0/gems/selenium-webdriver-3.142.7/lib/selenium/webdriver/common/search_context.rb:80:in `find_elements' from /app/vendor/bundle/ruby/2.5.0/gems/capybara-3.35.3/lib/capybara/selenium/extensions/find.rb:17:in `find_by' from /app/vendor/bundle/ruby/2.5.0/gems/capybara-3.35.3/lib/capybara/selenium/extensions/find.rb:11:in `find_css' from /app/vendor/bundle/ruby/2.5.0/gems/capybara-3.35.3/lib/capybara/node/base.rb:109:in `find_css' from /app/vendor/bundle/ruby/2.5.0/gems/capybara-3.35.3/lib/capybara/queries/selector_query.rb:245:in `find_nodes_by_selector_format' from /app/vendor/bundle/ruby/2.5.0/gems/capybara-3.35.3/lib/capybara/queries/selector_query.rb:158:in `block in resolve_for' from /app/vendor/bundle/ruby/2.5.0/gems/capybara-3.35.3/lib/capybara/node/base.rb:77:in `synchronize' from /app/vendor/bundle/ruby/2.5.0/gems/capybara-3.35.3/lib/capybara/queries/selector_query.rb:157:in `resolve_for' from /app/vendor/bundle/ruby/2.5.0/gems/capybara-3.35.3/lib/capybara/node/element.rb:553:in `reload' from /app/vendor/bundle/ruby/2.5.0/gems/capybara-3.35.3/lib/capybara/node/base.rb:92:in `rescue in synchronize' from /app/vendor/bundle/ruby/2.5.0/gems/capybara-3.35.3/lib/capybara/node/base.rb:83:in `synchronize' from /app/vendor/bundle/ruby/2.5.0/gems/capybara-3.35.3/lib/capybara/node/element.rb:60:in `text' from scraper.rb:81:in `block (2 levels) in scrape' from scraper.rb:71:in `each' from scraper.rb:71:in `block in scrape' from scraper.rb:64:in `loop' from scraper.rb:64:in `scrape' from scraper.rb:126:in `block in <main>' from scraper.rb:124:in `each' from scraper.rb:124:in `<main>'

Data

Downloaded 467 times by openaustralia dcalde Taz17 muzzie86

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.46 MB) Use the API

rows 10 / 2795

council_reference address description info_url date_scraped date_received authority_label
DA/2021/0426
6/19 Nicholson Street BALMAIN EAST NSW 2041
Alterations and additions to rear ground floor of existing townhouse
2021-06-29 14:16:55 +1000
2021-05-31 13:34:10 +1000
inner_west
MOD/2021/0204
349 Liverpool Road ASHFIELD NSW 2131
Modification of approved massage parlour including restriction of trading hours to allow trading until midnight, signage and internal modification requirements.
2021-06-29 14:17:03 +1000
2021-05-26 13:24:26 +1000
inner_west
DA/2021/0405
13 Dudley Street HABERFIELD NSW 2045
Alterations and additions to existing dwelling including rear modifications and new carport
2021-06-29 14:17:04 +1000
2021-05-25 12:52:05 +1000
inner_west
PDA/2021/0190
5 Henry Street BALMAIN NSW 2041
Construction of detached studio in rear garden.
2021-06-29 14:17:06 +1000
2021-05-23 23:28:55 +1000
inner_west
PDA/2021/0182
96 Douglas Street STANMORE NSW 2048
To demolish part of the premises and carry out alterations and additions to a residential dual occupancy
2021-06-29 14:17:12 +1000
2021-05-14 15:14:51 +1000
inner_west
PDA/2021/0179
32 Fletcher Street MARRICKVILLE NSW 2204
Subdivision of existing lot into 3 Torrens Title lots. Construction of a dwelling on each lot with parking, landscaping and associated works.
2021-06-29 14:17:14 +1000
2021-05-13 10:26:54 +1000
inner_west
DA/2021/0373
22 Dickson Street NEWTOWN NSW 2042
Demolition of existing carport and construction of a studio at the rear.
2021-06-29 14:17:14 +1000
2021-05-12 15:35:02 +1000
inner_west
PDA/2021/0178
4 Warwick Street STANMORE NSW 2048
To demolish part of the premises and carry our ground and first floor alterations and additions to a dwelling house
2021-06-29 14:17:15 +1000
2021-05-12 13:11:33 +1000
inner_west
PDA/2021/0156
43 Reiby Street NEWTOWN NSW 2042
To demolish part of the premises and carry out ground and first floor alterations and additions to a dwelling house
2021-06-29 14:17:31 +1000
2021-04-30 09:44:12 +1000
inner_west
DA/2021/0270
37 Nicholson Street BALMAIN EAST NSW 2041
Strata Subdivision of the existing lot into 28 lots.
2021-06-29 14:17:36 +1000
2021-04-26 10:42:51 +1000
inner_west

Statistics

Average successful run time: 4 minutes

Total run time: 2 days

Total cpu time used: about 5 hours

Total disk space used: 1.53 MB

History

  • Auto ran revision 5269abad and failed .
    169 records added, 161 records removed in the database
  • Manually ran revision 5269abad and failed .
    164 records added, 163 records removed in the database
  • Manually ran revision 5269abad and failed .
    161 records added, 158 records removed in the database
  • Auto ran revision 8aa4569b and failed .
    166 records added, 155 records removed in the database
  • Auto ran revision 8aa4569b and failed .
    182 records added, 182 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_cianywhere / scraper.rb