This is a scraper that runs on Morph. To get started see the documentation

Contributors mlandauer equivalentideas henare ljnicol

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Skipping already saved record A004892134 Skipping already saved record A004892193 Skipping already saved record A004892418 scraper.rb:10:in `scrape_property_details': undefined method `text' for nil:NilClass (NoMethodError) from scraper.rb:36:in `block in scrape_page' from /app/vendor/bundle/ruby/1.9.1/gems/nokogiri-1.5.0/lib/nokogiri/xml/node_set.rb:239:in `block in each' from /app/vendor/bundle/ruby/1.9.1/gems/nokogiri-1.5.0/lib/nokogiri/xml/node_set.rb:238:in `upto' from /app/vendor/bundle/ruby/1.9.1/gems/nokogiri-1.5.0/lib/nokogiri/xml/node_set.rb:238:in `each' from scraper.rb:22:in `scrape_page' from scraper.rb:51:in `scrape_and_follow_next_link' from scraper.rb:86:in `<main>'

Data

Downloaded 6633 times by slav123 openaustralia LoveMyData TheZepto spatialsteve yourneighbourhood srsmonty dsccramb stevebrencorp peteclowes primin2 MikeRalphson ljnicol n1k0p0l ShawInnes newmana thinkpropertyjason bigsmaug

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (477 KB) Use the API

rows 10 / 900

info_url council_reference date_received description address date_scraped comment_url
A004868622
2018-03-01
Signs and Line Marking for Minor Roads
106 CONSIDINE ST ELLEN GROVE QLD 4078
2018-03-09
A004868759
2018-03-01
Multiple Dwelling, Extension, Multiple Dwelling, Demolition
14 FIFTH AVE SANDGATE QLD 4017
2018-03-09
A004871923
2018-03-01
Standard Format Plan
79 BROOKBENT RD PALLARA QLD 4110
2018-03-09
A004869372
2018-03-01
Standard Format Plan
7 HOOLAN ST STAFFORD QLD 4053
2018-03-09
A004872047
2018-03-01
Standard Format Plan
261 GOODERHAM RD WILLAWONG QLD 4110
2018-03-09
A004868803
2018-03-01
Outdoor Sport and Recreation, Extension
338 GOODERHAM RD N WILLAWONG QLD 4110
2018-03-09
A004868586
2018-03-01
Food and Drink Outlet, Office, Food and Drink Outlet, Office
22 ROSS ST NEWSTEAD QLD 4006
2018-03-09
A004869102
2018-03-02
Dwelling House, Extension, Dwelling House, Extension, Dwelling House, Demolition
66 PRIMROSE ST GRANGE QLD 4051
2018-03-09
A004869404
2018-03-02
Educational Establishment, Extension
109 NORTH RD WYNNUM WEST QLD 4178
2018-03-09
A004869449
2018-03-02
Filling and/or Excavation
59 DENHAM ST BRACKEN RIDGE QLD 4017
2018-03-09

Statistics

Average successful run time: 3 minutes

Total run time: 13 days

Total cpu time used: about 1 hour

Total disk space used: 513 KB

History

  • Auto ran revision a84c0485 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision a84c0485 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision a84c0485 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision a84c0485 and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision a84c0485 and failed .
    nothing changed in the database
    13 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

brisbane / scraper.rb