planningalerts-scrapers / gold_coast

Gold Coast City Council Development Applications

Scrapes pdonline.goldcoast.qld.gov.au

PD Online is part of a program of work funded by the federal government through AusIndustry and endorsed by the Council of Mayors (SEQ).


City of Gold Coast Council Scraper

This Council involves the followings

  • Server - Masterview, ApplicationMaster
  • Cookie - Yes
  • Scrape detail page - No
  • Clearly defined data within a row - Yes
  • JavaScript - Yes - doPostBack

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Forked from ScraperWiki

Contributors LoveMyData henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting 'thisweek' data, changable via MORPH_PERIOD environment Saving record OPW201800940, 8 WIRRANINA PLACE CURRUMBIN 4223 QLD Saving record BLD201804717, 30 COOLANGATTA ROAD COOLANGATTA 4225 QLD Saving record BLD201804699, 138 TAHITI AVENUE PALM BEACH 4221 QLD Saving record BLD201804702, 64 ALICIA STREET SOUTHPORT 4215 QLD Saving record BLD201804724, 78 GIBRALTAR DRIVE SURFERS PARADISE 4217 QLD Saving record BLD201804707, 5 BANYAN COURT ASHMORE 4214 QLD Saving record BLD201804704, 36 OLD BURLEIGH ROAD SURFERS PARADISE 4217 QLD Skipping already saved record BLD201804704 Skipping already saved record BLD201804704 Skipping already saved record BLD201804704 scraping for page 2 of 6 pages Skipping already saved record BLD201804704 Skipping already saved record BLD201804704 Skipping already saved record BLD201804704 Skipping already saved record BLD201804704 Skipping already saved record BLD201804704 Skipping already saved record BLD201804704 Saving record OPW201800941, 19 VATAKOULA PARADE MERMAID WATERS 4218 QLD Saving record BLD201804715, 5 CONDAMINE CRESCENT HELENSVALE 4212 QLD Saving record BLD201804719, 11 HARRIS COURT CURRUMBIN WATERS 4223 QLD Saving record BLD201804706, 353 HINKLER DRIVE WORONGARY 4213 QLD scraping for page 3 of 6 pages Saving record BLD201804701, 7 ILKINIA AVENUE BROADBEACH WATERS 4218 QLD Saving record BLD201804726, 123 MT NIMMEL ROAD AUSTINVILLE 4213 QLD Saving record ROL201800150, 58 BERRIGANS ROAD MUDGEERABA 4213 QLD Saving record BLD201804703, 42 LAVER DRIVE ROBINA 4226 QLD Saving record BLD201804705, 1501 / 56 SCARBOROUGH STREET SOUTHPORT 4215 QLD Saving record OPW201800921, 15 STADIUM DRIVE ROBINA 4226 QLD Saving record OPW201800922, 18 / 44 PINE VALLEY DRIVE ROBINA 4226 QLD Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Saving record BLD201804710, JOHN FRANCIS DRIVE CARRARA 4211 QLD scraping for page 4 of 6 pages Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 scraping for page 5 of 6 pages Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Skipping already saved record OPW201800922 Saving record OPW201800923, 22 LAMB STREET BROADBEACH WATERS 4218 QLD Saving record BLD201804696, 2 CASSIUS WAY ORMEAU 4208 QLD Saving record OPW201800924, 1 PARK COVE BOULEVARD HOPE ISLAND 4212 QLD scraping for page 6 of 6 pages Saving record BLD201804711, 1A WOODVALE DRIVE TALLAI 4213 QLD

Data

Downloaded 3819 times by slav123 openaustralia LoveMyData TheZepto equivalentideas primin2 dsccramb thinkpropertyjason thomas-deneux

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (14.7 MB) Use the API

rows 10 / 35416

date_scraped description info_url date_received council_reference address comment_url
2012-04-25
Description: Class: CODE Work Type:
2012-04-12
MCU201200186
7 KATTA AVENUE CURRUMBIN 4223
mailto:gcccmail@goldcoast.qld.gov.au?subject=Development+Application+Enquiry%3A+MCU201200186
2012-04-25
Description: ELEVATE EXISTING DWELLING AND RENOVATE Class: HOUSE Work Type: ALTERATIONS
2012-04-11
BLD201202570
27 RUTLEDGE STREET COOLANGATTA 4225
mailto:gcccmail@goldcoast.qld.gov.au?subject=Development+Application+Enquiry%3A+BLD201202570
2012-04-25
Description: BATHROOM & LAUNDRY RENOVATION Class: HOUSE Work Type: ALTERATIONS
2012-04-11
BLD201202551
4 STATION STREET TUGUN 4224
mailto:gcccmail@goldcoast.qld.gov.au?subject=Development+Application+Enquiry%3A+BLD201202551
2012-04-25
Description: DUPLEX Class: DUPLEX Work Type: CONSTRUCT
2012-04-19
BLD201202815
26 HOOPER DRIVE CURRUMBIN 4223
mailto:gcccmail@goldcoast.qld.gov.au?subject=Development+Application+Enquiry%3A+BLD201202815
2012-04-25
Description: CARPORT + DECK WITHIN SETBACKS Class: REFERRAL AGENCY ASSESSMENT Work Type: DESIGN AND SITING
2012-04-17
BLD201202737
37 MITCHELL AVENUE CURRUMBIN 4223
mailto:gcccmail@goldcoast.qld.gov.au?subject=Development+Application+Enquiry%3A+BLD201202737
2012-04-25
Description: Class: CODE Work Type: PERMISSIBLE CHANGE
2012-04-24
MCU201200212
27 MILLERS DRIVE CURRUMBIN 4223
mailto:gcccmail@goldcoast.qld.gov.au?subject=Development+Application+Enquiry%3A+MCU201200212
2012-04-25
Description: NEW DWELLING Class: HOUSE Work Type: CONSTRUCT
2012-04-04
BLD201202446
71 DIXON STREET COOLANGATTA 4225
mailto:gcccmail@goldcoast.qld.gov.au?subject=Development+Application+Enquiry%3A+BLD201202446
2012-04-25
Description: REPLACE AWNINGS AND UMBRELLA STRUCTURE Class: RETAIL/DINING/SERVICES Work Type: ALTERATIONS
2012-04-13
BLD201202640
48 MUSGRAVE STREET COOLANGATTA 4225
mailto:gcccmail@goldcoast.qld.gov.au?subject=Development+Application+Enquiry%3A+BLD201202640
2012-04-25
Description: COURTHOUSE - ENCLOSED CARPARKING & STOREROOM Class: OFFICE FITOUT Work Type: ALTERATIONS
2012-04-23
BLD201202912
MUSGRAVE STREET COOLANGATTA 4225
mailto:gcccmail@goldcoast.qld.gov.au?subject=Development+Application+Enquiry%3A+BLD201202912
2012-04-25
Description: HOUSE DEMOLITION Class: DEMOLITION Work Type: DEMOLISH
2012-04-04
BLD201202435
161 GOLDEN FOUR DRIVE BILINGA 4225
mailto:gcccmail@goldcoast.qld.gov.au?subject=Development+Application+Enquiry%3A+BLD201202435

Statistics

Average successful run time: less than a minute

Total run time: 16 days

Total cpu time used: about 1 hour

Total disk space used: 14.7 MB

History

  • Auto ran revision 159650d6 and completed successfully .
    23 records added in the database
    6 pages scraped
  • Auto ran revision 159650d6 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 159650d6 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 159650d6 and completed successfully .
    nothing changed in the database
    25 pages scraped
  • Auto ran revision 159650d6 and completed successfully .
    68 records added in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

gold_coast / scraper.rb