planningalerts-scrapers / cockburn

City of Cockburn Development Applications


City of Corkburn Council Scraper

This council involves the followings * Server - Microsoft * System - eProperty * Cookie tracking - Yes * Pagination - Yes * Javascript - Yes __doPostBack * Clearly defined data within a row - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default) * thismonth * lastmonth

Enjoy

Forked from ScraperWiki

Contributors LoveMyData equivalentideas mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0-p648 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/planningalerts-scrapers/technology_one_scraper.git  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Fetching public_suffix 2.0.5  Installing public_suffix 2.0.5  Using bundler 1.15.2  Fetching safe_yaml 1.0.5  Installing safe_yaml 1.0.5  Fetching unf_ext 0.0.7.6  Installing unf_ext 0.0.7.6 with native extensions  Fetching hashdiff 0.4.0  Installing hashdiff 0.4.0  Fetching httpclient 2.8.3  Installing httpclient 2.8.3  Fetching mime-types-data 3.2019.0331  Installing mime-types-data 3.2019.0331  Fetching net-http-digest_auth 1.4.1  Installing net-http-digest_auth 1.4.1  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.2  Installing webrobots 0.1.2  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching timecop 0.9.1  Installing timecop 0.9.1  Fetching vcr 5.0.0  Installing vcr 5.0.0  Fetching addressable 2.6.0  Installing addressable 2.6.0  Fetching crack 0.4.3  Installing crack 0.4.3  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.6.8.1  Installing nokogiri 1.6.8.1 with native extensions  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching webmock 3.6.0  Installing webmock 3.6.0  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Using technology_one_scraper 0.1.0 from https://github.com/planningalerts-scrapers/technology_one_scraper.git (at master@9dce7cf)  Bundle complete! 5 Gemfile dependencies, 27 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from hashdiff:  The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45.  Bundle completed (24.48s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data in `thismonth`, changable via MORPH_PERIOD environment Scraping page 1 of 13 Saving record BP19/0978, 80 Osprey Drive YANGEBUP WA 6164 Saving record BP19/0975, 16 Woolwich Way SUCCESS WA 6164 Saving record BP19/0976, 5 Woolwich Way SUCCESS WA 6164 Saving record BP19/0977, 17 Melbourne Loop HAMMOND PARK WA 6164 Saving record DA19/0387, 52 Entrance Road SPEARWOOD WA 6163 Saving record Permit19/0048, 27/60 Flourish Loop ATWELL WA 6164 Saving record DA19/0388, 11/40 Port Pirie Street BIBRA LAKE WA 6163 Saving record DA19/0389, 451L Railway Parade BIBRA LAKE WA 6163 Saving record BP19/0979, 4 Colonial Drive BIBRA LAKE WA 6163 Saving record BP19/0980, 37 Tamara Drive COCKBURN CENTRAL WA 6164 Saving record BP19/1007, 8 Staaten Street HAMMOND PARK WA 6164 Saving record BP19/0981, 15 Turnbury Park Drive JANDAKOT WA 6164 Saving record BP19/0982, 5 Melbourne Loop HAMMOND PARK WA 6164 Saving record BP19/0983, 16 La Fayette Boulevard BIBRA LAKE WA 6163 Saving record BP19/0984, 160 Elderberry Drive SOUTH LAKE WA 6164 Scraping page 2 of 13 Saving record BP19/0985, 64 Aquamarine Parade TREEBY WA 6164 Saving record BP19/0986, 5 Tamarind Road TREEBY WA 6164 Saving record BP19/0987, 623 Rockingham Road MUNSTER WA 6166 Saving record BP19/0988, 76 Aquamarine Parade TREEBY WA 6164 Saving record BP19/0989, 7 St Joseph Fairway SUCCESS WA 6164 Saving record BP19/0990, 45 Paddock Parade COCKBURN CENTRAL WA 6164 Saving record BP19/0991, 44 Hanbury Loop SUCCESS WA 6164 Saving record BP19/0992, 4 Colonial Drive BIBRA LAKE WA 6163 Saving record BP19/0993, 124 Quill Way HENDERSON WA 6166 Saving record BP19/0994, 11 Gosch Street HAMILTON HILL WA 6163 Saving record CL19/0071, 75L Prizmic Street BEELIAR WA 6164 Saving record CL19/0072, 65 Delaronde Drive SUCCESS WA 6164 Saving record DA19/0390, 119 Winfield Street HAMILTON HILL WA 6163 Saving record DA19/0391, 45 Boronia Road BANJUP WA 6164 Saving record DA19/0392, 3 Leece Street COOLBELLUP WA 6163 Scraping page 3 of 13 Saving record DA19/0393, 110 Rockingham Road HAMILTON HILL WA 6163 Saving record DA19/0394, 75 Rockingham Road HAMILTON HILL WA 6163 Saving record DA19/0395, 41 Glendower Way SPEARWOOD WA 6163 Saving record DA19/0396, 8/6 Geelong Court BIBRA LAKE WA 6163 Saving record DA19/0397, 45 Boronia Road BANJUP WA 6164 Saving record DA19/0398, 3 Colt Entrance COCKBURN CENTRAL WA 6164 Saving record DA19/0399, 1 Crystalline Road SPEARWOOD WA 6163 Saving record Permit19/0049, 13 Affable Way ATWELL WA 6164 Saving record Permit19/0050, 26/60 Flourish Loop ATWELL WA 6164 Saving record BP19/0995, 18 Quartz Road TREEBY WA 6164 Saving record BP19/0996, 40 Grande Crescent SUCCESS WA 6164 Saving record BP19/0997, 40 Grande Crescent SUCCESS WA 6164 Saving record BP19/0998, 5B Hanlon Street HAMILTON HILL WA 6163 Saving record BP19/0999, 11 Quartz Road TREEBY WA 6164 Saving record BP19/1000, 165 Whadjuk Drive HAMMOND PARK WA 6164 Scraping page 4 of 13 Saving record BP19/1001, 27 O`Connell Street HAMILTON HILL WA 6163 Saving record BP19/1002, 64 Massicot Road TREEBY WA 6164 Saving record BP19/1003, 7 St Joseph Fairway SUCCESS WA 6164 Saving record BP19/1004, 77 Johnsonia Bend HAMMOND PARK WA 6164 Saving record BP19/1005, 8 Bosworth Road HAMMOND PARK WA 6164 Saving record BP19/1006, 2 De Ceglie Street COOGEE WA 6166 Saving record BP19/1008, 13 Woolwich Way SUCCESS WA 6164 Saving record BP19/1009, 10 Yellowstone Grove SUCCESS WA 6164 Saving record BP19/1010, 22 Jervois Street BEELIAR WA 6164 Saving record BP19/1011, 9 Kotisina Gardens MUNSTER WA 6166 Saving record BP19/1012, 4 Opal Way TREEBY WA 6164 Saving record BP19/1013, 9 Criddle Way HAMMOND PARK WA 6164 Saving record BP19/1014, 74 Aquamarine Parade TREEBY WA 6164 Saving record BP19/1015, 8 Wisely Court AUBIN GROVE WA 6164 Saving record BP19/1016, 18 Grasstree Lane SUCCESS WA 6164 Scraping page 5 of 13 Saving record BP19/1017, 70 Muriel Court COCKBURN CENTRAL WA 6164 Saving record BP19/1018, 5 Nancy Way COOGEE WA 6166 Saving record BP19/1019, 17 Fulton Street HAMILTON HILL WA 6163 Saving record BP19/1020, 26 Deptford Street SUCCESS WA 6164 Saving record BP19/1021, 17 Fulton Street HAMILTON HILL WA 6163 Saving record BP19/1022, 16A Birbeck Way SPEARWOOD WA 6163 Saving record BP19/1023, 13 Podman Loop NORTH COOGEE WA 6163 Saving record BP19/1024, 9 Charnley Bend SUCCESS WA 6164 Saving record BP19/1025, 27 Jewel Gardens HAMMOND PARK WA 6164 Saving record BP19/1026, 25 Jewel Gardens HAMMOND PARK WA 6164 Saving record BP19/1027, 26 Sawle Road HAMILTON HILL WA 6163 Saving record BP19/1028, 10 Quartz Road TREEBY WA 6164 Saving record BP19/1029, 17 Ravello Vista YANGEBUP WA 6164 Saving record BP19/1030, 8 Staaten Street HAMMOND PARK WA 6164 Saving record BP19/1031, 45 Aquamarine Parade TREEBY WA 6164 Scraping page 6 of 13 Saving record BP19/1032, 122 Harper Road BANJUP WA 6164 Saving record BP19/1033, 4 Quarimor Road BIBRA LAKE WA 6163 Saving record BP19/1034, 43 Marwood Circuit SUCCESS WA 6164 Saving record BP19/1035, 70 Greensand Promenade TREEBY WA 6164 Saving record BP19/1036, 80 Greensand Promenade TREEBY WA 6164 Saving record BP19/1037, 72 Birchley Road BEELIAR WA 6164 Saving record CL19/0073, 12 Romeo Road COOLBELLUP WA 6163 Saving record CL19/0074, 9000L Wentworth Parade SUCCESS WA 6164 Saving record CL19/0075, 9546L Torwood Avenue TREEBY WA 6164 Saving record CL19/0076, 137 Blackwood Avenue HAMILTON HILL WA 6163 Saving record CL19/0077, 139 Forrest Road HAMILTON HILL WA 6163 Saving record CL19/0078, 34 Sebastian Crescent COOLBELLUP WA 6163 Saving record CL19/0079, 9037L Mudstone Road TREEBY WA 6164 Saving record DA19/0294, 125L Wattleup Road HAMMOND PARK WA 6164 Saving record DA19/0400, 1L Semple Court SOUTH LAKE WA 6164 Scraping page 7 of 13 Saving record DA19/0401, 70 Frederick Road HAMILTON HILL WA 6163 Saving record DA19/0402, 128 Holmes Road MUNSTER WA 6166 Saving record DA19/0403, 13 Devonshire Link NORTH COOGEE WA 6163 Saving record DA19/0404, 527A Rockingham Road MUNSTER WA 6166 Saving record DA19/0405, 4 Dotterel Way YANGEBUP WA 6164 Saving record DA19/0406, 94 Discovery Drive BIBRA LAKE WA 6163 Saving record DA19/0407, 82 Sparks Road HENDERSON WA 6166 Saving record DA19/0408, 28 Hanbury Loop SUCCESS WA 6164 Saving record DA19/0409, 17 Maxworthy Place HAMILTON HILL WA 6163 Saving record DA19/0410, 7 Ferdinand Crescent COOLBELLUP WA 6163 Saving record DA19/0411, 7 Kennon Court SPEARWOOD WA 6163 Saving record DA19/0412, 20 Crystalline Road SPEARWOOD WA 6163 Saving record DA19/0413, 7 Daviesia Turn SUCCESS WA 6164 Saving record DA19/0414, 5 Baxteri Way HAMMOND PARK WA 6164 Saving record DA19/0415, 14 Stanyford Place HAMILTON HILL WA 6163 Scraping page 8 of 13 Saving record DA19/0416, 40 Mosedale Retreat ATWELL WA 6164 Saving record DA19/0417, 40 Mosedale Retreat ATWELL WA 6164 Saving record DA19/0418, 7 Ferdinand Crescent COOLBELLUP WA 6163 Saving record DA19/0419, 24 Fawcett Road MUNSTER WA 6166 Saving record DP19/0038, 1 Timberyard Way BIBRA LAKE WA 6163 Saving record LDP19/22, 9042L Jandakot Road TREEBY WA 6164 Saving record LDP19/23, 81L McLaren Avenue BEELIAR WA 6164 Saving record BP19/1038, 218 Frankland Avenue HAMMOND PARK WA 6164 Saving record BP19/1039, 7 Daviesia Turn SUCCESS WA 6164 Saving record BP19/1040, 11 Capello Lane HAMMOND PARK WA 6164 Saving record BP19/1041, 18A Kent Street SPEARWOOD WA 6163 Saving record BP19/1042, 152 Holmes Road MUNSTER WA 6166 Saving record BP19/1043, 18B Kent Street SPEARWOOD WA 6163 Saving record BP19/1044, 15A Othello Quays NORTH COOGEE WA 6163 Saving record BP19/1045, 63 McPhee Road HAMMOND PARK WA 6164 Scraping page 9 of 13 Saving record BP19/1046, 2 Solitaire Road TREEBY WA 6164 Saving record BP19/1047, 29 Waitch Loop BEELIAR WA 6164 Saving record BP19/1048, 18A Kent Street SPEARWOOD WA 6163 Saving record BP19/1049, 123 Orsino Boulevard NORTH COOGEE WA 6163 Saving record BP19/1050, 13 Moondarra Circle SOUTH LAKE WA 6164 Saving record BP19/1051, 13 Recreation Road HAMILTON HILL WA 6163 Saving record BP19/1052, 52/100 Clementine Boulevard TREEBY WA 6164 Saving record BP19/1053, 21 Hanbury Loop SUCCESS WA 6164 Saving record BP19/1054, 56 Southwell Crescent HAMILTON HILL WA 6163 Saving record BP19/1055, 11 Welford Way SUCCESS WA 6164 Saving record BP19/1056, 12 Mercator Close NORTH COOGEE WA 6163 Saving record BP19/1057, 97 Hammond Road COCKBURN CENTRAL WA 6164 Saving record BP19/1058, 19 Chesterton Street SPEARWOOD WA 6163 Saving record BP19/1059, 53 Corsia Crescent HAMMOND PARK WA 6164 Saving record BP19/1060, 1 Columbus Loop SUCCESS WA 6164 Scraping page 10 of 13 Saving record BP19/1061, 59 Sylvan Crescent LEEMING WA 6149 Saving record BP19/1062, 5 Baxteri Way HAMMOND PARK WA 6164 Saving record BP19/1063, 54 Greensand Promenade TREEBY WA 6164 Saving record BP19/1064, 62 Duchart Way COOGEE WA 6166 Saving record BP19/1065, 19 Owsten Court TREEBY WA 6164 Saving record BP19/1066, 101 Turquoise Boulevard TREEBY WA 6164 Saving record BP19/1067, 14 Duchart Way COOGEE WA 6166 Saving record BP19/1068, 75 Barfield Road HAMMOND PARK WA 6164 Saving record BP19/1069, 58 Greensand Promenade TREEBY WA 6164 Saving record BP19/1070, 94 Discovery Drive BIBRA LAKE WA 6163 Saving record BP19/1071, 36 Helen Street HAMILTON HILL WA 6163 Saving record BP19/1072, 4 Citrus Loop SOUTH LAKE WA 6164 Saving record BP19/1073, 15 Hybrid Court TREEBY WA 6164 Saving record BP19/1074, 15 Hybrid Court TREEBY WA 6164 Saving record BP19/1075, 134 Orsino Boulevard NORTH COOGEE WA 6163 Scraping page 11 of 13 Saving record BP19/1076, 16 Dusky Court MUNSTER WA 6166 Saving record BP19/1077, 6 Voyageurs Way HAMMOND PARK WA 6164 Saving record BP19/1078, 10 Prizba Rise COOGEE WA 6166 Saving record BP19/1079, 7002L Abelia Road TREEBY WA 6164 Saving record BP19/1080, 1/9 Bilcich Gardens SPEARWOOD WA 6163 Saving record BP19/1081, 21 Mayhew Cross ATWELL WA 6164 Saving record BP19/1082, 122 Holmes Road MUNSTER WA 6166 Saving record BP19/1083, 78 Muriel Court COCKBURN CENTRAL WA 6164 Saving record BP19/1084, 20 Malvolio Road COOLBELLUP WA 6163 Saving record BP19/1085, 110 Mills Street COOGEE WA 6166 Saving record BP19/1086, 28 Bondi Way AUBIN GROVE WA 6164 Saving record CL19/0080, 68 Edeline Street SPEARWOOD WA 6163 Saving record DA19/0420, 239 Barrington Street BIBRA LAKE WA 6163 Saving record DA19/0421, 79/888 North Lake Road COCKBURN CENTRAL WA 6164 Saving record DA19/0422, 15 Solitaire Road TREEBY WA 6164 Scraping page 12 of 13 Saving record DA19/0423, SP 18/432 Rockingham Road SPEARWOOD WA 6163 Saving record DA19/0424, 1 Kiesey Street COOGEE WA 6166 Saving record DA19/0425, 27 Bradbury Road HAMILTON HILL WA 6163 Saving record DA19/0426, 97 Hammond Road COCKBURN CENTRAL WA 6164 Saving record DA19/0427, 17L Cockburn Road NORTH COOGEE WA 6163 Saving record DA19/0428, 60 Medina Parade NORTH COOGEE WA 6163 Saving record DA19/0429, 69A Healy Road HAMILTON HILL WA 6163 Saving record DA19/0430, 116 Cutler Road JANDAKOT WA 6164 Saving record DA19/0431, 60 Medina Parade NORTH COOGEE WA 6163 Saving record DA19/0432, 116 Cutler Road JANDAKOT WA 6164 Saving record DA19/0433, 2/2 Points Way COCKBURN CENTRAL WA 6164 Saving record DA19/0434, 11 Hermione Way COOLBELLUP WA 6163 Saving record DA19/0435, 3/401 Rockingham Road SPEARWOOD WA 6163 Saving record DA19/0436, 81 Mason Court SOUTH LAKE WA 6164 Saving record DA19/0437, 3/401 Rockingham Road SPEARWOOD WA 6163 Scraping page 13 of 13 Saving record DA19/0438, 115 Turquoise Boulevard TREEBY WA 6164 Saving record DA19/0439, 136A Britannia Avenue BEELIAR WA 6164 Saving record DA19/0440, 1 Arthur Road HAMILTON HILL WA 6163 Saving record DA19/0441, 2/451 Yangebup Road COCKBURN CENTRAL WA 6164 Saving record DA19/0442, 12 Romeo Road COOLBELLUP WA 6163 Saving record DA19/0443, 21 Birbeck Way SPEARWOOD WA 6163 Saving record DP19/0039, 2 Rosalind Way COOLBELLUP WA 6163 Saving record Permit19/0051, 11/23 Junction Boulevard COCKBURN CENTRAL WA 6164 Saving record SU19/0069, 9 Coleville Crescent SPEARWOOD WA 6163 Saving record SU19/0070, 9 Coleville Crescent SPEARWOOD WA 6163

Data

Downloaded 1988 times by openaustralia LoveMyData jesse-a-reilly TheZepto MikeRalphson Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.82 MB) Use the API

rows 10 / 5246

date_scraped description info_url date_received council_reference address comment_url
2011-09-10
MEZZANINE FLOOR
2011-09-05
DA11/0698
12 Horus Bend, BIBRA LAKE, WA
mailto:masterplan@cockburn.wa.gov.au
2011-09-10
SHED
2011-09-05
DA11/0701
6A Angus Avenue, SPEARWOOD, WA
mailto:masterplan@cockburn.wa.gov.au
2011-09-10
RETAINING WALL
2011-09-05
DA11/0702
21 Fairmount Close, BIBRA LAKE, WA
mailto:masterplan@cockburn.wa.gov.au
2011-09-10
SINGLE DWELLING
2011-09-06
DA11/0699
6 Cadiz Place, COOGEE, WA
mailto:masterplan@cockburn.wa.gov.au
2011-09-10
RETAINING WALL
2011-09-06
DA11/0703
15 Tanunda Road, COOGEE, WA
mailto:masterplan@cockburn.wa.gov.au
2011-09-10
RETROSPECTIVE CHANGE OF USE FOR MECHANICAL WORKSHOP
2011-09-06
DA11/0704
1 / 68 Solomon Road, JANDAKOT, WA
mailto:masterplan@cockburn.wa.gov.au
2011-09-10
Grouped (R-Code) Dwelling
2011-09-06
DA11/0705
30 / 26 Charnley Bend, HAMMOND PARK, WA
mailto:masterplan@cockburn.wa.gov.au
2011-09-10
SINGLE R-CODE HOUSE VARIATIONS
2011-09-06
DA11/0708
271 Spearwood Avenue, SPEARWOOD, WA
mailto:masterplan@cockburn.wa.gov.au
2011-09-10
TEMPORARY SOIL TREATMENT FACILITY
2011-09-06
DA11/0710
27L Wattleup Road, WATTLEUP, WA
mailto:masterplan@cockburn.wa.gov.au
2011-09-10
LIMESTONE PLANTER BOX, RETAINING WALL AND SHED
2011-09-08
DA11/0707
10 Adromeda Link, AUBIN GROVE, WA
mailto:masterplan@cockburn.wa.gov.au

Statistics

Average successful run time: less than a minute

Total run time: 8 days

Total cpu time used: 44 minutes

Total disk space used: 2.22 MB

History

  • Auto ran revision afbede20 and completed successfully .
    190 records added, 61 records removed in the database
  • Auto ran revision a3237805 and completed successfully .
    nothing changed in the database
  • Auto ran revision a3237805 and completed successfully .
    nothing changed in the database
  • Auto ran revision a3237805 and completed successfully .
    15 records added, 15 records removed in the database
  • Auto ran revision a3237805 and completed successfully .
    15 records added, 15 records removed in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

cockburn / scraper.rb