Wyong Council Scraper

  • Server - .NET
  • Cookie tracking - Yes
  • Pagnation - No
  • Javascript - Yes
  • Clearly defined data within a row - Sort of

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData mlandauer

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 1498 times by LoveMyData dcalde

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.64 MB) Use the API

rows 10 / 4500

info_url council_reference date_received description address date_scraped comment_url
DA - 618 / 2017
2017-05-22
Shed
63 Imga Street GWANDALAN NSW 2259
2017-05-24
mailto:wsc@wyong.nsw.gov.au
DA - 619 / 2017
2017-05-22
Alterations & additions
395 Tuggerawong Road TUGGERAWONG NSW 2259
2017-05-24
mailto:wsc@wyong.nsw.gov.au
DA - 621 / 2017
2017-05-22
Dwelling
219 Lakedge Avenue BERKELEY VALE NSW 2261
2017-05-24
mailto:wsc@wyong.nsw.gov.au
DA - 622 / 2017
2017-05-22
Exhibition home
24 Virginia Road HAMLYN TERRACE NSW 2259
2017-05-24
mailto:wsc@wyong.nsw.gov.au
DA - 623 / 2017
2017-05-22
Inground Pool
62 Pebble Beach Avenue MAGENTA NSW 2261
2017-05-24
mailto:wsc@wyong.nsw.gov.au
DA - 624 / 2017
2017-05-22
Inground pool
36 Jane Ellen Cres CHITTAWAY BAY NSW 2261
2017-05-24
mailto:wsc@wyong.nsw.gov.au
DA - 625 / 2017
2017-05-22
Exhibition Home
26 Virginia Road HAMLYN TERRACE NSW 2259
2017-05-24
mailto:wsc@wyong.nsw.gov.au
DA - 626 / 2017
2017-05-22
Commercial additions
1-11 Alison Road WYONG NSW 2259
2017-05-24
mailto:wsc@wyong.nsw.gov.au
DA - 627 / 2017
2017-05-22
Inground pool
26 Leonard Avenue TOUKLEY NSW 2263
2017-05-24
mailto:wsc@wyong.nsw.gov.au
DA - 628 / 2017
2017-05-23
Dwelling
26 Yackerboom Avenue BUFF POINT NSW 2262
2017-05-24
mailto:wsc@wyong.nsw.gov.au

Statistics

Average successful run time: less than a minute

Total run time: 2 days

Total cpu time used: 35 minutes

Total disk space used: 1.67 MB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wyong / scraper.rb