planningalerts-scrapers / bogan

Bogan Development Applications


Bogan Shire Council Scraper

  • Server - Unknown but I like it
  • Cookie tracking - Yes
  • Agreement - Yes
  • Pagnation - No
  • JSON - Yes - Yay....

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default, today -10 days)
  • thismonth
  • lastmonth
  • year (eg. 2016)

Enjoy

Contributors CloCkWeRX LoveMyData mlandauer jamezpolley

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data between 07/06/2019 and 17/06/2019, changable via MORPH_PERIOD environment Saving record DA 2019/14 - 80 Wambiana St, Nyngan 2825 NSW Saving record OCC 2019/14 - 80 Wambiana St, Nyngan 2825 NSW Saving record CONS 2019/14 - 80 Wambiana St, Nyngan 2825 NSW Saving record DA 2019/13 - 710 Hickey's Rd, Nyngan 2825 NSW Saving record SUBD 2019/13 - 710 Hickey's Rd, Nyngan 2825 NSW

Data

Downloaded 574 times by LoveMyData DevAppProject openaustralia WilliamYun TheZepto jesse-a-reilly MikeRalphson Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (39 KB) Use the API

rows 10 / 112

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to
010.2016.00000018.001
27 Ellen St, Nyngan, NSW 2825
New Garage/Carport/Pergola/Shed
2016-08-03
2016-08-02
010.2016.00000020.001
13 Mudal St, Nyngan, NSW 2825
New Dual Occupancy
2016-09-06
2016-09-02
010.2016.00000023.001
31 Dandaloo St, Nyngan, NSW 2825
New Garage and Relocation of Pergola
2016-09-15
2016-09-15
010.2016.00000022.001
876 Barrier Hwy, NYNGAN, NSW 2825
New Education Building
2016-09-15
2016-09-12
010.2016.00000024.001
Lawlor St, NYNGAN, NSW 2825
New Industrial Building
2016-09-27
2016-09-26
010.2017.00000006.001
54 Oatley St, Nyngan, NSW 2825
New Transportable Dwelling
2017-04-10
2017-03-14
2017-04-10
2017-04-21
DA 2017/34
51-57 Flashman Ave, Nyngan 2825 NSW
New Single Dwelling
mailto:admin@bogan.nsw.gov.au
2017-10-29
2017-10-27
DA 2017/33
5 Cathundril St, Nyngan 2825 NSW
Mobile Vending Vehicle
mailto:admin@bogan.nsw.gov.au
2017-10-29
2017-10-26
DA 2017/35
50-52 Cannonbar St, Nyngan 2825 NSW
New Garage/Carport/Pergola/Shed
mailto:admin@bogan.nsw.gov.au
2017-11-22
2017-11-22
CONS 2017/35
50-52 Cannonbar St, Nyngan 2825 NSW
New Garage/Carport/Pergola/Shed
mailto:admin@bogan.nsw.gov.au
2017-11-22
2017-11-22

Statistics

Average successful run time: less than a minute

Total run time: 1 day

Total cpu time used: 12 minutes

Total disk space used: 77.6 KB

History

  • Auto ran revision 89109267 and completed successfully .
    5 records added, 5 records removed in the database
  • Auto ran revision 89109267 and completed successfully .
    5 records added, 5 records removed in the database
  • Auto ran revision 89109267 and completed successfully .
    5 records added, 5 records removed in the database
  • Auto ran revision 89109267 and completed successfully .
    5 records added, 5 records removed in the database
  • Auto ran revision 89109267 and completed successfully .
    5 records added, 5 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

bogan / scraper.php