planningalerts-scrapers / camden

Camden Council Development Applications


Camden Council Scraper

Camden Council involves the followings

  • Server - Unknown but I like it
  • Cookie tracking - Yes
  • Pagnation - No
  • JSON - Yes - Yay....

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default, today -10 days)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData equivalentideas henare

The scraper is running. It was queued automatically .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.json; requirements  from dependencies in composer.lock will be used for selection  - php (7.2.12)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.37) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 4 installs, 0 updates, 0 removals  - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (100%)   - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (100%)   - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (100%)   - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data between 30/11/2018 and 10/12/2018, changable via MORPH_PERIOD environment

Data

Downloaded 1231 times by openaustralia jesse-a-reilly TheZepto MikeRalphson AnthonyKunz razz969 derman232 Horizons444 jayzhouny ajoh3691

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (4.84 MB) Use the API

rows 10 / 15148

id council_reference address description info_url comment_url date_scraped date_received
1
1466.1/2015
1 1 3 Lone Pine Pl,SMEATON GRANGE, NSW, Australia
New Change Of Use
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1466.1/2015
2015-12-14
2015-12-14
2
1468.1/2015
7 Fernleigh CT,COBBITTY, NSW, Australia
New Dwelling - Single Storey
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1468.1/2015
2015-12-14
2015-12-14
3
1469.1/2015
28 Rover ST,LEPPINGTON, NSW, Australia
New Dwelling - Two Storey and New Swimming Pool - Fibreglass New Dwelling - Two Storey New Swimming Pool - Fibreglass
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1469.1/2015
2015-12-14
2015-12-14
4
1546.3/2010
43 Healy AV,GREGORY HILLS, NSW, Australia
DA Modification (amendment to Vegetation Management Plan) - SEE DA/2010/1548/4 FOR FEES
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1546.3/2010
2015-12-14
2015-11-02
5
1306.1/2015
19 Long Bush RL,COBBITTY, NSW, Australia
New Dwelling - Single Storey
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1306.1/2015
2015-12-14
2015-11-02
6
1307.1/2015
10 Horne ST,COBBITTY, NSW, Australia
Two storey dwelling
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1307.1/2015
2015-12-14
2015-11-02
7
1308.1/2015
55 Holden DR,ORAN PARK, NSW, Australia
Construction of a Double Storey Dwelling & attached Granny Flat
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1308.1/2015
2015-12-14
2015-11-02
8
1311.1/2015
53 The Straight,ORAN PARK, NSW, Australia
New Dwelling - Single Storey
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1311.1/2015
2015-12-14
2015-11-02
9
1312.1/2015
55 Amberley ST,GLEDSWOOD HILLS, NSW, Australia
Construction of a Two Storey Dwelling
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1312.1/2015
2015-12-14
2015-11-02
10
1313.1/2015
29 Long Bush RL,COBBITTY, NSW, Australia
Construction of a Two Storey Dwelling
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1313.1/2015
2015-12-14
2015-11-02

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: 11 minutes

Total disk space used: 4.95 MB

History

  • Auto ran revision e6dc97b0 and completed successfully .
    89 records added, 1 record updated in the database
    2 pages scraped
  • Auto ran revision e6dc97b0 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision e6dc97b0 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision e6dc97b0 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision e6dc97b0 and completed successfully .
    32 records added, 1 record updated in the database
    2 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

camden / scraper.php