planningalerts-scrapers / camden

Camden Council Development Applications

Scrapes planning.camden.nsw.gov.au

MasterView 2.0 Application Master


Camden Council Scraper

Camden Council involves the followings

  • Server - Unknown but I like it
  • Cookie tracking - Yes
  • Pagnation - No
  • JSON - Yes - Yay....

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default, today -10 days)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData equivalentideas henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.json; requirements  from dependencies in composer.lock will be used for selection  - php (7.2.6)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.33) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 4 installs, 0 updates, 0 removals  - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (100%)   - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (100%)   - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (100%)   - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data between 17/05/2018 and 27/05/2018, changable via MORPH_PERIOD environment Getting data between 17/05/2018 and 27/05/2018, changable via MORPH_PERIOD environment Skipping already saved record DA/2018/599/1 Skipping already saved record OC/2015/360/2 Skipping already saved record S96/2017/200/2 Skipping already saved record EngCC/2017/1324/2 Skipping already saved record S96/2009/838/6 Skipping already saved record CC/2015/1508/6 Skipping already saved record CDC/2018/816/1 Skipping already saved record EngCC/2017/1319/1 Skipping already saved record EngCC/2016/949/11 Skipping already saved record CC/2017/1446/1 Skipping already saved record OC/2017/1225/1 Skipping already saved record CDC/2018/815/1 Skipping already saved record OC/2017/1509/1 Skipping already saved record DA/2018/613/1 Skipping already saved record OC/2017/1594/2 Skipping already saved record CDC/2018/814/1 Skipping already saved record OC/2017/1002/3 Skipping already saved record OC/2016/1116/2 Skipping already saved record CDC/2018/809/1 Skipping already saved record OC/2017/863/1 Skipping already saved record OC/2017/1579/1 Skipping already saved record OC/2017/1404/1 Skipping already saved record CDC/2018/813/1 Skipping already saved record OC/2017/1383/1 Skipping already saved record OC/2017/1823/1 Skipping already saved record OC/2017/668/1 Skipping already saved record OC/2017/979/1 Skipping already saved record OC/2017/1574/1 Skipping already saved record CDC/2018/812/1 Skipping already saved record OC/2017/377/2 Skipping already saved record CDC/2018/811/1 Skipping already saved record CDC/2018/810/1 Skipping already saved record DA/2018/612/1 Skipping already saved record CDC/2018/808/1 Skipping already saved record DA/2018/611/1 Skipping already saved record CDC/2018/807/1 Skipping already saved record DA/2018/610/1 Skipping already saved record CDC/2018/806/1 Skipping already saved record OC/2017/1546/2 Skipping already saved record OC/2017/368/2 Skipping already saved record S96/2016/1100/2 Skipping already saved record S96/2017/795/2 Skipping already saved record S96/2015/628/2 Skipping already saved record CDC/2018/805/1 Skipping already saved record SC/2017/1265/1 Skipping already saved record CDC/2018/804/1 Skipping already saved record CDC/2018/803/1 Skipping already saved record CDC/2018/802/1 Skipping already saved record CDC/2018/801/1 Skipping already saved record CC/2018/113/1 Skipping already saved record CC/2018/509/1 Skipping already saved record CDC/2018/800/1 Skipping already saved record CC/2018/326/1 Skipping already saved record SC/2017/1266/1 Skipping already saved record OC/2017/1253/1 Skipping already saved record S96/2017/355/3 Skipping already saved record DA/2018/609/1 Skipping already saved record CC/2018/609/1 Skipping already saved record OC/2017/1311/1 Skipping already saved record CDC/2018/799/1 Skipping already saved record OC/2016/747/2 Skipping already saved record OC/2017/433/3 Skipping already saved record OC/2016/743/2 Skipping already saved record CDC/2018/798/1 Skipping already saved record OC/2016/1357/3 Skipping already saved record CC/2018/323/1 Skipping already saved record CC/2018/505/1 Skipping already saved record OC/2016/1431/2 Skipping already saved record DA/2018/608/1 Skipping already saved record CC/2018/608/1 Skipping already saved record CC/2017/1477/1 Skipping already saved record OC/2016/1206/2 Skipping already saved record DA/2018/601/1 Skipping already saved record OC/2017/241/1 Skipping already saved record CC/2018/176/2 Skipping already saved record DA/2018/607/1 Skipping already saved record DA/2018/597/1 Skipping already saved record DA/2018/606/1 Skipping already saved record OC/2016/1214/2 Skipping already saved record S96/2015/910/4 Skipping already saved record CC/2018/322/1 Skipping already saved record S96/2017/704/2 Skipping already saved record OC/2017/1034/2 Skipping already saved record OC/2017/1116/2 Skipping already saved record OC/2017/965/2 Skipping already saved record OC/2017/2287/1 Skipping already saved record OC/2017/1963/1 Skipping already saved record OC/2016/1351/2 Skipping already saved record OC/2016/2038/2 Skipping already saved record CDC/2018/797/1 Skipping already saved record CDC/2018/796/1 Skipping already saved record DA/2018/602/1 Skipping already saved record OC/2018/49/1 Skipping already saved record DA/2018/596/1 Skipping already saved record DA/2018/605/1 Skipping already saved record CC/2018/369/1 Skipping already saved record CC/2018/371/1 Skipping already saved record DA/2018/604/1 Skipping already saved record DA/2018/600/1 Skipping already saved record OC/2017/2014/1 Skipping already saved record CDC/2018/795/1 Skipping already saved record OC/2018/156/1 Skipping already saved record DA/2018/588/1 Skipping already saved record OC/2017/1572/1 Skipping already saved record OC/2017/751/1 Skipping already saved record CDC/2018/794/1 Skipping already saved record OC/2016/1024/3 Skipping already saved record CDC/2018/793/1 Skipping already saved record OC/2016/539/2 Skipping already saved record CC/2018/336/1 Skipping already saved record OC/2017/2044/1 Skipping already saved record OC/2016/2070/2 Skipping already saved record OC/2016/2008/2 Skipping already saved record CDC/2018/792/1 Skipping already saved record OC/2017/1292/3 Skipping already saved record OC/2018/733/2 Skipping already saved record OC/2017/151/1 Skipping already saved record DA/2018/598/1 Skipping already saved record DA/2018/592/1 Skipping already saved record DA/2018/589/1 Skipping already saved record OC/2017/526/2 Skipping already saved record OC/2017/901/1 Skipping already saved record OC/2016/1074/1 Skipping already saved record S96/2017/1068/2 Skipping already saved record CDC/2018/791/1 Skipping already saved record CC/2018/594/1 Skipping already saved record DA/2018/594/1 Skipping already saved record DA/2018/586/1 Skipping already saved record S96/2017/1243/2 Skipping already saved record CC/2018/506/1 Skipping already saved record OC/2017/826/1 Skipping already saved record OC/2017/825/1 Skipping already saved record OC/2016/1504/2 Skipping already saved record CDC/2018/790/1 Skipping already saved record CDC/2018/789/1 Skipping already saved record CDC/2018/788/1 Skipping already saved record OC/2017/2180/1 Skipping already saved record TREE/2018/77/1 Skipping already saved record CDC/2018/787/1 Skipping already saved record CDC/2018/786/1 Skipping already saved record CC/2016/1502/1 Skipping already saved record CC/2017/1347/2 Skipping already saved record OC/2017/2003/1 Skipping already saved record OC/2017/1504/1 Skipping already saved record OC/2017/37/2 Skipping already saved record CC/2018/471/1 Skipping already saved record OC/2017/1002/2 Skipping already saved record OC/2017/410/2 Skipping already saved record OC/2017/1501/1 Skipping already saved record CC/2018/593/1 Skipping already saved record DA/2018/593/1 Skipping already saved record DA/2018/595/1 Skipping already saved record S96/2015/1417/4 Skipping already saved record S96/2016/1335/2 Skipping already saved record EngCC/2016/949/10 Skipping already saved record CDC/2018/785/1 Skipping already saved record CDC/2018/784/1 Skipping already saved record CC/2017/1777/1 Skipping already saved record CDC/2018/783/1 Skipping already saved record CDC/2018/782/1 Skipping already saved record CC/2016/949/2 Skipping already saved record CC/2018/544/1 Skipping already saved record CDC/2018/781/1 Skipping already saved record CC/2018/485/1 Skipping already saved record CDC/2018/780/1 Skipping already saved record OC/2016/1223/2 Skipping already saved record SC/2016/447/1 Skipping already saved record CDC/2018/776/1 Skipping already saved record CDC/2018/777/1 Skipping already saved record OC/2017/1778/1 Skipping already saved record CDC/2018/779/1 Skipping already saved record CDC/2018/778/1 Skipping already saved record OC/2016/41/2 Skipping already saved record CC/2018/591/1 Skipping already saved record DA/2018/591/1 Skipping already saved record OC/2017/2286/1 Skipping already saved record OC/2017/622/2 Skipping already saved record CDC/2018/625/2 Skipping already saved record CDC/2018/775/1 Skipping already saved record CC/2018/63/1 Skipping already saved record CC/2018/26/1 Skipping already saved record CC/2017/1264/1 Skipping already saved record CC/2017/1678/1 Skipping already saved record OC/2017/487/2 Skipping already saved record OC/2017/1413/1 Skipping already saved record OC/2017/1990/1 Skipping already saved record CC/2017/1629/1 Skipping already saved record CDC/2018/622/2 Skipping already saved record DA/2018/584/1 Skipping already saved record OC/2016/291/1 Skipping already saved record CC/2018/581/1 Skipping already saved record DA/2018/581/1 Skipping already saved record OC/2017/236/2 Skipping already saved record CC/2017/1807/1 Skipping already saved record DA/2018/579/1 Skipping already saved record CC/2018/519/1 Skipping already saved record CDC/2018/762/1 Skipping already saved record OC/2018/773/1 Skipping already saved record CDC/2018/773/1 Skipping already saved record CDC/2018/761/1 Skipping already saved record CC/2018/590/1 Skipping already saved record DA/2018/590/1 Skipping already saved record CDC/2018/774/1 Skipping already saved record OC/2014/1159/2 Skipping already saved record DA/2018/580/1 Skipping already saved record DA/2018/583/1 Skipping already saved record DA/2018/587/1 Skipping already saved record CDC/2018/772/1 Skipping already saved record CDC/2018/771/1 Skipping already saved record CDC/2018/770/1 Skipping already saved record CDC/2018/769/1 Skipping already saved record DA/2018/585/1 Skipping already saved record TREE/2018/78/1 Skipping already saved record OC/2017/652/2 Skipping already saved record OC/2017/271/2 Skipping already saved record EngCC/2015/993/7 Skipping already saved record CDC/2018/768/1 Skipping already saved record CDC/2018/767/1 Skipping already saved record SC/2017/223/1 Skipping already saved record CDC/2018/766/1 Skipping already saved record CDC/2018/765/1 Skipping already saved record CC/2018/368/1 Skipping already saved record CC/2018/370/1 Skipping already saved record EngCC/2016/1335/1 Skipping already saved record SC/2016/1335/1 Skipping already saved record CDC/2018/764/1 Skipping already saved record OC/2017/1870/2 Skipping already saved record CC/2017/1539/1 Skipping already saved record OC/2017/1250/1 Skipping already saved record OC/2017/566/2 Skipping already saved record CC/2018/411/1 Skipping already saved record CC/2018/413/1 Skipping already saved record CC/2017/1479/1 Skipping already saved record CC/2017/1383/1 Skipping already saved record CDC/2018/763/1 Skipping already saved record OC/2018/338/1 Skipping already saved record OC/2017/340/1 Skipping already saved record OC/2017/64/2 Skipping already saved record OC/2017/2188/1 Skipping already saved record OC/2017/1552/1 Skipping already saved record OC/2017/2261/1 Skipping already saved record OC/2017/2206/1 Skipping already saved record OC/2017/827/1 Skipping already saved record OC/2017/834/1 Skipping already saved record OC/2017/943/1 Skipping already saved record DA/2018/582/1 Skipping already saved record CC/2018/85/1 Skipping already saved record CC/2018/80/1 Skipping already saved record CC/2018/81/1 Skipping already saved record CC/2018/88/1 Skipping already saved record CC/2018/150/1 Skipping already saved record CC/2018/84/1 Skipping already saved record OC/2017/753/1 Skipping already saved record OC/2017/245/2 Skipping already saved record OC/2017/1493/1 Skipping already saved record OC/2018/119/1 Skipping already saved record OC/2017/1863/1 Skipping already saved record OC/2017/2187/1 Skipping already saved record OC/2017/1862/1 Skipping already saved record OC/2017/1855/1 Skipping already saved record CC/2018/457/1

Data

Downloaded 1025 times by openaustralia TheZepto MikeRalphson AnthonyKunz ajoh3691 derman232 Horizons444

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.28 MB) Use the API

rows 10 / 9836

id council_reference address description info_url comment_url date_scraped date_received
1
1466.1/2015
1 1 3 Lone Pine Pl,SMEATON GRANGE, NSW, Australia
New Change Of Use
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1466.1/2015
2015-12-14
2015-12-14
2
1468.1/2015
7 Fernleigh CT,COBBITTY, NSW, Australia
New Dwelling - Single Storey
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1468.1/2015
2015-12-14
2015-12-14
3
1469.1/2015
28 Rover ST,LEPPINGTON, NSW, Australia
New Dwelling - Two Storey and New Swimming Pool - Fibreglass New Dwelling - Two Storey New Swimming Pool - Fibreglass
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1469.1/2015
2015-12-14
2015-12-14
4
1546.3/2010
43 Healy AV,GREGORY HILLS, NSW, Australia
DA Modification (amendment to Vegetation Management Plan) - SEE DA/2010/1548/4 FOR FEES
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1546.3/2010
2015-12-14
2015-11-02
5
1306.1/2015
19 Long Bush RL,COBBITTY, NSW, Australia
New Dwelling - Single Storey
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1306.1/2015
2015-12-14
2015-11-02
6
1307.1/2015
10 Horne ST,COBBITTY, NSW, Australia
Two storey dwelling
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1307.1/2015
2015-12-14
2015-11-02
7
1308.1/2015
55 Holden DR,ORAN PARK, NSW, Australia
Construction of a Double Storey Dwelling & attached Granny Flat
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1308.1/2015
2015-12-14
2015-11-02
8
1311.1/2015
53 The Straight,ORAN PARK, NSW, Australia
New Dwelling - Single Storey
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1311.1/2015
2015-12-14
2015-11-02
9
1312.1/2015
55 Amberley ST,GLEDSWOOD HILLS, NSW, Australia
Construction of a Two Storey Dwelling
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1312.1/2015
2015-12-14
2015-11-02
10
1313.1/2015
29 Long Bush RL,COBBITTY, NSW, Australia
Construction of a Two Storey Dwelling
mailto:mail@camden.nsw.gov.au?subject=Development Application Enquiry: DA-1313.1/2015
2015-12-14
2015-11-02

Statistics

Average successful run time: 3 minutes

Total run time: 1 day

Total cpu time used: 9 minutes

Total disk space used: 3.38 MB

History

  • Auto ran revision e6dc97b0 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision e6dc97b0 and completed successfully .
    88 records added, 1 record updated in the database
    2 pages scraped
  • Auto ran revision e6dc97b0 and completed successfully .
    24 records added, 1 record updated in the database
    2 pages scraped
  • Auto ran revision e6dc97b0 and completed successfully .
    31 records added, 1 record updated in the database
    2 pages scraped
  • Auto ran revision e6dc97b0 and completed successfully .
    37 records added, 1 record updated in the database
    2 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

camden / scraper.php