LoveMyData / manly

Manly Council Development Applications

Scrapes da.manly.nsw.gov.au and eservices.northernbeaches.nsw.gov.au

IIS7


Manly Council scraper

  • Server - .NET
  • Cookie tracking - Yes
  • Pagnation - Yes
  • Javascript - Yes
  • Clearly defined data within a row - Yes
  • Scrape detail page - No

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData equivalentideas CloCkWeRX

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.json; requirements  from dependencies in composer.lock will be used for selection  - php (7.2.3)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - apache (2.4.29)  - nginx (1.8.1) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 5 installs, 0 updates, 0 removals  - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (0%) Downloading (100%)  - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (0%) Downloading (5%)Downloading (10%)Downloading (15%)Downloading (20%)Downloading (25%)Downloading (30%)Downloading (35%)Downloading (40%)Downloading (45%)Downloading (50%)Downloading (55%)Downloading (60%)Downloading (65%)Downloading (70%)Downloading (75%)Downloading (80%)Downloading (85%)Downloading (90%)Downloading (95%)Downloading (100%)  - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (0%) Downloading (65%)Downloading (100%)  - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  - Installing sunra/php-simple-html-dom-parser (v1.5.2): Downloading (connecting...)Downloading (0%) Downloading (15%)Downloading (30%)Downloading (45%)Downloading (60%)Downloading (75%)Downloading (95%)Downloading (100%)  Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data for `thismonth`, changable via MORPH_PERIOD environment PHP Fatal error: Uncaught Error: Call to a member function set() on null in /app/scraper.php:32 Stack trace: #0 {main} thrown in /app/scraper.php on line 32

Data

Downloaded 593 times by LoveMyData MikeRalphson equivalentideas henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (939 KB) Use the API

rows 10 / 1873

id council_reference address description info_url comment_url date_scraped date_received
1
DA 232/2015
67 Birkley RD, MANLY, NSW, Australia
Alterations and additions to an existing dwelling house including new rear secondary dwelling and rear garage, new rear ground floor addition and new front carport.
mailto:records@manly.nsw.gov.au?subject=Development Application Enquiry: DA 232/2015
2015-11-30
2015-10-01
2
S96 196/2013/2
75 Fairlight ST, FAIRLIGHT, NSW, Australia
Section 96 to modify approved Alterations and additions to an existing two (2) storey dwelling including the increase in height of floor levels, construction of detached garage and carport, front and rear decks, swimming pool and landscaping.- involving amended garage and carport? Part 2
mailto:records@manly.nsw.gov.au?subject=Development Application Enquiry: S96 196/2013/2
2015-11-30
2015-10-02
3
S96 63/2014/2
20 Monash CR, CLONTARF, NSW, Australia
Section 96 to modify approved Alterations and additions to the ground and first floors of the existing dwelling and to the existing carport.- involving - modifications to windows and finishes; addition of skylights and dwarf wall near carport - Part 2
mailto:records@manly.nsw.gov.au?subject=Development Application Enquiry: S96 63/2014/2
2015-11-30
2015-10-02
4
S96 289/2010/2
48 Wood ST, MANLY, NSW, Australia
Section 96 to modify approved Alterations and additions to an existing dwelling by extending the existing ground floor including deck, and existing lower ground floor including a terrace - involving extensions at rear and modifications to approved deck and stairs at lower ground floor level and extensions and modifications to approved ground floor level ?Part 2
mailto:records@manly.nsw.gov.au?subject=Development Application Enquiry: S96 289/2010/2
2015-11-30
2015-10-06
5
DA 233/2015
91 Gurney CR, SEAFORTH, NSW, Australia
Alterations and additions to an existing dwelling including additions at first and second floor levels, internal alterations to existing ground and first floor level
mailto:records@manly.nsw.gov.au?subject=Development Application Enquiry: DA 233/2015
2015-11-30
2015-10-06
6
S96 66/2015/2
56B Smith ST, MANLY, NSW, Australia
Section 96 to modify approved Alterations and additions to an existing semi-detached dwelling including new first floor addition and internal alterations - involving internal reconfiguration to ground floor level and amendment to condition ANS01, internal reconfiguration to second floor level and reorientation of skylight - Part 2
mailto:records@manly.nsw.gov.au?subject=Development Application Enquiry: S96 66/2015/2
2015-11-30
2015-10-07
7
DA 234/2015
39 Bungaloe AV, BALGOWLAH HEIGHTS, NSW, Australia
Construction of a new retaining wall at the rear of the existing dwelling
mailto:records@manly.nsw.gov.au?subject=Development Application Enquiry: DA 234/2015
2015-11-30
2015-10-07
8
DA 235/2015
1 Addison RD, MANLY, NSW, Australia
Alterations and additions to an existing Residential Flat Building including new balconies, roof extension, internal reconfiguration, replacement of windows and doors - Unit 81
mailto:records@manly.nsw.gov.au?subject=Development Application Enquiry: DA 235/2015
2015-11-30
2015-10-08
9
DA 238/2015
9 Fairlight ST, MANLY, NSW, Australia
Alterations and additions to existing dwelling including addition of new attic, loft and new carport with reconfiguration of internal areas
mailto:records@manly.nsw.gov.au?subject=Development Application Enquiry: DA 238/2015
2015-11-30
2015-10-08
10
DA 236/2015
323 Sydney RD, BALGOWLAH, NSW, Australia
Demolition of an existing structures, construction of a four (4) storey Residential Flat Building containing fifteen (15) units including five (5) affordable rental units, eleven (11) car parking spaces) with basement carpark, decks and landscaping
mailto:records@manly.nsw.gov.au?subject=Development Application Enquiry: DA 236/2015
2015-11-30
2015-10-09

Statistics

Average successful run time: 2 minutes

Total run time: about 21 hours

Total cpu time used: 6 minutes

Total disk space used: 1.02 MB

History

  • Auto ran revision 84cb4d7f and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 84cb4d7f and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 84cb4d7f and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 84cb4d7f and completed successfully .
    nothing changed in the database
  • Auto ran revision 84cb4d7f and completed successfully .
    nothing changed in the database
    14 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

manly / scraper.php