planningalerts-scrapers / kingston

City of Kingston Development Applications

Scrapes online.kingston.vic.gov.au


City of Kingston Council Scraper

Willoughby City Council Council involves the followings * Server - .NET - ePathway * Cookie tracking - Yes * Pagnation - Yes with restriction * Javascript - Yes * Clearly defined data within a row - Yes

Enjoy

Forked from ScraperWiki

Contributors mlandauer emikulic LoveMyData henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.json; requirements  from dependencies in composer.lock will be used for selection  - php (7.2.12)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.37) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 5 installs, 0 updates, 0 removals  - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (100%)   - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (100%)   - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (100%)   - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  - Installing sunra/php-simple-html-dom-parser (v1.5.2): Downloading (connecting...)Downloading (100%)   Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 1580 times by openaustralia LoveMyData jesse-a-reilly TheZepto TornMarketing

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.75 MB) Use the API

rows 10 / 10657

date_scraped description info_url date_received council_reference address on_notice_to comment_url date on_notice_from
2011-03-01 10:16:58
2 LOT SUBDIVISION
2009-02-02
KP-50/2009
18 Foam Street, Aspendale
2009-02-25
2009-02-02 00:00:00
2011-03-01 10:16:58
SBO - ATLS & ADDS TO DWELLING - VERANDAH & CARPORT
2009-01-28
KP-39/2009
10 Second Avenue, Aspendale
2009-02-25
2009-01-28 00:00:00
2011-03-01 10:16:58
2 LOT SUBDIVISION
2008-11-12
KP-1043/2008
1 Birdwood Street, Aspendale
2009-02-25
2008-11-12 00:00:00
2011-03-01 10:16:58
ALTS & ADDS - EXTENSION
2008-02-19
KP-208/2008
38-40 Station Street, Aspendale
2009-02-02
2008-02-19 00:00:00
2011-03-01 10:16:58
2 LOT SUB
2009-01-21
KP-592/2007/A
26 Bowman Street, Aspendale
2009-02-02
2009-01-21 00:00:00
2011-03-01 10:16:59
B'LD & WORKS - RESTAURANT
2008-11-27
KP-1063/2008
4 Springvale Road, Aspendale Gardens
2009-02-09
2008-11-27 00:00:00
2011-03-01 10:17:00
2 DWELLINGS
2008-04-22
KP-385/2008
101 Bondi Road, Bonbeach
2009-02-26
2008-04-22 00:00:00
2011-03-01 10:17:00
2 LOT SUBDIVISION
2008-09-03
KP-829/2008
5 Marina Grove, Bonbeach
2009-02-24
2008-09-03 00:00:00
2011-03-01 10:17:00
TWO (2) DWELLINGS
2008-09-30
KP-903/2008
5 Mascot Avenue, Bonbeach
2009-02-06
2008-09-30 00:00:00
2011-03-01 10:17:00
ALTS & ADDS - REAR VERANDAH
2008-11-14
KP-1030/2008
2 41 York Street, Bonbeach
2009-02-02
2008-11-14 00:00:00

Statistics

Average successful run time: half a minute

Total run time: 6 days

Total cpu time used: 27 minutes

Total disk space used: 3.86 MB

History

  • Auto ran revision 3d36ccb5 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 3d36ccb5 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 3d36ccb5 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 3d36ccb5 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 3d36ccb5 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

PHP

kingston / scraper.php