LoveMyData / kingston

City of Kingston Development Applications

Scrapes online.kingston.vic.gov.au


City of Kingston Council Scraper

This council involves the followings * Server - .NET - ePathway * Cookie tracking - Yes * Pagnation - Yes with restriction * Javascript - Yes * Clearly defined data within a row - Yes

Enjoy

Contributors emikulic LoveMyData mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.json; requirements  from dependencies in composer.lock will be used for selection  - php (7.2.1)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - apache (2.4.29)  - nginx (1.8.1) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 5 installs, 0 updates, 0 removals  - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (100%)   - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (100%)   - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (0%) Downloading (65%)Downloading (100%)  - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  - Installing sunra/php-simple-html-dom-parser (v1.5.2): Downloading (connecting...)Downloading (0%) Downloading (15%)Downloading (30%)Downloading (45%)Downloading (60%)Downloading (75%)Downloading (100%)  Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Scraping page 1 of 436 Skipping already saved record - KP-1049/2016/A Skipping already saved record - KP-37/2018 Skipping already saved record - KP-38/2018 Skipping already saved record - KP-39/2018 Skipping already saved record - KP-40/2018 Skipping already saved record - KP-41/2018 Skipping already saved record - KP-42/2018 Skipping already saved record - KP-45/2018 Skipping already saved record - KP-46/2018 Skipping already saved record - KP-47/2018 Skipping already saved record - KP-166/2017/A Skipping already saved record - KP-44/2018 Skipping already saved record - KP-173/2013/A Skipping already saved record - KP-31/2018 Skipping already saved record - KP-32/2018 Skipping already saved record - KP-600/2016/A Skipping already saved record - KP-35/2018 Skipping already saved record - KP-36/2018 Skipping already saved record - KP-43/2018 Skipping already saved record - KP-30/2018 Skipping already saved record - KP-33/2018 Skipping already saved record - KP-34/2018 Skipping already saved record - KP-35/2016/C Skipping already saved record - KP-27/2018 Skipping already saved record - KP-28/2018 Skipping already saved record - KP-29/2018 Skipping already saved record - KP-1021/2016/A Skipping already saved record - KP-25/2018 Skipping already saved record - KP-26/2018 Skipping already saved record - KP-22/2018 Scraping page 2 of 436 Skipping already saved record - KP-23/2018 Skipping already saved record - KP-24/2018 Skipping already saved record - KP-16/2018 Skipping already saved record - KP-17/2018 Skipping already saved record - KP-18/2018 Skipping already saved record - KP-19/2018 Skipping already saved record - KP-21/2018 Skipping already saved record - KP-14/2018 Skipping already saved record - KP-1023/2016/A Skipping already saved record - KP-20/2018 Skipping already saved record - KP-311/2010/B Skipping already saved record - KP-8/2018 Skipping already saved record - KP-9/2018 Skipping already saved record - KP-11/2018 Skipping already saved record - KP-10/2018 Skipping already saved record - KP-13/2018 Skipping already saved record - KP-15/2018 Skipping already saved record - KP-7/2018 Skipping already saved record - KP-581/2016/A Skipping already saved record - KP-3/2018 Skipping already saved record - KP-4/2018 Skipping already saved record - KP-5/2018 Skipping already saved record - KP-6/2018 Skipping already saved record - KP-1012/2017 Skipping already saved record - KP-1013/2017 Skipping already saved record - KP-2/2018 Skipping already saved record - KP-998/2017 Skipping already saved record - KP-1001/2017 Skipping already saved record - KP-1002/2017 Skipping already saved record - KP-1003/2017 Scraping page 3 of 436 Skipping already saved record - KP-1015/2017 Skipping already saved record - KP-1016/2017 Skipping already saved record - KP-1017/2017 Skipping already saved record - KP-1018/2017 Skipping already saved record - KP-747/2006/D Skipping already saved record - KP-990/2017 Skipping already saved record - KP-991/2017 Skipping already saved record - KP-995/2017 Skipping already saved record - KP-999/2017 Skipping already saved record - KP-1000/2017 Skipping already saved record - KP-1004/2017 Skipping already saved record - KP-1005/2017 Skipping already saved record - KP-1006/2017 Skipping already saved record - KP-985/2017 Skipping already saved record - KP-986/2017 Skipping already saved record - KP-987/2017 Skipping already saved record - KP-988/2017 Skipping already saved record - KP-989/2017 Skipping already saved record - KP-992/2017 Skipping already saved record - KP-997/2017 Skipping already saved record - KP-1007/2017 Skipping already saved record - KP-1014/2017 Skipping already saved record - KP-229/2016/A Skipping already saved record - KP-994/2017 Skipping already saved record - KP-996/2017 Skipping already saved record - KP-1008/2017 Skipping already saved record - KP-1009/2017 Skipping already saved record - KP-1011/2017 Skipping already saved record - KP-277/2014/A Skipping already saved record - KP-954/2015/B Scraping page 4 of 436 Skipping already saved record - KP-822/2015/A Skipping already saved record - KP-979/2017 Skipping already saved record - KP-980/2017 Skipping already saved record - KP-981/2017 Skipping already saved record - KP-983/2017 Skipping already saved record - KP-119/2014/B Skipping already saved record - KP-1010/2017 Skipping already saved record - KP-260/2004/A Skipping already saved record - KP-977/2017 Skipping already saved record - KP-978/2017 Skipping already saved record - KP-982/2017 Skipping already saved record - KP-984/2017 Skipping already saved record - KP-968/2017 Skipping already saved record - KP-969/2017 Skipping already saved record - KP-970/2017 Skipping already saved record - KP-971/2017 Skipping already saved record - KP-972/2017 Skipping already saved record - KP-974/2017 Skipping already saved record - KP-975/2017 Skipping already saved record - KP-976/2017 Skipping already saved record - KP-967/2017 Skipping already saved record - KP-754/2012/A Skipping already saved record - KP-965/2017 Skipping already saved record - KP-793/2016/A Skipping already saved record - KP-960/2017 Skipping already saved record - KP-964/2017 Skipping already saved record - KP-966/2017 Skipping already saved record - KP-150/2015/A Skipping already saved record - KP-487/2008/C Skipping already saved record - KP-953/2017 Scraping page 5 of 436 Skipping already saved record - KP-956/2017 Skipping already saved record - KP-957/2017 Skipping already saved record - KP-958/2017 Skipping already saved record - KP-959/2017 Skipping already saved record - KP-962/2017 Skipping already saved record - KP-963/2017 Skipping already saved record - KP-409/2010/A Skipping already saved record - KP-208/2014/B Skipping already saved record - KP-947/2017 Skipping already saved record - KP-948/2017 Skipping already saved record - KP-949/2017 Skipping already saved record - KP-950/2017 Skipping already saved record - KP-951/2017 Skipping already saved record - KP-952/2017 Skipping already saved record - KP-954/2017 Skipping already saved record - KP-955/2017 Skipping already saved record - KP-301/2014/B Skipping already saved record - KP-939/2017 Skipping already saved record - KP-943/2017 Skipping already saved record - KP-944/2017 Skipping already saved record - KP-946/2017 Skipping already saved record - KP-340/2016/A Skipping already saved record - KP-935/2017 Skipping already saved record - KP-936/2017 Skipping already saved record - KP-937/2017 Skipping already saved record - KP-938/2017 Skipping already saved record - KP-942/2017 Skipping already saved record - KP-945/2017 Skipping already saved record - KP-931/2017 Skipping already saved record - KP-933/2017 Scraping page 6 of 436 Skipping already saved record - KP-934/2017 Skipping already saved record - KP-940/2017 Skipping already saved record - KP-716/2015/B Skipping already saved record - KP-929/2017 Skipping already saved record - KP-932/2017 Skipping already saved record - KP-927/2017 Skipping already saved record - KP-27/2011/E Skipping already saved record - KP-928/2017 Skipping already saved record - KP-973/2017 Skipping already saved record - KP-921/2017 Skipping already saved record - KP-922/2017 Skipping already saved record - KP-923/2017 Skipping already saved record - KP-924/2017 Skipping already saved record - KP-925/2017 Skipping already saved record - KP-926/2017 Skipping already saved record - KP-128/2016/A Skipping already saved record - KP-477/2011/A Skipping already saved record - KP-941/2017 Skipping already saved record - KP-912/2017 Skipping already saved record - KP-913/2017 Skipping already saved record - KP-914/2017 Skipping already saved record - KP-915/2017 Skipping already saved record - KP-916/2017 Skipping already saved record - KP-917/2017 Skipping already saved record - KP-919/2017 Skipping already saved record - KP-930/2017 Skipping already saved record - KP-910/2017 Skipping already saved record - KP-911/2017 Skipping already saved record - KP-918/2017 Skipping already saved record - KP-936/2015/A Scraping page 7 of 436 Skipping already saved record - KP-438/2007/A Skipping already saved record - KP-907/2017 Skipping already saved record - KP-460/2015/B Skipping already saved record - KP-818/2016/A Skipping already saved record - KP-372/1997/A Skipping already saved record - KP-908/2017 Skipping already saved record - KP-909/2017 Skipping already saved record - KP-407/2017/A Skipping already saved record - KP-904/2017 Skipping already saved record - KP-1006/1998/B Skipping already saved record - KP-920/2017 Skipping already saved record - KP-860/1998/A Skipping already saved record - KP-898/2017 Skipping already saved record - KP-899/2017 Skipping already saved record - KP-900/2017 Skipping already saved record - KP-901/2017 Skipping already saved record - KP-376/2017/A Skipping already saved record - KP-903/2017 Skipping already saved record - KP-905/2017 Skipping already saved record - KP-961/2017 Skipping already saved record - KP-893/2017 Skipping already saved record - KP-895/2017 Skipping already saved record - KP-896/2017 Skipping already saved record - KP-902/2017 Skipping already saved record - KP-795/2014/A Skipping already saved record - KP-888/2017 Skipping already saved record - KP-897/2017 Skipping already saved record - KP-286/2015/A Skipping already saved record - KP-369/2014/A Skipping already saved record - KP-788/2016/A Scraping page 8 of 436 Skipping already saved record - KP-529/2005/B Skipping already saved record - KP-886/2017 Skipping already saved record - KP-887/2017 Skipping already saved record - KP-889/2017 Skipping already saved record - KP-890/2017 Skipping already saved record - KP-894/2017 Skipping already saved record - KP-880/2017 Skipping already saved record - KP-884/2017 Skipping already saved record - KP-891/2017 Skipping already saved record - KP-892/2017 Skipping already saved record - KP-878/2017 Skipping already saved record - KP-879/2017 Skipping already saved record - KP-906/2017 Skipping already saved record - KP-877/2017 Skipping already saved record - KP-882/2017 Skipping already saved record - KP-885/2017 Skipping already saved record - KP-486/2007/A Skipping already saved record - KP-867/2017 Skipping already saved record - KP-871/2017 Skipping already saved record - KP-874/2017 Skipping already saved record - KP-883/2017 Skipping already saved record - KP-776/2015/A Skipping already saved record - KP-866/2017 Skipping already saved record - KP-868/2017 Skipping already saved record - KP-875/2017 Skipping already saved record - KP-876/2017 Skipping already saved record - KP-865/2017 Skipping already saved record - KP-372/2016/A Skipping already saved record - KP-873/2017 Skipping already saved record - KP-881/2017 Scraping page 9 of 436 Skipping already saved record - KP-112/2013/A Skipping already saved record - KP-852/2017 Skipping already saved record - KP-853/2017 Skipping already saved record - KP-854/2017 Skipping already saved record - KP-855/2017 Skipping already saved record - KP-856/2017 Skipping already saved record - KP-857/2017 Skipping already saved record - KP-859/2017 Skipping already saved record - KP-863/2017 Skipping already saved record - KP-864/2017 Skipping already saved record - KP-872/2017 Skipping already saved record - KP-844/2017 Skipping already saved record - KP-848/2017 Skipping already saved record - KP-861/2017 Skipping already saved record - KP-862/2017 Skipping already saved record - KP-378/2017/A Skipping already saved record - KP-869/2017 Skipping already saved record - KP-875/2005/A Skipping already saved record - KP-890/2016/A Skipping already saved record - KP-843/2017 Skipping already saved record - KP-846/2017 Skipping already saved record - KP-847/2017 Skipping already saved record - KP-858/2017 Skipping already saved record - KP-860/2017 Skipping already saved record - KP-1004/2016/A Skipping already saved record - KP-870/2017 Skipping already saved record - KP-842/2017 Skipping already saved record - KP-1041/2016/A Skipping already saved record - KP-845/2017 Skipping already saved record - KP-144/2015/A Scraping page 10 of 436 Skipping already saved record - KP-840/2017 Skipping already saved record - KP-35/2016/B Skipping already saved record - KP-851/2017 Skipping already saved record - KP-830/2017 Skipping already saved record - KP-831/2017 Skipping already saved record - KP-835/2017 Skipping already saved record - KP-12/2018 Skipping already saved record - KP-827/2017 Skipping already saved record - KP-832/2017 Skipping already saved record - KP-833/2017 Skipping already saved record - KP-1/2012/A Skipping already saved record - KP-161/2016/A Skipping already saved record - KP-834/2017 Skipping already saved record - KP-836/2017 Skipping already saved record - KP-837/2017 Skipping already saved record - KP-838/2017 Skipping already saved record - KP-650/2000/A Skipping already saved record - KP-650/1998/A Skipping already saved record - KP-52/2005/A Skipping already saved record - KP-824/2017 Skipping already saved record - KP-825/2017 Skipping already saved record - KP-828/2017 Skipping already saved record - KP-829/2017 Skipping already saved record - KP-850/2017 Skipping already saved record - KP-551/2000/B Skipping already saved record - KP-821/2017 Skipping already saved record - KP-822/2017 Skipping already saved record - KP-823/2017 Skipping already saved record - KP-826/2017 Skipping already saved record - KP-841/2017

Data

Downloaded 415 times by LoveMyData MikeRalphson henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (4.12 MB) Use the API

rows 10 / 13144

id council_reference address description info_url comment_url date_scraped date_received
1
KP-267/2017
20 Scotch Parade, CHELSEA, VIC
Subdivide the Land into Two (2) Lots
mailto:info@kingston.vic.gov.au
2017-04-11
2017-04-11
2
KP-268/2017
7A Glenbrook Avenue, CHELSEA, VIC
Subdivide the land into two (2) lots
mailto:info@kingston.vic.gov.au
2017-04-11
2017-04-11
3
KP-258/2017
1 53 Bondi Road, BONBEACH, VIC
Subdivide the Land into Five (5) Lots
mailto:info@kingston.vic.gov.au
2017-04-11
2017-04-10
4
KP-259/2017
41 Westall Road, CLAYTON SOUTH, VIC
Subdivide the Land into Three (3) Lots
mailto:info@kingston.vic.gov.au
2017-04-11
2017-04-10
5
KP-266/2017
9 Palermo Street, MENTONE, VIC
Develop the land for the construction and display of advertising signage
mailto:info@kingston.vic.gov.au
2017-04-11
2017-04-10
6
KP-211/2017
34 Mernda Avenue, BONBEACH, VIC
Develop the land for the construction of two (2) double storey dwellings
mailto:info@kingston.vic.gov.au
2017-04-11
2017-04-07
7
KP-254/2017
20 The Crescent, HIGHETT, VIC
Prune Significant tree on land subject to environmental significance overlay
mailto:info@kingston.vic.gov.au
2017-04-11
2017-04-07
8
KP-257/2017
27 Plaza Crescent, DINGLEY VILLAGE, VIC
Develop the land for the construction of one (1) dwelling in a Special Building Overlay
mailto:info@kingston.vic.gov.au
2017-04-11
2017-04-07
9
KP-264/2017
79-81 Bernard Street, CHELTENHAM, VIC
Develop the land for the construction of two (2) dwellings
mailto:info@kingston.vic.gov.au
2017-04-11
2017-04-07
10
KP-265/2017
1 590 Nepean Highway, BONBEACH, VIC
Develop the land for the construction of eight (8) dwellings
mailto:info@kingston.vic.gov.au
2017-04-11
2017-04-07

Statistics

Average successful run time: less than a minute

Total run time: about 7 hours

Total cpu time used: 6 minutes

Total disk space used: 4.22 MB

History

  • Auto ran revision eb3288a4 and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision eb3288a4 and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision eb3288a4 and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision eb3288a4 and completed successfully .
    22 records added, 1 record updated in the database
    15 pages scraped
  • Auto ran revision eb3288a4 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

kingston / scraper.php