planningalerts-scrapers / liverpool-py

Liverpool City Council Development Applications

Scrapes eplanning.liverpool.nsw.gov.au

Terms and Conditions


Liverpool City Council Scraper

Liverpool City Council Scraper involves the followings * Server - .NET - XCTrack * Accept Terms - No * Cookie tracking - No * Pagnation - No * Javascript - No * UserAgent - No * Request actual DA page for data - Yes * Clearly defined data within a row - No

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default) * thismonth * lastmonth

Thanks and Enjoy

Contributors dpschramm henare LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Skipping already saved record DA-304/2018 Skipping already saved record DA-306/2018 Skipping already saved record CD-509/2017/A Skipping already saved record BC-27/2018 Skipping already saved record CD-308/2018 Skipping already saved record DA-307/2018 Skipping already saved record CD-309/2018 Skipping already saved record CD-310/2018 Skipping already saved record CD-312/2018 Skipping already saved record CD-311/2018 Skipping already saved record CCB-255/2018 Skipping already saved record CD-313/2018 Skipping already saved record CD-314/2018 Skipping already saved record DA-308/2018 Skipping already saved record BC-28/2018 Skipping already saved record DA-309/2018 Skipping already saved record DA-310/2018 Skipping already saved record DA-311/2018 Skipping already saved record CCB-256/2018 Skipping already saved record DA-312/2018 Skipping already saved record CCB-257/2018 Skipping already saved record CCE-13/2018 Skipping already saved record CD-315/2018 Skipping already saved record CD-316/2018 Skipping already saved record DA-562/2016/A Skipping already saved record CD-317/2018 Skipping already saved record DA-313/2018 Skipping already saved record DA-314/2018 Skipping already saved record CD-318/2018 Skipping already saved record CD-319/2018 Skipping already saved record CD-320/2018 Skipping already saved record CCB-259/2018 Skipping already saved record DA-557/2011/A Skipping already saved record DA-561/2011/A Skipping already saved record CD-321/2018 Skipping already saved record CD-322/2018 Skipping already saved record CD-323/2018 Skipping already saved record CD-324/2018 Skipping already saved record CD-325/2018 Skipping already saved record CD-326/2018 Saving record CCB-265/2018 Skipping already saved record CD-329/2018 Skipping already saved record DA-316/2018 Skipping already saved record DA-853/2017/A Skipping already saved record CCB-260/2018 Skipping already saved record DA-315/2018 Skipping already saved record CD-330/2018 Skipping already saved record DA-317/2018 Skipping already saved record DA-319/2018 Skipping already saved record DA-318/2018 Skipping already saved record DA-320/2018 Skipping already saved record CCB-261/2018 Skipping already saved record DA-321/2018 Skipping already saved record DA-322/2018 Skipping already saved record CD-331/2018 Skipping already saved record CD-331/2018/A Skipping already saved record CD-332/2018 Skipping already saved record DA-323/2018 Skipping already saved record DA-1100/2010/D Skipping already saved record CD-333/2018 Skipping already saved record CCE-14/2018 Skipping already saved record CD-334/2018 Skipping already saved record DA-324/2018 Skipping already saved record CD-335/2018 Skipping already saved record DA-325/2018 Skipping already saved record SC-51/2018 Skipping already saved record CD-336/2018 Skipping already saved record CD-337/2018 Skipping already saved record CD-338/2018 Skipping already saved record CD-339/2018 Skipping already saved record CD-340/2018 Skipping already saved record CD-341/2018 Saving record SC-52/2018 Saving record CCB-262/2018 Saving record CD-342/2018 Saving record CD-343/2018 Saving record CD-344/2018 Saving record CCB-263/2018 Saving record DA-326/2018 Saving record CCB-264/2018 Saving record CD-345/2018 Saving record CD-346/2018 Saving record CD-347/2018 Saving record CCB-266/2018 Saving record CD-348/2018 Saving record CCE-15/2018 Saving record CD-349/2018 Saving record CCB-267/2018

Data

Downloaded 2959 times by slav123 openaustralia TheZepto LoveMyData JPHePlanning Jeremy-Charlton MikeRalphson derman232 Horizons444 uncoverRiley Ceebee74 henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (4.2 MB) Use the API

rows 10 / 8549

date_received description info_url date_scraped comment_url address council_reference
2015-06-01
two double storey semi detached dwelling, demolition and torrens title subdivision of one lot into two lots
2015-06-30
14 BRAIN AVENUE, LURNEA NSW 2170
DA-442/2015
2015-06-01
installation of a Telecommunications facility including 40m monopole, equipment shelter and ancillary equipment
2015-06-30
50 VICTOR AVENUE, KEMPS CREEK NSW 2178
DA-443/2015
2015-06-01
S(96)1A to extend retaining wall and fill
2015-06-30
48 MCGOWEN CRESCENT, LIVERPOOL NSW 2170
DA-1723/2012/C
2015-06-01
two storey dwelling and front fence
2015-06-30
LOT 40 ARDENNES AVENUE, EDMONDSON PARK NSW 2174
DA-444/2015
2015-06-01
torrens tilte subdivision of one lot into two lots
2015-06-30
15 TEMPLETON CRESCENT, MOOREBANK NSW 2170
SC-53/2015
2015-06-01
Boundary adjustment
2015-06-30
115 CROATIA AVENUE, EDMONDSON PARK NSW 2174
DA-1084/2014/A
2015-06-01
concrete hardstand and concrete on ground storage bin and relocation of property fence along eastern boundary
2015-06-30
102 JEDDA ROAD, PRESTONS NSW 2170
DA-445/2015
2015-06-02
inground swimming pool
2015-06-30
85 SADLEIR AVENUE, ASHCROFT NSW 2168
DA-446/2015
2015-06-02
demolition of existing structures, subdivision of the existing lot into two torrens tiltle lots and the construction of a double storey detached dwelling on each lot
2015-06-30
26 BOUNDARY ROAD, LIVERPOOL NSW 2170
DA-447/2015
2015-06-02
cutting hole in wall between two buildings to gain easy access for storage
2015-06-30
17 MEMORIAL AVENUE, LIVERPOOL NSW 2170
DA-448/2015

Statistics

Average successful run time: 5 minutes

Total run time: 3 days

Total cpu time used: 43 minutes

Total disk space used: 4.57 MB

History

  • Auto ran revision c459d749 and completed successfully .
    17 records added in the database
    178 pages scraped
  • Auto ran revision c459d749 and completed successfully .
    28 records added in the database
    146 pages scraped
  • Auto ran revision c459d749 and failed .
    17 records added in the database
    91 pages scraped
  • Auto ran revision c459d749 and completed successfully .
    14 records added in the database
    56 pages scraped
  • Auto ran revision c459d749 and completed successfully .
    13 records added in the database
    28 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

liverpool-py / scraper.php