LoveMyData / greatlakes

Great Lakes Council Development Applications

Scrapes services.greatlakes.nsw.gov.au

IIS7


Great Lakes Council Scraper

  • Server - .NET - ePathway
  • Cookie tracking - No
  • Pagnation - Yes - Limited to 10 pages
  • Javascript - Yes
  • Clearly defined data within a row - Yes

Enjoy

Contributors LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.json; requirements  from dependencies in composer.lock will be used for selection  - php (7.2.6)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.33) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 5 installs, 0 updates, 0 removals  - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (100%)   - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (100%)   - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (100%)   - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  - Installing sunra/php-simple-html-dom-parser (v1.5.2): Downloading (connecting...)Downloading (100%)   Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Scraping page 1 of 10 Saving record DA-383/2018/A - 13 Barromee Way, NORTH ARM COVE NSW 2324 Saving record DA-548/2018 - 22 Yalinbah Street, TEA GARDENS NSW 2324 Skipping already saved record - DA-544/2018 Skipping already saved record - DA-545/2018 Skipping already saved record - DA-349/2014/B Skipping already saved record - DA-546/2018 Skipping already saved record - DA-547/2018 Skipping already saved record - DA-541/2018 Skipping already saved record - DA-542/2018 Skipping already saved record - DA-543/2018 Skipping already saved record - DA-335/2018/A Skipping already saved record - DA-534/2018 Skipping already saved record - DA-535/2018 Skipping already saved record - DA-536/2018 Skipping already saved record - DA-537/2018 Skipping already saved record - DA-538/2018 Skipping already saved record - DA-539/2018 Skipping already saved record - DA-540/2018 Skipping already saved record - DA-531/2018 Skipping already saved record - DA-533/2018 Skipping already saved record - DA-532/2018 Skipping already saved record - DA-359/2015/A Skipping already saved record - DA-530/2018 Skipping already saved record - DA-337/2008/H Skipping already saved record - DA-529/2018 Skipping already saved record - DA-26/2017/B Skipping already saved record - DA-528/2018 Skipping already saved record - DA-527/2018 Skipping already saved record - DA-435/2015/A Skipping already saved record - DA-522/2018 Scraping page 2 of 10 Skipping already saved record - DA-524/2018 Skipping already saved record - DA-169/2018/A Skipping already saved record - DA-523/2018 Skipping already saved record - DA-525/2018 Skipping already saved record - DA-526/2018 Skipping already saved record - DA-181/2018/A Skipping already saved record - DA-520/2018 Skipping already saved record - DA-521/2018 Skipping already saved record - DA-517/2018 Skipping already saved record - DA-518/2018 Skipping already saved record - DA-190/2006/E Skipping already saved record - DA-513/2018 Skipping already saved record - DA-515/2018 Skipping already saved record - DA-514/2018 Skipping already saved record - DA-577/2017/A Skipping already saved record - DA-516/2018 Skipping already saved record - DA-299/2016/A Skipping already saved record - DA-331/2015/B Skipping already saved record - DA-511/2018 Skipping already saved record - DA-512/2018 Skipping already saved record - DA-507/2018 Skipping already saved record - DA-508/2018 Skipping already saved record - DA-509/2018 Skipping already saved record - DA-510/2018 Skipping already saved record - DA-60/2016/A Skipping already saved record - DA-506/2018 Skipping already saved record - DA-503/2018 Skipping already saved record - DA-60/2018/A Skipping already saved record - DA-504/2018 Skipping already saved record - DA-505/2018 Scraping page 3 of 10 Skipping already saved record - DA-502/2018 Skipping already saved record - DA-499/2018 Skipping already saved record - DA-500/2018 Skipping already saved record - DA-501/2018 Skipping already saved record - DA-498/2018 Skipping already saved record - DA-216/2018/A Skipping already saved record - DA-176/2017/A Skipping already saved record - DA-497/2018 Skipping already saved record - DA-496/2018 Skipping already saved record - DA-495/2018 Skipping already saved record - DA-8/2012/F Skipping already saved record - DA-492/2018 Skipping already saved record - DA-493/2018 Skipping already saved record - DA-494/2018 Skipping already saved record - DA-488/2018 Skipping already saved record - DA-562/2017/A Skipping already saved record - DA-490/2018 Skipping already saved record - DA-489/2018 Skipping already saved record - DA-491/2018 Skipping already saved record - DA-486/2018 Skipping already saved record - DA-487/2018 Skipping already saved record - DA-113/2017/A Skipping already saved record - DA-484/2018 Skipping already saved record - DA-485/2018 Skipping already saved record - DA-482/2018 Skipping already saved record - DA-480/2018 Skipping already saved record - DA-481/2018 Skipping already saved record - DA-479/2018 Skipping already saved record - DA-478/2018 Skipping already saved record - DA-475/2018 Scraping page 4 of 10 Skipping already saved record - DA-286/2018/A Skipping already saved record - DA-476/2018 Skipping already saved record - DA-477/2018 Skipping already saved record - DA-473/2018 Skipping already saved record - DA-474/2018 Skipping already saved record - DA-116/2011/F Skipping already saved record - DA-470/2018 Skipping already saved record - DA-471/2018 Skipping already saved record - DA-472/2018 Skipping already saved record - DA-452/2017/A Skipping already saved record - DA-11/2018/A Skipping already saved record - DA-463/2018 Skipping already saved record - DA-464/2018 Skipping already saved record - DA-157/2010/A Skipping already saved record - DA-465/2018 Skipping already saved record - DA-466/2018 Skipping already saved record - DA-467/2018 Skipping already saved record - DA-468/2018 Skipping already saved record - DA-469/2018 Skipping already saved record - DA-317/2018/A Skipping already saved record - DA-460/2018 Skipping already saved record - DA-461/2018 Skipping already saved record - DA-462/2018 Skipping already saved record - DA-458/2018 Skipping already saved record - DA-459/2018 Skipping already saved record - DA-453/2018 Skipping already saved record - DA-454/2018 Skipping already saved record - DA-455/2018 Skipping already saved record - DA-456/2018 Skipping already saved record - DA-457/2018 Scraping page 5 of 10 Skipping already saved record - DA-451/2018 Skipping already saved record - DA-452/2018 Skipping already saved record - DA-309/2007/B Skipping already saved record - DA-394/2017/A Skipping already saved record - DA-557/2010/C Skipping already saved record - DA-450/2018 Skipping already saved record - DA-223/2017/A Skipping already saved record - DA-447/2018 Skipping already saved record - DA-448/2018 Skipping already saved record - DA-449/2018 Skipping already saved record - DA-442/2018 Skipping already saved record - DA-443/2018 Skipping already saved record - DA-445/2018 Skipping already saved record - DA-446/2018 Skipping already saved record - DA-176/2015/C Skipping already saved record - DA-98/2011/B Skipping already saved record - DA-441/2018 Skipping already saved record - DA-435/2018 Skipping already saved record - DA-436/2018 Skipping already saved record - DA-437/2018 Skipping already saved record - DA-438/2018 Skipping already saved record - DA-439/2018 Skipping already saved record - DA-440/2018 Skipping already saved record - DA-431/2018 Skipping already saved record - DA-432/2018 Skipping already saved record - DA-433/2018 Skipping already saved record - DA-434/2018 Skipping already saved record - DA-430/2018 Skipping already saved record - DA-428/2018 Skipping already saved record - DA-429/2018 Scraping page 6 of 10 Skipping already saved record - DA-319/2016/A Skipping already saved record - DA-427/2018 Skipping already saved record - DA-422/2018 Skipping already saved record - DA-423/2018 Skipping already saved record - DA-424/2018 Skipping already saved record - DA-425/2018 Skipping already saved record - DA-426/2018 Skipping already saved record - DA-421/2018 Skipping already saved record - DA-417/2018 Skipping already saved record - DA-418/2018 Skipping already saved record - DA-419/2018 Skipping already saved record - DA-420/2018 Skipping already saved record - DA-414/2018 Skipping already saved record - DA-415/2018 Skipping already saved record - DA-416/2018 Skipping already saved record - DA-439/2017/A Skipping already saved record - DA-412/2018 Skipping already saved record - DA-413/2018 Skipping already saved record - DA-409/2018 Skipping already saved record - DA-410/2018 Skipping already saved record - DA-537/2016/B Skipping already saved record - DA-407/2018 Skipping already saved record - DA-408/2018 Skipping already saved record - DA-400/2018 Skipping already saved record - DA-401/2018 Skipping already saved record - DA-402/2018 Skipping already saved record - DA-403/2018 Skipping already saved record - DA-404/2018 Skipping already saved record - DA-406/2018 Skipping already saved record - DA-405/2018 Scraping page 7 of 10 Skipping already saved record - DA-392/2018 Skipping already saved record - DA-393/2018 Skipping already saved record - DA-395/2018 Skipping already saved record - DA-394/2018 Skipping already saved record - DA-396/2018 Skipping already saved record - DA-397/2018 Skipping already saved record - DA-398/2018 Skipping already saved record - DA-399/2018 Skipping already saved record - DA-385/2018 Skipping already saved record - DA-386/2018 Skipping already saved record - DA-205/2018/A Skipping already saved record - DA-387/2018 Skipping already saved record - DA-388/2018 Skipping already saved record - DA-389/2018 Skipping already saved record - DA-390/2018 Skipping already saved record - DA-391/2018 Skipping already saved record - DA-384/2018 Skipping already saved record - DA-383/2018 Skipping already saved record - DA-377/2018 Skipping already saved record - DA-516/2017/B Skipping already saved record - DA-380/2018 Skipping already saved record - DA-379/2018 Skipping already saved record - DA-381/2018 Skipping already saved record - DA-382/2018 Skipping already saved record - DA-190/2017/A Skipping already saved record - DA-375/2018 Skipping already saved record - DA-376/2018 Skipping already saved record - DA-469/2014/B Skipping already saved record - DA-373/2018 Skipping already saved record - DA-374/2018 Scraping page 8 of 10 Skipping already saved record - DA-368/2018 Skipping already saved record - DA-369/2018 Skipping already saved record - DA-370/2018 Skipping already saved record - DA-371/2018 Skipping already saved record - DA-372/2018 Skipping already saved record - DA-367/2018 Skipping already saved record - DA-365/2018 Skipping already saved record - DA-366/2018 Skipping already saved record - DA-363/2018 Skipping already saved record - DA-364/2018 Skipping already saved record - DA-360/2018 Skipping already saved record - DA-361/2018 Skipping already saved record - DA-362/2018 Skipping already saved record - DA-358/2018 Skipping already saved record - DA-395/2017/A Skipping already saved record - DA-359/2018 Skipping already saved record - DA-355/2018 Skipping already saved record - DA-356/2018 Skipping already saved record - DA-357/2018 Skipping already saved record - DA-353/2018 Skipping already saved record - DA-354/2018 Skipping already saved record - DA-352/2018 Skipping already saved record - DA-349/2018 Skipping already saved record - DA-301/2018/A Skipping already saved record - DA-302/2018/A Skipping already saved record - DA-350/2018 Skipping already saved record - DA-351/2018 Skipping already saved record - DA-346/2018 Skipping already saved record - DA-347/2018 Skipping already saved record - DA-348/2018 Scraping page 9 of 10 Skipping already saved record - DA-344/2018 Skipping already saved record - DA-345/2018 Skipping already saved record - DA-392/2017/C Skipping already saved record - DA-230/2017/A Skipping already saved record - DA-343/2018 Skipping already saved record - DA-342/2018 Skipping already saved record - DA-340/2018 Skipping already saved record - DA-341/2018 Skipping already saved record - DA-905/2004/A Skipping already saved record - DA-339/2018 Skipping already saved record - DA-338/2018 Skipping already saved record - DA-333/2018 Skipping already saved record - DA-334/2018 Skipping already saved record - DA-335/2018 Skipping already saved record - DA-336/2018 Skipping already saved record - DA-328/2018 Skipping already saved record - DA-329/2018 Skipping already saved record - DA-330/2018 Skipping already saved record - DA-331/2018 Skipping already saved record - DA-468/2017/A Skipping already saved record - DA-332/2018 Skipping already saved record - DA-33/2016/A Skipping already saved record - DA-326/2018 Skipping already saved record - DA-327/2018 Skipping already saved record - DA-247/2017/A Skipping already saved record - DA-325/2018 Skipping already saved record - DA-322/2018 Skipping already saved record - DA-323/2018 Skipping already saved record - DA-324/2018 Skipping already saved record - DA-453/2009/A Scraping page 10 of 10 Skipping already saved record - DA-321/2018 Skipping already saved record - DA-176/2018/A Skipping already saved record - DA-41/2018/A Skipping already saved record - DA-319/2018 Skipping already saved record - DA-320/2018 Skipping already saved record - DA-71/2018/A Skipping already saved record - DA-317/2018 Skipping already saved record - DA-318/2018 Skipping already saved record - DA-313/2018 Skipping already saved record - DA-314/2018 Skipping already saved record - DA-315/2018 Skipping already saved record - DA-316/2018 Skipping already saved record - DA-312/2018 Skipping already saved record - DA-381/2015/B Skipping already saved record - DA-307/2018 Skipping already saved record - DA-308/2018 Skipping already saved record - DA-309/2018 Skipping already saved record - DA-310/2018 Skipping already saved record - DA-311/2018 Skipping already saved record - DA-163/2018/A Skipping already saved record - DA-301/2018 Skipping already saved record - DA-302/2018 Skipping already saved record - DA-303/2018 Skipping already saved record - DA-304/2018 Skipping already saved record - DA-305/2018 Skipping already saved record - DA-306/2018 Skipping already saved record - DA-299/2018 Skipping already saved record - DA-238/2017/C Skipping already saved record - DA-300/2018 Skipping already saved record - DA-85/2018/A

Data

Downloaded 622 times by LoveMyData MikeRalphson henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (515 KB) Use the API

rows 10 / 1441

id council_reference address description info_url comment_url date_scraped date_received
1
DA-234/2016
35 First Ridge Road, SMITHS LAKE NSW 2428, Australia
Split Level dwelling with attached garage
mailto:council@greatlakes.nsw.gov.au?subject=DA-234/2016
2015-12-14
2015-12-04
2
DA-233/2016
86-88 MacIntosh Street, FORSTER NSW 2428, Australia
Hand carwash bay and alterations to existing service station
mailto:council@greatlakes.nsw.gov.au?subject=DA-233/2016
2015-12-14
2015-12-03
3
DA-230/2016
2 River Street, BULAHDELAH NSW 2423, Australia
Filling of land
mailto:council@greatlakes.nsw.gov.au?subject=DA-230/2016
2015-12-14
2015-12-02
4
DA-226/2016
5 Merriwa Boulevard, NORTH ARM COVE NSW 2324, Australia
Alterations and additions to dwelling and widen driveway
mailto:council@greatlakes.nsw.gov.au?subject=DA-226/2016
2015-12-14
2015-12-01
5
DA-224/2016
56 King George Parade, FORSTER NSW 2428, Australia
Conversion of existing carport to Garage
mailto:council@greatlakes.nsw.gov.au?subject=DA-224/2016
2015-12-14
2015-11-30
6
DA-225/2016
26 Coolangatta Street, COOMBA PARK NSW 2428, Australia
Pitch Patio
mailto:council@greatlakes.nsw.gov.au?subject=DA-225/2016
2015-12-14
2015-11-30
7
DA-217/2016
4 Nixon Place, NABIAC NSW 2312, Australia
Swimming Pool
mailto:council@greatlakes.nsw.gov.au?subject=DA-217/2016
2015-12-14
2015-11-26
8
DA-218/2016
7780 Pacific Highway, NERONG NSW 2423, Australia
Dwelling
mailto:council@greatlakes.nsw.gov.au?subject=DA-218/2016
2015-12-14
2015-11-26
9
DA-222/2016
11 Oasis Parade, TUNCURRY NSW 2428, Australia
New swimming pool
mailto:council@greatlakes.nsw.gov.au?subject=DA-222/2016
2015-12-14
2015-11-26
10
DA-211/2016
4 Milliken Street, TUNCURRY NSW 2428, Australia
Demolition and replacement of existing sunroom within existing footprint
mailto:council@greatlakes.nsw.gov.au?subject=DA-211/2016
2015-12-14
2015-11-24

Statistics

Average successful run time: 4 minutes

Total run time: 4 days

Total cpu time used: 8 minutes

Total disk space used: 618 KB

History

  • Auto ran revision c60a92dd and completed successfully .
    2 records added, 1 record updated in the database
    15 pages scraped
  • Auto ran revision c60a92dd and completed successfully .
    5 records added, 1 record updated in the database
    15 pages scraped
  • Auto ran revision c60a92dd and completed successfully .
    3 records added, 1 record updated in the database
    15 pages scraped
  • Auto ran revision c60a92dd and completed successfully .
    1 record added, 1 record updated in the database
    15 pages scraped
  • Auto ran revision c60a92dd and completed successfully .
    7 records added, 1 record updated in the database
    15 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

greatlakes / scraper.php