planningalerts-scrapers / cardinia

Cardinia Shire Council Planning Applications


Cardinia Council Scraper

  • Server - Unknown
  • Cookie tracking - No
  • Pagnation - No
  • Javascript - No
  • Clearly defined data within a row - Yes
  • System - Unknown

Enjoy

This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

Expected output

Injecting configuration and compiling...
Injecting scraper and running...
Using Australian proxy: http://***@...
Using user agent: Ruby/3.2.2 PlanningAlerts scraper for Cardinia Shire Council/1.0 (https://www.planningalerts.org.au/about)
Scraping page: https://www.cardinia.vic.gov.au/planning-and-building/applying-and-managing-planning-applications-and-permits/current-advertised
Saving record T250324, 5445 South Gippsland HighwayLang Lang, VIC

(Sometimes it fixes urls:)
NOT: Reference: T250582 had an invalid url (https://T250582 PA - Advertising Package - 1340 Westernport Rd, Heath Hill), using list url instead!
Saving record T250582, 1340 Westernport Road, Heath Hill, VIC
Saving record T200592-1, 43 Tynong Road, Tynong, VIC
Saving record T240496, 150 Macclesfield Road, Avonsleigh, VIC
...
Saving record T260120, 3 George Street, Bunyip, VIC
Saving record T160676-2, 95 Hall Road, Pakenham South, VIC
Saving record T260459, Commercial Drive, Pakenham, VIC
Finished! Saved 18 applications.

Execution time under a minute

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors flying-feline LoveMyData henare equivalentideas mlandauer benrfairless CloCkWeRX ianheggie-oaf

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using Australian proxy: http://***@plannies-proxy.thesite.info:49976/ Using user agent: Ruby/3.2.2 PlanningAlerts scraper for Cardinia Shire Council/1.0 (https://www.planningalerts.org.au/about) Scraping page: https://www.cardinia.vic.gov.au/planning-and-building/applying-and-managing-planning-applications-and-permits/current-advertised Saving record T260199 - 1, 12 Monterey WayPakenham , VIC Saving record T260558, 9 Gold Street Pakenham, VIC Saving record T260314, 12 Victor Road Clematis, VIC Saving record T260263, 295 Kettles Road Lang Lang, VIC Saving record T260564, 270 Cardinia Road Officer South, VIC Saving record T260148, 73A Kilvington Drive Emerald, VIC Saving record T260435, 40 Breyleigh Drive, Pakenham, VIC Saving record T260480, 31 A'Beckett Road, Bunyip, VIC Finished! Saved 8 applications.

Data

Downloaded 6406 times by openaustralia dcalde mlandauer LoveMyData jesse-a-reilly tkrikke repose-lecture kouzi-sys DevAppProject TheZepto davidyu37 equivalentideas 538digital Joel-Tan_valocity Shawnyu0217 MikeRalphson Simsoi Manasaanand AthleticoPrawn TornMarketing derman232 Jedwards157 93399339 danielpurton mustafa0 ianheggie-oaf

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (553 KB) Use the API

rows 10 / 1366

info_url comment_url council_reference description address on_notice_to date_scraped
mailto:mail@cardinia.vic.gov.au
T200500-1
Amendment to planning permit T200500 (that was issued for the use and development of land for a place of worship and associated works) to delete conditions
Army Road (Corner of Murphy Road), Pakenham, VIC
2021-05-13
2021-05-19
mailto:mail@cardinia.vic.gov.au
T200716
Development of the land for a dwelling, earthworks and removal of vegetation
11A Duffys Road, Emerald, VIC
2021-05-13
2021-05-19
mailto:mail@cardinia.vic.gov.au
T200754
Use and development of the land for a car park
Lyle Blue Court, Pakenham (rear of Castellos Hotel), VIC
2021-05-13
2021-05-19
mailto:mail@cardinia.vic.gov.au
T200816
Development of the land for a dwelling and outbuilding and associated works
34 A`Beckett Road, Bunyip, VIC
2021-05-14
2021-05-19
mailto:mail@cardinia.vic.gov.au
T210180
Use of the land for an indoor recreation facility
Trampoline Centre FY 14/99 Bald Hill Road, Pakenham, VIC
2021-05-21
2021-05-24
mailto:mail@cardinia.vic.gov.au
T210001
Removal of vegetation
405 Monomeith Road, Monomeith, VIC
2021-05-24
2021-05-24
mailto:mail@cardinia.vic.gov.au
T200455
Use of the land for a retail premises and signage
122 Old Princes Highway, Beaconsfield, VIC
2021-05-28
2021-06-03
mailto:mail@cardinia.vic.gov.au
T210005
Use and development of the land for domestic animal husbandry (dog breeding)
150 Settlement Road, Caldermeade, VIC
2021-06-04
2021-06-10
mailto:mail@cardinia.vic.gov.au
T210314
Removal of vegetation (five trees, including one native tree)
335 Garfield North Road, Garfield North, VIC
2021-06-04
2021-06-10
mailto:mail@cardinia.vic.gov.au
T210234
Removal of native vegetation (three trees)
4 Wattletree Road, Bunyip, VIC
2021-06-04
2021-06-10

Statistics

Average successful run time: half a minute

Total run time: 5 days

Total cpu time used: about 1 hour

Total disk space used: 675 KB

History

  • Auto ran revision 5f641bc2 and completed successfully .
    8 records added, 6 records removed in the database
  • Auto ran revision 5f641bc2 and completed successfully .
    6 records added, 5 records removed in the database
  • Auto ran revision 5f641bc2 and completed successfully .
    8 records added, 8 records removed in the database
  • Auto ran revision 5f641bc2 and completed successfully .
    8 records added, 8 records removed in the database
  • Auto ran revision 5f641bc2 and completed successfully .
    8 records added, 8 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

cardinia / scraper.rb