planningalerts-scrapers / cardinia

Cardinia Shire Council Planning Applications


Cardinia Council Scraper

  • Server - Unknown
  • Cookie tracking - No
  • Pagnation - No
  • Javascript - No
  • Clearly defined data within a row - Yes
  • System - Unknown

Enjoy

This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

Expected output

Injecting configuration and compiling...
Injecting scraper and running...
Using Australian proxy: http://***@...
Using user agent: Ruby/3.2.2 PlanningAlerts scraper for Cardinia Shire Council/1.0 (https://www.planningalerts.org.au/about)
Scraping page: https://www.cardinia.vic.gov.au/planning-and-building/applying-and-managing-planning-applications-and-permits/current-advertised
Saving record T250324, 5445 South Gippsland HighwayLang Lang, VIC

(Sometimes it fixes urls:)
NOT: Reference: T250582 had an invalid url (https://T250582 PA - Advertising Package - 1340 Westernport Rd, Heath Hill), using list url instead!
Saving record T250582, 1340 Westernport Road, Heath Hill, VIC
Saving record T200592-1, 43 Tynong Road, Tynong, VIC
Saving record T240496, 150 Macclesfield Road, Avonsleigh, VIC
...
Saving record T260120, 3 George Street, Bunyip, VIC
Saving record T160676-2, 95 Hall Road, Pakenham South, VIC
Saving record T260459, Commercial Drive, Pakenham, VIC
Finished! Saved 18 applications.

Execution time under a minute

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors flying-feline LoveMyData henare equivalentideas mlandauer benrfairless CloCkWeRX ianheggie-oaf

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using Australian proxy: http://***@plannies-proxy.thesite.info:49976/ Using user agent: Ruby/3.2.2 PlanningAlerts scraper for Cardinia Shire Council/1.0 (https://www.planningalerts.org.au/about) Scraping page: https://www.cardinia.vic.gov.au/planning-and-building/applying-and-managing-planning-applications-and-permits/current-advertised NOTE: Reference: T260173 had an invalid url (/media/3870), using list url instead! Saving record T260173, 30 Breyleigh Drive, Pakenham, VIC NOTE: Reference: T260120 had an invalid url (/media/3874), using list url instead! Saving record T260120, 3 George Street, Bunyip, VIC Saving record T160676-2, 95 Hall Road, Pakenham South, VIC Saving record T260459, Commercial Drive, Pakenham, VIC Saving record T260240, 53-55 Main StreetNar Nar Goon, VIC Saving record T260237 , 95 Hall RoadPakenham South, VIC Saving record T260127, U 1/23 Main StreetNar Nar Goon, VIC Saving record T100906-1, FY 9 / 22-26 Bald Hill Road, Pakenham, VIC Saving record T260356, 11 Kookaburra Rise, Pakenham, VIC Saving record T260470, 40 Avon Road, Avonsleigh, VIC Saving record T260308, 990 Longwarry-Modella Road, Modella, VIC Saving record T260260, Shop 2 / 10 Westernport Road, Lang Lang, VIC Saving record T260288, 111 Downey Street, Dewhurst, VIC Saving record T260215, 16 Hamilton Road, Emerald, VIC Saving record T260005, 20 Lenne StreetBeaconsfield Upper, VIC Finished! Saved 15 applications.

Data

Downloaded 6275 times by openaustralia dcalde mlandauer LoveMyData jesse-a-reilly tkrikke repose-lecture kouzi-sys DevAppProject TheZepto davidyu37 equivalentideas 538digital MikeRalphson Joel-Tan_valocity mustafa0 ianheggie-oaf Simsoi Manasaanand AthleticoPrawn TornMarketing derman232 Jedwards157 93399339 danielpurton

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (520 KB) Use the API

rows 10 / 1302

info_url comment_url council_reference description address on_notice_to date_scraped
mailto:mail@cardinia.vic.gov.au
T200500-1
Amendment to planning permit T200500 (that was issued for the use and development of land for a place of worship and associated works) to delete conditions
Army Road (Corner of Murphy Road), Pakenham, VIC
2021-05-13
2021-05-19
mailto:mail@cardinia.vic.gov.au
T200716
Development of the land for a dwelling, earthworks and removal of vegetation
11A Duffys Road, Emerald, VIC
2021-05-13
2021-05-19
mailto:mail@cardinia.vic.gov.au
T200754
Use and development of the land for a car park
Lyle Blue Court, Pakenham (rear of Castellos Hotel), VIC
2021-05-13
2021-05-19
mailto:mail@cardinia.vic.gov.au
T200816
Development of the land for a dwelling and outbuilding and associated works
34 A`Beckett Road, Bunyip, VIC
2021-05-14
2021-05-19
mailto:mail@cardinia.vic.gov.au
T210180
Use of the land for an indoor recreation facility
Trampoline Centre FY 14/99 Bald Hill Road, Pakenham, VIC
2021-05-21
2021-05-24
mailto:mail@cardinia.vic.gov.au
T210001
Removal of vegetation
405 Monomeith Road, Monomeith, VIC
2021-05-24
2021-05-24
mailto:mail@cardinia.vic.gov.au
T200455
Use of the land for a retail premises and signage
122 Old Princes Highway, Beaconsfield, VIC
2021-05-28
2021-06-03
mailto:mail@cardinia.vic.gov.au
T210005
Use and development of the land for domestic animal husbandry (dog breeding)
150 Settlement Road, Caldermeade, VIC
2021-06-04
2021-06-10
mailto:mail@cardinia.vic.gov.au
T210314
Removal of vegetation (five trees, including one native tree)
335 Garfield North Road, Garfield North, VIC
2021-06-04
2021-06-10
mailto:mail@cardinia.vic.gov.au
T210234
Removal of native vegetation (three trees)
4 Wattletree Road, Bunyip, VIC
2021-06-04
2021-06-10

Statistics

Average successful run time: less than a minute

Total run time: 5 days

Total cpu time used: about 1 hour

Total disk space used: 605 KB

History

  • Auto ran revision 2b44bf1f and completed successfully .
    15 records added, 15 records removed in the database
  • Auto ran revision 2b44bf1f and completed successfully .
    15 records added, 15 records removed in the database
  • Auto ran revision 2b44bf1f and completed successfully .
    15 records added, 14 records removed in the database
  • Auto ran revision 2b44bf1f and completed successfully .
    14 records added, 14 records removed in the database
  • Auto ran revision 2b44bf1f and completed successfully .
    14 records added, 14 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

cardinia / scraper.rb