yourneighbourhood / LoganDA

Logan City Council


This is a scraper that runs on Morph. To get started see the documentation

Contributors yourneighbourhood

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/......  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Using bundler 1.15.2  Fetching unf_ext 0.0.7.1  Installing unf_ext 0.0.7.1 with native extensions  Fetching httpclient 2.6.0.1  Installing httpclient 2.6.0.1  Fetching mime-types 2.5  Installing mime-types 2.5  Fetching net-http-digest_auth 1.4  Installing net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile 0.6.2  Installing mini_portile 0.6.2  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.1  Installing webrobots 0.1.1  Fetching sqlite3 1.3.10  Installing sqlite3 1.3.10 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching nokogiri 1.6.6.2  Installing nokogiri 1.6.6.2 with native extensions  Fetching sqlite_magic 0.0.3  Installing sqlite_magic 0.0.3  Fetching domain_name 0.5.24  Installing domain_name 0.5.24  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching mechanize 2.7.3  Installing mechanize 2.7.3  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (23.53s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data in `thisweek`, changable via MORPH_PERIOD environment Scraping page 1... Skipping already saved record MCUC-41/2020 Skipping already saved record RL-36/2020 Skipping already saved record OW-351/2018 Skipping already saved record SBR-6/2020 Skipping already saved record BWAP-190/2020 Skipping already saved record BWAP-194/2020 Saving record BWAP-195/2020 - 7 Bindi Street LOGAN CENTRAL QLD 4114 Saving record BWAP-197/2020 - 56-58 Holyrood Court MUNRUBEN QLD 4125 Skipping already saved record PD-603/2020 Skipping already saved record PD-603/2020 Scraping page 2... Skipping already saved record PD-603/2020 Skipping already saved record PD-603/2020 Skipping already saved record PD-603/2020 Skipping already saved record PD-1394/2020 Skipping already saved record PD-1395/2020 Skipping already saved record PD-1396/2020 Skipping already saved record PD-1397/2020 Skipping already saved record PD-1399/2020 Skipping already saved record PD-1400/2020 Skipping already saved record PD-1401/2020 Scraping page 3... Skipping already saved record PD-1398/2020 Skipping already saved record PD-1402/2020 Skipping already saved record PD-1403/2020 Skipping already saved record PD-1404/2020 Skipping already saved record PD-1405/2020 Skipping already saved record PD-1406/2020 Skipping already saved record PD-1408/2020 Skipping already saved record PD-1409/2020 Skipping already saved record PD-1410/2020 Skipping already saved record PD-1412/2020 Scraping page 4... Skipping already saved record PD-1413/2020 Skipping already saved record PD-1414/2020 Skipping already saved record PD-1415/2020 Skipping already saved record PD-1416/2020 Skipping already saved record PD-1417/2020 Skipping already saved record PD-1411/2020 Skipping already saved record PD-1418/2020 Skipping already saved record PD-1419/2020 Skipping already saved record PD-1421/2020 Skipping already saved record PD-1422/2020 Scraping page 5... Skipping already saved record PD-1423/2020 Saving record PD-1435/2020 - 48 Doncaster Street HERITAGE PARK QLD 4118 Saving record PD-1074/2020 - 17-27 Halcyon Way LOGAN RESERVE QLD 4133 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 6... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 7... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1088/2020 Scraping page 8... Saving record PD-1424/2020 - 9 Bandicoot Drive BAHRS SCRUB QLD 4207 Saving record PD-1425/2020 - 57 Macadamia Circuit PARK RIDGE QLD 4125 Saving record PD-1427/2020 - 4 Darling Court FLAGSTONE QLD 4280 Skipping already saved record PD-1024/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 9... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 10... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 11... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 12... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 13... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 14... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 15... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 16... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 17... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Scraping page 18... Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Skipping already saved record PD-1074/2020 Saving record PD-1428/2020 - 36 Expedition Road YARRABILBA QLD 4207 Saving record PD-1429/2020 - 24 Wallum Circuit BAHRS SCRUB QLD 4207 Saving record PD-1430/2020 - 33-87 Anzac Avenue CHAMBERS FLAT QLD 4133 Saving record PD-1431/2020 - 21 Manglo Street SHAILER PARK QLD 4128 Saving record PD-1432/2020 - 89 Macmillan Loop BELIVAH QLD 4207 Saving record PD-1433/2020 - 28 Roselea Avenue BAHRS SCRUB QLD 4207 Scraping page 19... Saving record PD-1434/2020 - 3 Herbst Drive BAHRS SCRUB QLD 4207 Skipping already saved record BW-4335/2020 Skipping already saved record BW-4337/2020 Skipping already saved record BW-4338/2020 Skipping already saved record BW-4340/2020 Skipping already saved record BW-4341/2020 Skipping already saved record BW-4342/2020 Skipping already saved record BW-4343/2020 Skipping already saved record BW-4344/2020 Skipping already saved record BW-4345/2020 Scraping page 20... Skipping already saved record BW-4347/2020 Skipping already saved record BW-4348/2020 Skipping already saved record BW-4349/2020 Skipping already saved record BW-4350/2020 Skipping already saved record BW-4351/2020 Skipping already saved record BW-4352/2020 Skipping already saved record BW-4353/2020 Skipping already saved record BW-4354/2020 Skipping already saved record BW-4355/2020 Skipping already saved record BW-4356/2020 Scraping page 21... Skipping already saved record BW-4357/2020 Skipping already saved record BW-4358/2020 Skipping already saved record BW-4363/2020 Skipping already saved record BW-4365/2020 Skipping already saved record BW-4367/2020 Skipping already saved record BW-4368/2020 Skipping already saved record BW-4369/2020 Skipping already saved record BW-4371/2020 Skipping already saved record BW-4372/2020 Skipping already saved record BW-4379/2020 Scraping page 22... Skipping already saved record BW-4380/2020 Skipping already saved record BW-4381/2020 Skipping already saved record BW-4382/2020 Skipping already saved record BW-4383/2020 Skipping already saved record BW-4384/2020 Skipping already saved record BW-4385/2020 Skipping already saved record BW-4386/2020 Skipping already saved record BW-4387/2020 Skipping already saved record BW-4388/2020 Skipping already saved record BW-4389/2020 Scraping page 23... Skipping already saved record BW-4390/2020 Skipping already saved record BW-4392/2020 Skipping already saved record BW-4393/2020 Skipping already saved record BW-4394/2020 Skipping already saved record BW-4395/2020 Skipping already saved record BW-4396/2020 Skipping already saved record BW-4397/2020 Skipping already saved record BW-4398/2020 Skipping already saved record BW-4399/2020 Skipping already saved record BW-4400/2020 Scraping page 24... Skipping already saved record BW-4401/2020 Skipping already saved record BW-4402/2020 Skipping already saved record BW-4403/2020 Skipping already saved record BW-4405/2020 Skipping already saved record BW-4406/2020 Skipping already saved record BW-4408/2020 Skipping already saved record BW-4412/2020 Skipping already saved record BW-4413/2020 Skipping already saved record BW-4415/2020 Skipping already saved record BW-4417/2020 Scraping page 25... Skipping already saved record BW-4418/2020 Skipping already saved record BW-4419/2020 Skipping already saved record BW-4420/2020 Skipping already saved record BW-4422/2020 Skipping already saved record BW-4424/2020 Skipping already saved record BW-4425/2020 Skipping already saved record BW-4429/2020 Skipping already saved record BW-4431/2020 Skipping already saved record BW-4432/2020 Skipping already saved record BW-4433/2020 Scraping page 26... Skipping already saved record BW-4434/2020 Skipping already saved record BW-4435/2020 Skipping already saved record BW-4436/2020 Skipping already saved record BW-4437/2020 Skipping already saved record BW-4438/2020 Skipping already saved record BW-4439/2020 Skipping already saved record BW-4440/2020 Skipping already saved record BW-4441/2020 Skipping already saved record BW-4443/2020 Skipping already saved record BW-4448/2020 Scraping page 27... Skipping already saved record BW-4449/2020 Skipping already saved record BW-4453/2020 Skipping already saved record BW-4454/2020 Skipping already saved record BW-4457/2020 Skipping already saved record BW-4461/2020 Skipping already saved record BW-4462/2020 Skipping already saved record BW-4463/2020 Skipping already saved record BW-4464/2020 Skipping already saved record BW-4465/2020 Skipping already saved record BW-4466/2020 Scraping page 28... Skipping already saved record BW-4469/2020 Skipping already saved record BW-4470/2020 Skipping already saved record BW-4472/2020 Skipping already saved record BW-4476/2020 Skipping already saved record BW-4477/2020 Skipping already saved record BW-4479/2020 Skipping already saved record BW-4480/2020 Skipping already saved record BW-4481/2020 Skipping already saved record BW-4486/2020 Skipping already saved record BW-4487/2020 Scraping page 29... Skipping already saved record BW-4491/2020 Saving record BW-4500/2020 - WOODRIDGE NORTH PRIMARY & PRE-SCHOOL 3-11 Arthur Street WOODRIDGE QLD 4114 Saving record BW-4501/2020 - 37-41 Hotz Road LOGAN VILLAGE QLD 4207 Saving record BW-4502/2020 - 19-27 Coonan Road SOUTH MACLEAN QLD 4280 Saving record BW-4503/2020 - 15-17 Colt Court SOUTH MACLEAN QLD 4280 Saving record BW-4504/2020 - FLAGSTONE VILLAGE 1-21 Bushman Drive FLAGSTONE QLD 4280 Saving record BW-4505/2020 - 6 Maranoa Street LOGAN RESERVE QLD 4133 Saving record BW-4506/2020 - 5 Spyda Road BAHRS SCRUB QLD 4207 Saving record BW-4507/2020 - 11-13 Loch Ness Circuit NEW BEITH QLD 4124 Saving record BW-4509/2020 - FLAGSTONE VILLAGE 1-21 Bushman Drive FLAGSTONE QLD 4280 Scraping page 30... Saving record BW-4512/2020 - 33 Kelvin Street WOODRIDGE QLD 4114 Saving record BW-4514/2020 - 60 Trudy Crescent CORNUBIA QLD 4130 Saving record BW-4515/2020 - 27-29 Flagtail Circuit NEW BEITH QLD 4124 Saving record BW-4516/2020 - 52 Lake Road SLACKS CREEK QLD 4127 Saving record BW-4517/2020 - 33 Elizabeth Drive FLAGSTONE QLD 4280 Saving record BW-4519/2020 - 308 Middle Road BORONIA HEIGHTS QLD 4124 Saving record BW-4520/2020 - 238-240 Forestdale Drive FORESTDALE QLD 4118 Saving record BW-4523/2020 - 16 Merino Street PARK RIDGE QLD 4125 Skipping already saved record SP-105/2020 Skipping already saved record SP-106/2020 Scraping page 31... Saving record SP-107/2020 - Lot 9002 Everleigh Drive GREENBANK QLD 4124 Saving record SP-108/2020 - 415-417 Springwood Road DAISY HILL QLD 4127 Skipping already saved record OWVM-14/2020 Skipping already saved record MCUR-129/2020 Skipping already saved record MCUR-131/2020 Saving record MCUR-132/2020 - 45-47 Gumview Crescent FLAGSTONE QLD 4280 Saving record MCUR-133/2020 - 92-98 Dungaree Drive NEW BEITH QLD 4124 Saving record MCUR-134/2020 - 63-65 Tomohon Heights Close LOGAN VILLAGE QLD 4207

Data

Downloaded 1 time by yourneighbourhood

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (559 KB) Use the API

rows 10 / 1787

info_url council_reference date_received description address date_scraped comment_url
MCUC-126347/2001
2020-04-20
Minor Change (Material Change of Use for a Place of Worship, Educational Establishment, Indoor Entertainment and Accommodation Building and Preliminary Approval for Building and Operational Works for Extension and Changes to Existing Buddhist Temple)
1034-1106 Underwood Road PRIESTDALE QLD 4127
2020-04-22
mailto:council@logan.qld.gov.au
MCUC-43/2019
2020-04-21
Minor Change - Low Impact Industry x2
7 Chetwynd Street LOGANHOLME QLD 4129
2020-04-22
mailto:council@logan.qld.gov.au
OW-59/2020
2020-04-20
Operational Works in Association with COM/67/2018 (Child Care Centre Component)
421-427 Chambers Flat Road PARK RIDGE QLD 4125
2020-04-22
mailto:council@logan.qld.gov.au
BWAP-114/2020
2020-04-20
Garage (Increased Size and Reduced Rear Boundary Clearance)
66-68 Panitz Drive JIMBOOMBA QLD 4280
2020-04-22
mailto:council@logan.qld.gov.au
BWAP-88/2019
2020-04-20
Minor Change (Shed, Retaining Wall (Increased Combined Size; Reduced Side Boundary Clearance))
29 Goldfinch Court GREENBANK QLD 4124
2020-04-22
mailto:council@logan.qld.gov.au
PD-810/2020
2020-04-20
Domestic - Dwelling
4 Heron Lane BAHRS SCRUB QLD 4207
2020-04-22
mailto:council@logan.qld.gov.au
PD-811/2020
2020-04-20
Domestic - Dwelling OSSF
67-73 Mahoney Road WOODHILL QLD 4285
2020-04-22
mailto:council@logan.qld.gov.au
PD-812/2020
2020-04-20
Domestic - Dwelling
6 Indigo Lane PARK RIDGE QLD 4125
2020-04-22
mailto:council@logan.qld.gov.au
PD-813/2020
2020-04-20
Domestic - Dwelling
33 Belivah Road BELIVAH QLD 4207
2020-04-22
mailto:council@logan.qld.gov.au
PD-814/2020
2020-04-20
Domestic - Dwelling
8 Samford Drive HOLMVIEW QLD 4207
2020-04-22
mailto:council@logan.qld.gov.au

Statistics

Average successful run time: less than a minute

Total run time: about 1 hour

Total cpu time used: 2 minutes

Total disk space used: 587 KB

History

  • Auto ran revision 149d6b58 and completed successfully .
    36 records added in the database
  • Auto ran revision 149d6b58 and completed successfully .
    23 records added in the database
  • Auto ran revision 149d6b58 and completed successfully .
    19 records added in the database
  • Auto ran revision 149d6b58 and completed successfully .
    60 records added in the database
  • Auto ran revision 149d6b58 and completed successfully .
    38 records added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

LoganDA / scraper.rb