jamasalbertastash / multiple-civica

README.md

This is a scraper that runs on Morph. To get started see the documentation

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

Contributors mlandauer tseyiokorodudu jamasalbertastash

Last run failed with status code 999.

Console output of last run

The Morph Github App installed on jamasalbertastash needs access to the repository multiple-civica. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=592971994&suggested_target_id=104399013 Why? See https://morph.io/documentation/github_app

Data

Downloaded 2 times by jamasalbertastash dcalde

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (184 KB) Use the API

rows 10 / 545

council_reference address description info_url date_received date_scraped authority_label on_notice_from on_notice_to
12113/2023
800L Orient Bend SMITHFIELD QLD 4878
Operational Works - Landscaping Smithfield Village Stage 29
https://eservices.cairns.qld.gov.au/eservice/daEnquiryInit.do?nodeNum=227
2023-01-24
2023-01-25
cairns
204/2023
2 Abbott Close EGLINTON WA 6034
Single Dwelling - Detached
https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047
2023-01-19
2023-01-25
wanneroo
3980/2022
3 Abbott Close EGLINTON WA 6034
AMENDMENT - Single Dwelling - Detached
https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047
2023-01-13
2023-01-25
wanneroo
65/2023
79 Aduro Street EGLINTON WA 6034
Single Dwelling - Detached
https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047
2023-01-10
2023-01-25
wanneroo
167/2023
31 Alabaster Approach JINDALEE WA 6036
Single Dwelling - Detached
https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047
2023-01-18
2023-01-25
wanneroo
99/2023
33 Alabaster Approach JINDALEE WA 6036
Single Dwelling - Detached
https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047
2023-01-12
2023-01-25
wanneroo
143/2023
59 Alabaster Approach JINDALEE WA 6036
Single Dwelling - Detached
https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047
2023-01-17
2023-01-25
wanneroo
82/2023
39 Althorpe Grove EGLINTON WA 6034
Single Dwelling - Detached
https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047
2023-01-11
2023-01-25
wanneroo
182/2023
40 Althorpe Grove EGLINTON WA 6034
Single Dwelling - Detached
https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047
2023-01-18
2023-01-25
wanneroo
155/2023
24 Alveley Loop BUTLER WA 6036
Swimming Pool Safety Fencing
https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047
2023-01-17
2023-01-25
wanneroo

Statistics

Average successful run time: 38 minutes

Total run time: about 5 hours

Total cpu time used: half a minute

Total disk space used: 4.2 MB

History

  • Manually ran and failed .
  • Manually ran and failed .
  • Manually ran and failed .
  • Manually ran revision f171e8fb and completed successfully .
    187 records added, 186 records removed in the database
  • Manually ran revision 5efec1e0 and failed .
    186 records added, 142 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple-civica / scraper.rb