ianheggie-oaf / multiple_atdis-prs

Test all multiple_atdis PRs

README.md

This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

Contributors mlandauer

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Collecting ATDIS feed data for armidale... Storing 341392 - 5232 New England Highway, LLANGOTHLIN, NSW 2365 Storing 340207 - 28 O'Dell Street, ARMIDALE, NSW 2350 Storing 340206 - 159 Long Swamp Road, ARMIDALE, NSW 2350 Storing 340205 - 229 Mann Street, ARMIDALE, NSW 2350 Collecting ATDIS feed data for bathurst... D, [2025-05-09T03:03:22.849179 #18] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2025-05-09&lodgement_date_start=2025-04-09&page=3 D, [2025-05-09T03:03:26.877783 #18] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2025-05-09&lodgement_date_start=2025-04-09&page=4 D, [2025-05-09T03:03:28.730870 #18] DEBUG -- : Fetching http://masterview.bathurst.nsw.gov.au/atdis/1.0//applications.json?lodgement_date_end=2025-05-09&lodgement_date_start=2025-04-09&page=5 W, [2025-05-09T03:03:29.159262 #18] WARN -- : No/invalid pagination, assuming no records/aborting Collecting ATDIS feed data for kiama... kiama: ERROR: Timed out connecting to server /app/vendor/bundle/ruby/2.5.0/gems/rest-client-2.1.0/lib/restclient/request.rb:749:in `rescue in transmit' /app/vendor/bundle/ruby/2.5.0/gems/rest-client-2.1.0/lib/restclient/request.rb:651:in `transmit' /app/vendor/bundle/ruby/2.5.0/gems/rest-client-2.1.0/lib/restclient/request.rb:163:in `execute' /app/vendor/bundle/ruby/2.5.0/gems/rest-client-2.1.0/lib/restclient/request.rb:63:in `execute' /app/vendor/bundle/ruby/2.5.0/gems/rest-client-2.1.0/lib/restclient/resource.rb:51:in `get' /app/vendor/bundle/ruby/2.5.0/gems/atdis-0.5.0/lib/atdis/model.rb:79:in `read_url_raw' /app/vendor/bundle/ruby/2.5.0/gems/atdis-0.5.0/lib/atdis/model.rb:83:in `read_url' /app/vendor/bundle/ruby/2.5.0/gems/atdis-0.5.0/lib/atdis/feed.rb:72:in `applications' /app/lib/atdisplanningalertsfeed.rb:45:in `fetch_all_pages' /app/lib/atdisplanningalertsfeed.rb:19:in `fetch' scraper.rb:27:in `block in <main>' scraper.rb:21:in `each' scraper.rb:21:in `<main>' scraper.rb:39:in `<main>': There were earlier errors. See output for details (RuntimeError)

Data

Downloaded 1296 times by ianheggie-oaf

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (7 KB) Use the API

rows 5 / 5

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to authority_label
340195
100 Rujala Lane, ARMIDALE, NSW 2350
1 into 17 lot low-density residential subdivision
https://epathway.newengland.nsw.gov.au/ePathway/Production/Web/GeneralEnquiry/ExternalRequestBroker.aspx?Module=EGELAP&Type=TRACK&Class=EPA&ApplicationId=340195
2025-04-25
2025-03-28
2025-04-08
2025-04-22
armidale
341392
5232 New England Highway, LLANGOTHLIN, NSW 2365
Demolition of Existing buildings and structures and construction of a New Service Station, General Store and Post Office
https://epathway.newengland.nsw.gov.au/ePathway/Production/Web/GeneralEnquiry/ExternalRequestBroker.aspx?Module=EGELAP&Type=TRACK&Class=EPA&ApplicationId=341392
2025-05-09
2025-05-06
armidale
340207
28 O'Dell Street, ARMIDALE, NSW 2350
Installation of 3 x 2 bedroom manufactured homes
https://epathway.newengland.nsw.gov.au/ePathway/Production/Web/GeneralEnquiry/ExternalRequestBroker.aspx?Module=EGELAP&Type=TRACK&Class=EPA&ApplicationId=340207
2025-05-09
2025-04-15
2025-05-01
2025-05-15
armidale
340206
159 Long Swamp Road, ARMIDALE, NSW 2350
Change use of shed (under Construction) to a dwelling (temporary occupation) until main dwelling is built). Refer to DA-74-2022/A
https://epathway.newengland.nsw.gov.au/ePathway/Production/Web/GeneralEnquiry/ExternalRequestBroker.aspx?Module=EGELAP&Type=TRACK&Class=EPA&ApplicationId=340206
2025-05-09
2025-04-15
2025-04-29
2025-05-13
armidale
340205
229 Mann Street, ARMIDALE, NSW 2350
Proposed Boundary adjustment
https://epathway.newengland.nsw.gov.au/ePathway/Production/Web/GeneralEnquiry/ExternalRequestBroker.aspx?Module=EGELAP&Type=TRACK&Class=EPA&ApplicationId=340205
2025-05-09
2025-04-14
2025-04-24
2025-05-08
armidale

Statistics

Total run time: 14 minutes

Total cpu time used: less than 20 seconds

Total disk space used: 956 KB

History

  • Auto ran revision 5afa7a3a and failed .
    4 records added, 4 records removed in the database
  • Auto ran revision 5afa7a3a and failed .
    4 records added, 3 records removed in the database
  • Auto ran revision 5afa7a3a and failed .
    3 records added, 3 records removed in the database
  • Auto ran revision 5afa7a3a and failed .
    3 records added, 3 records removed in the database
  • Auto ran revision 5afa7a3a and failed .
    3 records added, 3 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_atdis-prs / scraper.rb