This scraper runs on Morph to scrape DA Applications for LGA's that use it.
As Date range filtering is currently broken, it initially searches for All types, but if it finds more than 5 pages it then filters by "DA Status = On Ehxhibition".
When LGA is not set, it currently shows 11,770 results with 1308 pages of 9 cards per page, so its early days so far.
To get started see the documentation
bundle exec ruby scraper.rb
bundle exec rake
bundle exec rubocop
To download data sign in with GitHub
rows 10 / 45
council_reference | address | description | info_url | date_scraped | authority_label |
---|---|---|---|---|---|
2025.028
|
9 Eighth Division Memorial Avenue, Gunnedah NSW 2380
|
Shed
|
2025-05-11
|
gunnedah
|
|
2025.025
|
8521 Oxley Highway, Gunnedah NSW 2380
|
Dwelling
|
2025-05-11
|
gunnedah
|
|
2025.019
|
1693 Blue Vale Rd, Blue Vale NSW
|
Temporary Event Infrastructure
|
2025-05-11
|
gunnedah
|
|
2025.011
|
View Street, Gunnedah NSW 2380
|
Circus
|
2025-05-11
|
gunnedah
|
|
2024/098
|
29-31 Breeza St, Carroll NSW 2340
|
Shed
|
2025-05-11
|
gunnedah
|
|
202/2017.002
|
107 Barber Street, Gunnedah NSW 2380
|
Mod to Stage Development
|
2025-05-11
|
gunnedah
|
|
2024.095
|
107 George Street, Gunnedah NSW 2380
|
Dual Occupancy & Subdivision
|
2025-05-11
|
gunnedah
|
|
2024.097
|
42 Bindea Place, Gunnedah NSW 2380
|
Dwelling, Garage & Pool
|
2025-05-11
|
gunnedah
|
|
2025.012
|
73 Maitland Street, Gunnedah NSW 2380
|
Dwelling
|
2025-05-11
|
gunnedah
|
|
2024.093
|
23 Palmer Crescent, Gunnedah NSW 2380
|
Home Business
|
2025-05-11
|
gunnedah
|
To download data sign in with GitHub
rows 6 / 6
run_at | attempt | authority_label | records_saved | unprocessable_records | status | error_message | error_class | error_backtrace |
---|---|---|---|---|---|---|---|---|
2025-05-06T21:03:06+00:00
|
1
|
gunnedah
|
45
|
0
|
successful
|
|
|
|
2025-05-07T23:26:12+00:00
|
1
|
gunnedah
|
45
|
0
|
successful
|
|
|
|
2025-05-08T20:29:10+00:00
|
1
|
gunnedah
|
45
|
0
|
successful
|
|
|
|
2025-05-09T03:30:10+00:00
|
1
|
gunnedah
|
45
|
0
|
successful
|
|
|
|
2025-05-10T11:24:15+00:00
|
1
|
gunnedah
|
45
|
0
|
successful
|
|
|
|
2025-05-11T02:33:11+00:00
|
1
|
gunnedah
|
45
|
0
|
successful
|
|
|
|
To download data sign in with GitHub
rows 6 / 6
run_at | attempt | duration | successful | failed | interrupted | successful_count | interrupted_count | failed_count | public_ip |
---|---|---|---|---|---|---|---|---|---|
2025-05-06T21:03:06+00:00
|
1
|
8.9
|
gunnedah
|
|
|
1
|
0
|
0
|
|
2025-05-07T23:26:12+00:00
|
1
|
8.6
|
gunnedah
|
|
|
1
|
0
|
0
|
|
2025-05-08T20:29:10+00:00
|
1
|
7.9
|
gunnedah
|
|
|
1
|
0
|
0
|
|
2025-05-09T03:30:10+00:00
|
1
|
7.7
|
gunnedah
|
|
|
1
|
0
|
0
|
|
2025-05-10T11:24:15+00:00
|
1
|
8.7
|
gunnedah
|
|
|
1
|
0
|
0
|
|
2025-05-11T02:33:11+00:00
|
1
|
8.3
|
gunnedah
|
|
|
1
|
0
|
0
|
|
Average successful run time: less than 20 seconds
Total run time: 1 minute
Total cpu time used: less than 20 seconds
Total disk space used: 495 KB