tseyiokorodudu / multiple_horizon

Scrapes multiple authorities with the horizon system


This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

What an Horizon/SolOrient website looks like

Screenshots

(To update this screenshot run bundle exec rake screenshots)

Contributors mlandauer dependabot[bot] tseyiokorodudu

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping authorities: berrigan, leeton, cowra, liverpool_plains, warrumbungle, walcha, weddin, maitland Collecting feed data for berrigan... Collecting feed data for leeton... berrigan: ERROR: 403 => Net::HTTPForbidden for http://datracking.berriganshire.nsw.gov.au/Horizon/logonGuest.aw?domain=horizondap#/home -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/horizon_xml.rb:159:in `scrape_url' /app/lib/horizon_xml.rb:72:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:30:in `<main>' Collecting feed data for cowra... leeton: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/horizon_xml.rb:159:in `scrape_url' /app/lib/horizon_xml.rb:72:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:30:in `<main>' Saving record OC 2019/38.2, 27 Vaux Street COWRA 2794 NSW Saving record OC 2019/127.1, 58 Kite Street COWRA 2794 NSW Saving record OC 2021/55.2, 22 Waddell Street WATTAMONDARA 2794 NSW Saving record OC 2020/49.1, 21 Bartlett Avenue COWRA 2794 NSW Saving record OC 2020/59.1, 50 Vaux Street COWRA 2794 NSW Saving record DA 2021/138.1, 66 Lyall Street COWRA 2794 NSW Saving record DA 2021/139.1, 39 Main Street DARBYS FALLS 2793 NSW Saving record OC 2019/25.1, 313 Elouera Road COWRA 2794 NSW Saving record OC 2019/40.1, 42 Dawson Drive COWRA 2794 NSW Saving record CC 2021/93.1, 196 Camp Road COWRA 2794 NSW Saving record DA 2021/137.1, Campbell Street COWRA 2794 NSW Saving record OC 2019/53.1, 1469 Binni Creek Road WOODSTOCK 2793 NSW Saving record FS 2021/65.2, 11 Vaux Street COWRA 2794 NSW Saving record FS 2021/104.1, 2951 Belubula Way CANOWINDRA 2804 NSW Saving record DA 2021/136.1, 50 Hartley Street COWRA 2794 NSW Saving record CDC 2021/31.1, 76 Killara Road COWRA 2794 NSW Saving record OC 2021/7.1, 51 Liverpool Street COWRA 2794 NSW Saving record S68 2021/6.1, 1-3 Bowen Street WOODSTOCK 2793 NSW Saving record CDC 2021/30.1, 11 Vineyard Drive COWRA 2794 NSW Saving record OC 2021/65.1, 11 Vaux Street COWRA 2794 NSW Saving record DA 2004/196.3, 3 Shepherd Avenue COWRA 2794 NSW Saving record OC 2020/28.1, 43 Dawson Drive COWRA 2794 NSW Saving record DA 2021/135.1, 2 Yarrawonga Crescent COWRA 2794 NSW Collecting feed data for liverpool_plains... Saving record S68 2021/57.1, 124 George Street QUIRINDI 2343 NSW Saving record CDC 2021/16.1, 54 Rosebys Road WALLABADAH 2343 NSW Saving record DA 2021/77.1, 36 Breeza Street QUIRINDI 2343 NSW Saving record DA 2021/78.1, 22 Munro Street QUIRINDI 2343 NSW Saving record DA 2021/79.1, 6-8 Simpson Street QUIRINDI 2343 NSW Saving record DA 2021/80.1, 87 Bolah Ridge Road QUIRINDI 2343 NSW Saving record DA 2021/81.1, 28 Doyle Street QUIRINDI 2343 NSW Saving record DA 2021/82.1, 615 Colly Plains Road QUIRINDI 2343 NSW Saving record DA 2020/1.2, 129 Railway Parade WERRIS CREEK 2341 NSW Saving record CC 2021/32.1, 72 Sheedys Lane CURRABUBULA 2342 NSW Saving record DA 2021/50.2, 713 Gap Road WERRIS CREEK 2341 NSW Saving record DA 2021/76.1, 52 Learmonth Street WILLOW TREE 2339 NSW Saving record S68 2021/56.1, 149 Warrah Park Lane WILLOW TREE 2339 NSW Saving record DA 2021/75.1, 520 Harrisons Plains Road WARRAH RIDGE 2343 NSW Saving record DA 2021/74.1, 97 Loder Street QUIRINDI 2343 NSW Saving record S68 2021/55.1, 262 George Street QUIRINDI 2343 NSW Saving record DA 2021/72.1, 9 Grandview Place QUIRINDI 2343 NSW Saving record DA 2021/73.1, 149 Warrah Park Lane WILLOW TREE 2339 NSW Saving record S68 2021/54.1, 100 Loder Street QUIRINDI 2343 NSW Saving record DA 2021/66.1, 17 Fitzroy Street QUIRINDI 2343 NSW Collecting feed data for warrumbungle... Collecting feed data for walcha... Saving record S68 2021/38.1, 8985 Thunderbolts Way NOWENDOC 2354 NSW Saving record DA 2021/45.1, 8985 Thunderbolts Way NOWENDOC 2354 NSW Saving record CC 2021/46.1, 174W North Street WALCHA 2354 NSW Saving record DA 2021/42.1, 169W Evans Street WALCHA 2354 NSW Saving record DA 2017/26.2, 101 Ohio Road WALCHA 2354 NSW Saving record SC 2021/8.1, 1643 Oxley Highway WALCHA 2354 NSW Saving record S68 2021/37.1, 11S Lagoon Street WALCHA 2354 NSW Saving record CDC 2021/15.1, 11S Lagoon Street WALCHA 2354 NSW Saving record DA 2021/43.1, * Oxley Highway WALCHA 2354 NSW Saving record DA 2021/44.1, 209W Fitzroy Street WALCHA 2354 NSW Saving record S68 2021/36.1, 9756 Thunderbolts Way NOWENDOC 2354 NSW Saving record DA 2021/39.1, 101W Hill Street WALCHA 2354 NSW Collecting feed data for weddin... Saving record CC2021/58.1, 58 Main Street GRENFELL 2810 NSW Saving record OC2020/76.1, 13 Berrys Road GRENFELL 2810 NSW Saving record OC2021/53.1, 323 Claneys Road GRENFELL 2810 NSW Saving record CC2019/11.3, 4951 Henry Lawson Way GRENFELL 2810 NSW Saving record CC2021/54.1, 15 Bradley Street GRENFELL 2810 NSW Saving record FS2021/29.1, 102 Main Street GRENFELL 2810 NSW Saving record DA2021/65.1, 51 Forbes Street GRENFELL 2810 NSW Saving record CC2021/29.1, 102 Main Street GRENFELL 2810 NSW Saving record S682021/18.1, Main Street GRENFELL 2810 NSW Saving record CC2021/59.1, 74 Wyalong Street CARAGABAL 2810 NSW Saving record OC2021/42.1, 1 Walshs Lane GRENFELL 2810 NSW Saving record OC2020/78.1, 1841 Mary Gilmore Way GRENFELL 2810 NSW Collecting feed data for maitland... Saving record DA/2021/1658, 6 Eldon Drive LOUTH PARK NSW 2320 Saving record DA/2021/1661, 229 Glenarvon Road LORN NSW 2320 Saving record CDC/2021/739, 1 Eldon Drive LOUTH PARK NSW 2320 Saving record CDC/2021/763, 22 Hunterglen Drive BOLWARRA HEIGHTS NSW 2320 Saving record CDC/2021/764, 14 Mount Harris Drive MAITLAND VALE NSW 2320 Saving record CC/2021/1178, 40A Grand Parade RUTHERFORD NSW 2320 Saving record CC/2021/1180, 40A Grand Parade RUTHERFORD NSW 2320 Saving record DA/2021/1615, 232 Paterson Road BOLWARRA HEIGHTS NSW 2320 Saving record DA/2021/773:2, 7 Poynton Place THORNTON NSW 2322 Saving record DA/2021/1640, 5 Eire Close ASHTONFIELD NSW 2323 Saving record DA/2021/1642, 15 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1645, 6 Mapplewell Circuit FARLEY NSW 2320 Saving record DA/2021/1648, 343 New England Highway RUTHERFORD NSW 2320 Saving record DA/2021/1650, 56 Crestwood Road THORNTON NSW 2322 AUSTRALIA Saving record DA/2021/1657, 9 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1663, 2C South Street TELARAH NSW 2320 Saving record DA/2021/1665, 8 Dove Street ABERGLASSLYN NSW 2320 Saving record CDC/2021/749, 9 Charlotte Street LOCHINVAR NSW 2321 Saving record CDC/2021/750, 181 Settlers Boulevard CHISHOLM NSW 2322 Saving record CDC/2021/751, 19 Basker Street CHISHOLM NSW 2322 Saving record CDC/2021/752, 3 Redwood Drive GILLIESTON HEIGHTS NSW 2321 Saving record CDC/2021/753, 51 Raworth Avenue RAWORTH NSW 2321 Saving record CDC/2021/754, 1 Loquat Street LOCHINVAR NSW 2321 Saving record CDC/2021/756, 46 Spitfire Place RUTHERFORD NSW 2320 Saving record CDC/2021/755, 46 Spitfire Place RUTHERFORD NSW 2320 Saving record CDC/2021/757, 16 Annaliese Street CHISHOLM NSW 2322 Saving record CDC/2021/758, 18 Tillage Drive LOCHINVAR NSW 2321 Saving record CDC/2021/759, 4 Peppercorn Close ABERGLASSLYN NSW 2320 Saving record CDC/2021/760, 33 London Avenue MORPETH NSW 2321 Saving record CDC/2021/761, 28 Annaliese Street CHISHOLM NSW 2322 Saving record CDC/2021/762, 44 Brisbane Street EAST MAITLAND NSW 2323 Saving record CC/2021/1145, 15 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1147, 6 Mapplewell Circuit FARLEY NSW 2320 Saving record CC/2021/1151, 9 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1162, 2C South Street TELARAH NSW 2320 Saving record CC/2021/1176, 250 Settlers Boulevard CHISHOLM NSW 2322 Saving record DA/2021/1576, 75 Chelmsford Drive METFORD NSW 2323 Saving record DA/2021/1631, 7 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1633, 13 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1644, 82 O'Connells Road LOUTH PARK NSW 2320 Saving record DA/2021/1646, 45 Esk Circuit MAITLAND VALE NSW 2320 Saving record DA/2021/1656, 25 Hinchinbrook Close ASHTONFIELD NSW 2323 Saving record DA/2021/1684, 25 Collaroy Parade LOUTH PARK NSW 2320 Saving record CDC/2021/731, 78 Johannes Street LOCHINVAR NSW 2321 Saving record CDC/2021/732, 78 Johannes Street LOCHINVAR NSW 2321 Saving record CDC/2021/741, 32 Skimmer Street CHISHOLM NSW 2322 Saving record CDC/2021/742, 23 Annaliese Street CHISHOLM NSW 2322 Saving record CDC/2021/743, 23 St Fagans Parade RUTHERFORD NSW 2320 Saving record CDC/2021/744, 28 Pandanus Circuit BOLWARRA NSW 2320 Saving record CDC/2021/745, 8 Cruiser Street CHISHOLM NSW 2322 Saving record CDC/2021/746, 1 Cascade Close LOUTH PARK NSW 2320 Saving record CDC/2021/747, 12 Arklow Crescent CHISHOLM NSW 2322 Saving record CDC/2021/748, 56 Settlers Boulevard CHISHOLM NSW 2322 Saving record CC/2021/1138, 49 Annaliese Street CHISHOLM NSW 2322 Saving record CC/2021/1140, 7 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1143, 13 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1146, 82 O'Connells Road LOUTH PARK NSW 2320 Saving record CC/2021/1148, 45 Esk Circuit MAITLAND VALE NSW 2320 Saving record CC/2021/1173, 25 Collaroy Parade LOUTH PARK NSW 2320 Saving record CC/2021/1174, 8 Esk Circuit MAITLAND VALE NSW 2320 Saving record CC/2021/1175, 41-45 Chelmsford Drive METFORD NSW 2323 Saving record DA/2021/1587, 30 Farnsworth Street THORNTON NSW 2322 Saving record DA/2021/1622, 8 Brighton Street THORNTON NSW 2322 Saving record DA/2021/1629, 177 Gullivers Lane LOUTH PARK NSW 2320 Saving record DA/2021/1630, 49 Annaliese Street CHISHOLM NSW 2322 Saving record DA/2021/1636, 20 Petaltail Street CHISHOLM NSW 2322 Saving record DA/2021/1641, 4 Dodworth Street FARLEY NSW 2320 Saving record DA/2021/1647, 76 Tarragon Way CHISHOLM NSW 2322 Saving record DA/2021/1649, 1204 New England Highway LOCHINVAR NSW 2321 Saving record CDC/2021/734, 26 Lilac Avenue LOCHINVAR NSW 2321 Saving record CDC/2021/735, Lawson Avenue WOODBERRY NSW 2322 Saving record CDC/2021/736, 6 Lilac Avenue LOCHINVAR NSW 2321 Saving record CDC/2021/737, 75 Chelmsford Drive METFORD NSW 2323 Saving record CDC/2021/738, 1 Eldon Drive LOUTH PARK NSW 2320 Saving record CDC/2021/740, 19 Silvarum Street CHISHOLM NSW 2322 Saving record CC/2021/1137, 5 Peate Way LOUTH PARK NSW 2320 Saving record CC/2021/1170, 2/90 Hillsborough Road HILLSBOROUGH NSW 2320 Saving record CC/2021/1171, 22 Mount Harris Drive MAITLAND VALE NSW 2320 Saving record SM2021/33, 93 Luskintyre Road LOCHINVAR NSW 2321 Saving record CC/2021/1168, 1A Reflection Drive LOUTH PARK NSW 2320 Saving record DA/2021/1540, 1/175 High Street MAITLAND NSW 2320 Saving record DA/2021/1616, 12 Mapplewell Circuit FARLEY NSW 2320 Saving record DA/2021/1621, 3 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1626, 5 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1632, 46 Bordeaux Terrace LOCHINVAR NSW 2321 Saving record DA/2021/1638, 16 Masters Street RUTHERFORD NSW 2320 Saving record DA/2021/1653, 13 Ingall Street METFORD NSW 2323 Saving record DA/2021/1667, 3 Peate Way LOUTH PARK NSW 2320 Saving record DA/2016/1340:4, 9 Beryl Drive RUTHERFORD NSW 2320 Saving record CDC/2021/727, 6 Cruiser Street CHISHOLM NSW 2322 Saving record CDC/2021/728, 33 Annaliese Street CHISHOLM NSW 2322 Saving record CDC/2021/729, 9 Tramea Way CHISHOLM NSW 2322 Saving record CDC/2021/730, 56 Mustang Drive RUTHERFORD NSW 2320 Saving record CDC/2021/733, 14 Mitchell Drive EAST MAITLAND NSW 2323 Saving record CC/2021/1129, 12 Mapplewell Circuit FARLEY NSW 2320 Saving record CC/2021/1133, 3 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1134, 5 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1165, 3 Peate Way LOUTH PARK NSW 2320 Saving record CC/2021/1166, 12 Golf Links Road TENAMBIT NSW 2323 Saving record DA/2021/1546, 24 Blakewell Road THORNTON NSW 2322 Saving record DA/2021/1547, 29 Tillage Drive LOCHINVAR NSW 2321,31 Tillage Drive LOCHINVAR NSW 2321 Saving record DA/2021/1567, 7 Grey Gum Crescent CHISHOLM NSW 2322 Saving record DA/2021/1592, 103 Grand Parade RUTHERFORD NSW 2320 Saving record DA/2021/1602, 13 Meteor Place RUTHERFORD NSW 2320 Saving record DA/2021/1614, 1 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1627, 7 Aberglasslyn Road RUTHERFORD NSW 2320 Saving record DA/2021/1628, 22 Teal Street ABERGLASSLYN NSW 2320 Saving record DA/2021/1660, 118 Somerset Drive THORNTON NSW 2322 Saving record DA/2021/1662, Raymond Terrace Road THORNTON NSW 2322 Saving record DA/2021/1664, 15 Poynton Place THORNTON NSW 2322 Saving record DA/2021/1666, Rowantide 204 Luskintyre Road LUSKINTYRE NSW 2321 Saving record CDC/2021/722, 5 Basker Street CHISHOLM NSW 2322 Saving record CDC/2021/724, 29 Annaliese Street CHISHOLM NSW 2322 Saving record CDC/2021/725, 26 Golden Wattle Crescent THORNTON NSW 2322 Saving record CDC/2021/726, 119 Arrowtail Street CHISHOLM NSW 2322 Saving record CC/2021/1079, 24 Blakewell Road THORNTON NSW 2322 Saving record CC/2021/1128, 1 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1135, 7 Aberglasslyn Road RUTHERFORD NSW 2320 Saving record CC/2021/1136, 22 Teal Street ABERGLASSLYN NSW 2320 Saving record CC/2021/1160, 4 Tillage Drive LOCHINVAR NSW 2321 Saving record CC/2021/1161, 6 Tillage Drive LOCHINVAR NSW 2321 Saving record CC/2021/1163, 49 Morpeth Road EAST MAITLAND NSW 2323 Saving record DA/2021/1553, 13 Marika Street LOCHINVAR NSW 2321,15 Marika Street LOCHINVAR NSW 2321 Saving record DA/2021/1573, 93 Luskintyre Road LOCHINVAR NSW 2321 Saving record DA/2021/1591, 7 Sebastian Street LOCHINVAR NSW 2321,9 Sebastian Street LOCHINVAR NSW 2321 Saving record DA/2021/1594, 108 Mustang Drive RUTHERFORD NSW 2320 Saving record DA/2021/1605, 10 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1607, 11 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1612, 18 Thomas Street TELARAH NSW 2320 Saving record DA/2021/1617, 305 High Street MAITLAND NSW 2320 Saving record DA/2021/1619, 10 Ardennes Circuit GILLIESTON HEIGHTS NSW 2321 Saving record DA/2021/1620, 20 Mala Close LOUTH PARK NSW 2320 Saving record DA/2021/1623, 10 Masters Street RUTHERFORD NSW 2320 Saving record DA/2021/1659, 14 Grand Parade RUTHERFORD NSW 2320 Saving record CDC/2021/719, 33 Johannes Street LOCHINVAR NSW 2321 Saving record CDC/2021/720, 3 Redwood Drive GILLIESTON HEIGHTS NSW 2321 Saving record CDC/2021/721, 22 Charles Street EAST MAITLAND NSW 2323 Saving record CC/2021/1120, 10 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1121, 11 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1132, 10 Ardennes Circuit GILLIESTON HEIGHTS NSW 2321 Saving record CC/2021/1150, 14 Brighton Street THORNTON NSW 2322 Saving record CC/2021/1152, 36 Grand Parade RUTHERFORD NSW 2320 Saving record CC/2021/1153, 20 Lomond Street LOUTH PARK NSW 2320 Saving record CC/2021/1154, 4 Glenayre Close EAST MAITLAND NSW 2323 Saving record CC/2021/1155, 244 Duckenfield Road BERRY PARK NSW 2321 Saving record CC/2021/1156, 70 Dragonfly Drive CHISHOLM NSW 2322 Saving record CC/2021/1157, 13 Lomond Street LOUTH PARK NSW 2320 Saving record CC/2021/1158, 9 Pennparc Drive WINDELLA NSW 2320 Saving record CC/2021/1159, 378 Tocal Road MINDARIBBA NSW 2320 Saving record DA/2021/1541, 20 High Street MORPETH NSW 2321 Saving record DA/2021/1569, 73 Gardiner Street RUTHERFORD NSW 2320 Saving record DA/2021/1572, 2 Bushel Street LOCHINVAR NSW 2321 Saving record DA/2021/1575, 13 Ridgmont Circuit THORNTON NSW 2322 Saving record DA/2021/1580, 168 Weblands Street ABERGLASSLYN NSW 2320 Saving record DA/2021/1601, 4 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1604, 3 Lilac Avenue LOCHINVAR NSW 2321 Saving record DA/2021/1606, 25 Watervale Circuit CHISHOLM NSW 2322 Saving record DA/2021/1609, 24 Wexford Street CHISHOLM NSW 2322 Saving record DA/2021/1613, 81 Johannes Street LOCHINVAR NSW 2321 Saving record CDC/2021/680, 10 Basker Street CHISHOLM NSW 2322 Saving record CDC/2021/715, 2 Silvarum Street CHISHOLM NSW 2322 Saving record CDC/2021/716, 9 Cruiser Street CHISHOLM NSW 2322 Saving record CDC/2021/717, 49 Honeysuckle Drive ABERGLASSLYN NSW 2320 Saving record CDC/2021/718, 197 Settlers Boulevard CHISHOLM NSW 2322 Saving record CC/2021/1116, 4 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1118, 2 Singleton Avenue THORNTON NSW 2322 Saving record CC/2021/1119, 3 Lilac Avenue LOCHINVAR NSW 2321 Saving record CC/2021/1122, 64 Banks Street EAST MAITLAND NSW 2323 Saving record DA/2021/1550, 224 George Street EAST MAITLAND NSW 2323 Saving record DA/2021/1555, 27 John Street TELARAH NSW 2320 Saving record DA/2021/1571, 12 Newfield Street RUTHERFORD NSW 2320 Saving record DA/2021/1577, 452 Anambah Road ANAMBAH NSW 2320 Saving record DA/2021/1581, 14 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1582, 12 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1583, 8 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1584, 18 Shortland Drive RUTHERFORD NSW 2320 Saving record DA/2021/1586, 30 Arklow Crescent CHISHOLM NSW 2322 Saving record DA/2021/1590, 30 Byng Street TENAMBIT NSW 2323 Saving record DA/2021/1595, 127 Forest Hill Drive OAKHAMPTON HEIGHTS NSW 2320 Saving record DA/2021/1596, 9 Four Mile Creek Road ASHTONFIELD NSW 2323 Saving record DA/2016/1858:3, 100 Mcfarlanes Road BERRY PARK NSW 2321 Saving record DA/2021/1598, 145 Swan Street MORPETH NSW 2321,2/145-147 Swan Street MORPETH NSW 2321 Saving record DA/2021/1599, 27 Malachite Street CHISHOLM NSW 2322 Saving record DA/2021/1603, 2 Singleton Avenue THORNTON NSW 2322 Saving record DA/2021/1608, 45 Bordeaux Terrace LOCHINVAR NSW 2321 Saving record CDC/2021/700, 8 Barnstable Street THORNTON NSW 2322 Saving record CDC/2021/714, 22 Mumford Avenue THORNTON NSW 2322 Saving record CC/2021/1086, 27 John Street TELARAH NSW 2320 Saving record CC/2021/1093, 12 Newfield Street RUTHERFORD NSW 2320 Saving record CC/2021/1101, 14 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1102, 12 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1103, 8 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1123, 45 Bordeaux Terrace LOCHINVAR NSW 2321 Saving record CC/2021/1126, 24 Wexford Street CHISHOLM NSW 2322 Saving record CC/2021/1139, 33 Springfield Drive LOCHINVAR NSW 2321 Saving record CC/2021/1141, 39 Tournament Street RUTHERFORD NSW 2320 Saving record CC/2021/1142, 8 Antrim Close ASHTONFIELD NSW 2323 Saving record DA/2021/1494, 12 Melbourne Street EAST MAITLAND NSW 2323 Saving record DA/2021/1526, 12 Holmes Street ASHTONFIELD NSW 2323 Saving record DA/2021/1533, 31 Belmore Road LORN NSW 2320 Saving record DA/2021/1543, 206 High Street MAITLAND NSW 2320 Saving record DA/2021/1554, 1 Mcleod Avenue METFORD NSW 2323 Saving record DA/2021/1557, 11 Woodhurst Street LARGS NSW 2320 Saving record DA/2021/1593, 192 George Street EAST MAITLAND NSW 2323 Saving record CDC/2021/710, 54 Settlers Boulevard CHISHOLM NSW 2322 Saving record CDC/2021/711, 23 Tillage Drive LOCHINVAR NSW 2321 Saving record CDC/2021/712, 17 Basker Street CHISHOLM NSW 2322 Saving record CDC/2021/713, 21 Tillage Drive LOCHINVAR NSW 2321 Saving record CC/2021/735:1, 12 Allan Street LORN NSW 2320 Saving record DA/2021/1565, 10 Brighton Street THORNTON NSW 2322 Saving record DA/2021/1570, 6 Price Street EAST MAITLAND NSW 2323 Saving record DA/2021/1585, 9 Beckett Street GILLIESTON HEIGHTS NSW 2321 Saving record DA/2021/1588, 51 Laurie Drive RAWORTH NSW 2321 Saving record DA/2021/1589, 14 Denton Park Drive RUTHERFORD NSW 2320 Saving record CDC/2021/708, 13 Silvarum Street CHISHOLM NSW 2322 Saving record CDC/2021/709, 6 Riverside Street BOLWARRA NSW 2320 Saving record CC/2021/1130, 30 Capper Street TELARAH NSW 2320 Saving record CC/2021/1131, 28 Lancaster Street THORNTON NSW 2322 Saving record DA/2021/1521, 608 Duckenfield Road MILLERS FOREST NSW 2324 Saving record DA/2021/1532, 13 Mitchell Drive EAST MAITLAND NSW 2323,15 Mitchell Drive EAST MAITLAND NSW 2323 Saving record DA/2021/1534, 2 Grey Gum Crescent CHISHOLM NSW 2322 Saving record DA/2021/1548, 486 Louth Park Road LOUTH PARK NSW 2320 Saving record DA/2021/1559, 3 Moore Road BOLWARRA HEIGHTS NSW 2320 Saving record DA/2021/1563, 6 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1564, 2 Castleton Close FARLEY NSW 2320 Saving record DA/2021/1574, 11 Riverside Street BOLWARRA NSW 2320 Saving record DA/2021/1578, 887 New England Highway LOCHINVAR NSW 2321 Saving record DA/2021/1579, 23 Tournament Street RUTHERFORD NSW 2320 Saving record CDC/2021/701, 44 Elgin Street MAITLAND NSW 2320 Saving record CDC/2021/702, 5 Cruiser Street CHISHOLM NSW 2322 Saving record CDC/2021/703, 10 Francis Street LOCHINVAR NSW 2321 Saving record CDC/2021/704, 70 Station Lane LOCHINVAR NSW 2321 Saving record CDC/2021/705, 32 Crestwood Road THORNTON NSW 2322 AUSTRALIA Saving record CDC/2021/706, 38 Crestwood Road THORNTON NSW 2322 AUSTRALIA Saving record CDC/2021/707, 14 Orlando Close WINDELLA NSW 2320 Saving record CC/2021/1091, 6 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1092, 2 Castleton Close FARLEY NSW 2320 Saving record CC/2021/1094, 4 John Arthur Avenue THORNTON NSW 2322 Saving record CC/2021/1124, 6 Mountview Place ABERGLASSLYN NSW 2320 Saving record CC/2021/1125, 149 Budgeree Drive ABERGLASSLYN NSW 2320 Saving record DA/2021/1470, 62 Settlers Boulevard CHISHOLM NSW 2322,64 Settlers Boulevard CHISHOLM NSW 2322 Saving record DA/2021/1515, 17 Lucy Place RAWORTH NSW 2321 Saving record DA/2021/1523, 512 Raymond Terrace Road THORNTON NSW 2322 Saving record DA/2021/1529, 1 George Street MORPETH NSW 2321 Saving record DA/2021/1539, 94 Johannes Street LOCHINVAR NSW 2321 Saving record DA/2021/1549, 39 Mt Vincent Road EAST MAITLAND NSW 2323 Saving record DA/2021/1552, 37 Ada Street TELARAH NSW 2320 Saving record DA/2021/1556, 32 Fairfax Street RUTHERFORD NSW 2320 Saving record DA/2021/1558, 326 Dagworth Road LOUTH PARK NSW 2320 Saving record DA/2021/1561, 20 Lomond Street LOUTH PARK NSW 2320 Saving record DA/2019/167:2, 2 Telarah Street TELARAH NSW 2320 Saving record DA/2021/1568, 30 Metford Road EAST MAITLAND NSW 2323 Saving record CC/2021/1074, 94 Johannes Street LOCHINVAR NSW 2321 Saving record CC/2021/1087, 32 Fairfax Street RUTHERFORD NSW 2320 Saving record CC/2021/1088, 2A Wollombi Road RUTHERFORD NSW 2320 Saving record CC/2021/1105, 18 Lomond Street LOUTH PARK NSW 2320 Saving record DA/2021/1486, 244 Duckenfield Road BERRY PARK NSW 2321 Saving record DA/2021/1513, 1 Willow Tree Close ABERGLASSLYN NSW 2320 Saving record DA/2021/1525, 6 Basker Street CHISHOLM NSW 2322 Saving record DA/2021/1536, 174 Melbourne Street EAST MAITLAND NSW 2323 Saving record DA/2021/1545, 6 Shepherd Street LOCHINVAR NSW 2321 Saving record DA/2021/1551, 11 St Fagans Parade RUTHERFORD NSW 2320 Saving record DA/2021/1560, 11 Somers Close METFORD NSW 2323 Saving record CDC/2021/693, 15 Apple Street GILLIESTON HEIGHTS NSW 2321 Saving record CDC/2021/694, 10 Maidford Street THORNTON NSW 2322 Saving record CDC/2021/695, 11 Maybush Avenue THORNTON NSW 2322 Saving record CDC/2021/696, 23 Evelyn Crescent THORNTON NSW 2322 Saving record CDC/2021/697, 50 Bordeaux Terrace LOCHINVAR NSW 2321 Saving record CDC/2021/698, 8 Francis Street LOCHINVAR NSW 2321 Saving record CDC/2021/699, 50 Oswald Road OSWALD NSW 2321 Saving record CC/2021/1064, 20 Goldingham Street TENAMBIT NSW 2323 Saving record CC/2021/1111, 16 Tramea Way CHISHOLM NSW 2322 Saving record CC/2021/1113, 12 Golf Links Road TENAMBIT NSW 2323 Saving record CC/2021/1114, 25 Molly Morgan Drive EAST MAITLAND NSW 2323 Saving record CC/2021/1115, 120 Arrowtail Street CHISHOLM NSW 2322 Saving record CC/2021/1117, 78 Avery Street RUTHERFORD NSW 2320 Saving record CC/2021/1109, 31 Rous Street EAST MAITLAND NSW 2323 Saving record CC/2021/1110, 352 Mcfarlanes Road BERRY PARK NSW 2321 Saving record DA/2021/1528, 136 Cessnock Road MAITLAND NSW 2320 Saving record DA/2021/1535, 16 Hunterglen Drive BOLWARRA NSW 2320 Saving record DA/2021/1544, 68 Station Lane LOCHINVAR NSW 2321 Saving record CDC/2021/691, 62 Station Lane LOCHINVAR NSW 2321 Saving record CDC/2021/692, 20 Streeton Drive METFORD NSW 2323 Saving record CC/2021/1104, 8 Bordeaux Terrace LOCHINVAR NSW 2321 Saving record CC/2021/1106, 22 Fairway Street RUTHERFORD NSW 2320 Saving record CC/2021/1107, 3 Mt Vincent Road EAST MAITLAND NSW 2323 Saving record CC/2021/1108, 2 Coromandel Close ASHTONFIELD NSW 2323 Saving record DA/2021/1503, 123 Denton Park Drive ABERGLASSLYN NSW 2320 Saving record DA/2021/1506, 655 Anambah Road GOSFORTH NSW 2320 Saving record DA/2021/1530, 4 Reserve Street RUTHERFORD NSW 2320 Saving record DA/2021/1531, 18 Lomond Street LOUTH PARK NSW 2320 Saving record CDC/2021/686, 11 Enderle Drive LOCHINVAR NSW 2321 Saving record CDC/2021/687, 6 Meadow Street LOCHINVAR NSW 2321 Saving record CDC/2021/688, 4 Ossa Street LOUTH PARK NSW 2320 Saving record CDC/2021/689, 41 River Oak Avenue GILLIESTON HEIGHTS NSW 2321 Saving record CDC/2021/690, 3 Cruiser Street CHISHOLM NSW 2322 Saving record CC/2021/1098, 17 Brookland Promenade THORNTON NSW 2322 Saving record CC/2021/1099, 12 Dunmore Road LARGS NSW 2320 Saving record CC/2021/1100, 13 Tillage Drive LOCHINVAR NSW 2321 Saving record DA/2021/1472, 30 Shipley Drive RUTHERFORD NSW 2320 Saving record DA/2021/1493, 14 Racecourse Road RUTHERFORD NSW 2320 Saving record DA/2016/2924:2, 252 Pywells Road LUSKINTYRE NSW 2321 Saving record DA/2021/1514, 29 Hargreaves Circuit METFORD NSW 2323 Saving record DA/2021/1517, 15 Old Pitnacree Close PITNACREE NSW 2323 Saving record CDC/2021/681, 11 Springfield Drive LOCHINVAR NSW 2321 Saving record CDC/2021/682, 10 Lomandra Place WINDELLA NSW 2320 Saving record CDC/2021/683, 13 Silvarum Street CHISHOLM NSW 2322 Saving record CDC/2021/684, 14 Tramea Way CHISHOLM NSW 2322 Saving record CDC/2021/685, 31 Sunset Drive THORNTON NSW 2322 AUSTRALIA Saving record CC/2021/1069, 29 Hargreaves Circuit METFORD NSW 2323 Saving record CC/2021/1095, 41 Goldring Street CHISHOLM NSW 2322 Saving record CC/2021/1096, 342 Old North Road LOCHINVAR NSW 2321 Saving record CC/2021/1097, 252 Pywells Road LUSKINTYRE NSW 2321 *************************************************** Now retrying authorities which earlier had failures *************************************************** Collecting feed data for berrigan... Collecting feed data for leeton... berrigan: ERROR: 403 => Net::HTTPForbidden for http://datracking.berriganshire.nsw.gov.au/Horizon/logonGuest.aw?domain=horizondap#/home -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/horizon_xml.rb:159:in `scrape_url' /app/lib/horizon_xml.rb:72:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:37:in `<main>' leeton: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/horizon_xml.rb:159:in `scrape_url' /app/lib/horizon_xml.rb:72:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:37:in `<main>' scraper.rb:41:in `<main>': There were errors with the following authorities: [:berrigan, :leeton]. See earlier output for details (RuntimeError)

Data

Downloaded 1 time by tseyiokorodudu

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (154 KB) Use the API

rows 10 / 380

council_reference address description info_url date_scraped date_received authority_label
OC 2019/38.2
27 Vaux Street COWRA 2794 NSW
Alterations and additions to Cowra Bowling Club
2021-12-23
2021-12-22
cowra
OC 2019/127.1
58 Kite Street COWRA 2794 NSW
3 lot subdivision and construction of 3 dwellings
2021-12-23
2021-12-22
cowra
OC 2021/55.2
22 Waddell Street WATTAMONDARA 2794 NSW
Dwelling (transportable) and detached carport & garage
2021-12-23
2021-12-21
cowra
OC 2020/49.1
21 Bartlett Avenue COWRA 2794 NSW
Dwelling additions (extension and deck)
2021-12-23
2021-12-17
cowra
OC 2020/59.1
50 Vaux Street COWRA 2794 NSW
Dwelling
2021-12-23
2021-12-17
cowra
DA 2021/138.1
66 Lyall Street COWRA 2794 NSW
Alterations & additions to dwelling & change of use to transitional
2021-12-23
2021-12-15
cowra
DA 2021/139.1
39 Main Street DARBYS FALLS 2793 NSW
New Building Dwelling
2021-12-23
2021-12-15
cowra
OC 2019/25.1
313 Elouera Road COWRA 2794 NSW
Dwelling and garage
2021-12-23
2021-12-15
cowra
OC 2019/40.1
42 Dawson Drive COWRA 2794 NSW
Dwelling additions and shed
2021-12-23
2021-12-15
cowra
CC 2021/93.1
196 Camp Road COWRA 2794 NSW
Farm building (storage shed)
2021-12-23
2021-12-14
cowra

Statistics

Total run time: 11 minutes

Total cpu time used: less than 10 seconds

Total disk space used: 2.06 MB

History

  • Manually ran revision 93afdd6e and failed .
    380 records added, 378 records removed in the database
  • Manually ran revision 9a37746b and failed .
    nothing changed in the database
  • Manually ran revision 9a37746b and failed .
    nothing changed in the database
  • Manually ran revision 4bc731b9 and failed .
    378 records added in the database
  • Manually ran revision 102d8c88 and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_horizon / scraper.rb