equivalentideas

Luke Bacon Hero

equivalentideas

equivalentideas on GitHub

Public Organizations

planningalerts-scrapers AOGPN morph-test-scrapers frontyardprojects austccr

33 scrapers

errored nsw_police_media_releases
Scrape http://www.police.nsw.gov.au/news/media_release_archives to archive police media releases, which seem to be removed from their site after about a month.
errored nsw_contracts_detail_json_archiver
Contacts from the NSW government, and save a copy for archival purposes
errored nsw_livetraffic_incidents
Traffic incidents in NSW from livetraffic.com
errored nsw_contracts_json_archiver
Archive the json api of nsw government contracts
errored australian_government_lobbyists_register
Australian Government Lobbyists Register

lobbyists.pmc.gov.au
nsw_file_danger_3
This is an example scraper.
nsw_fire_danger_excersise_2
Testing this out

www.rfs.nsw.gov.au
frontyard_example_scraper
This is an example to clone and make sure our machine is set up right to get started scraping :)
new_test_scraper
This is an example
qld_government_bodies_test
errored west_australian_local_councillors
A list of elected local councillors in Western Australia
tas_lg_directory_councillors
The names of elected councillors at local government councils in Tasmania, Australia
qld_lg_directory_councillors
Names of Queensland local government councillors
nsw_lg_directory_councillors
Scraper to get list of current councillors for councils in NSW

www.olg.nsw.gov.au
vic_lg_directory_councillors
Names of councillors for Victorian councils

knowyourcouncil.vic.gov.au
sa_lg_councillors
South Australian Councillors

api.parse.com
errored morph_vanity_stats
Tracks the “This week at morph.io” numbers from the homepage over time
tutorial_members_of_australian_parliament
Collects members of Australia’s Federal Parliament (tutorial)

morph.io
city_of_sydney_significant_trees
Information of significant trees in Sydney

trees.cityofsydney.nsw.gov.au
nsw_fire_danger_and_bans
Daily Fire Danger Ratings and Fire Bans in New South Wales, Australia
errored nsw_parliament_current_session_bills
Bills going through NSW parliament: the date of their notice of motion and member who introduced the bill

www.parliament.nsw.gov.au
errored check_if_da_has_new_comments
Nothing, just checks if a page changes for me.

www.planningalerts.org.au
testtesttesttest
nothing
phantomjs_docs_test
Testing documentation PR
nepal-ca-members
errored theyvoteforyou_policy_positions
The number of Australian MPs in each policy position on TheyVoteForYou.org.au

theyvoteforyou.org.au
errored nsw_roads_maritime_services_contracts
A scraper to collect contracts from the Roads and Maritime Services government agency from NSW Australia
warringah

eservices1.warringah.nsw.gov.au
errored darebin

eservices.darebin.vic.gov.au
leichhardt
Leichhardt Municipal Council Development Applications

www.eservices.lmc.nsw.gov.au
errored nsw_gov_contract_award_notices_scraper

tenders.nsw.gov.au
errored westconnex_contracts
NSW Government Contract Award Notices with the term "westconnex"

tenders.nsw.gov.au, www.rjah.nhs.uk
santos_news_announcements

Contributed to 48 scrapers

PHP
planningalerts-scrapers/bankstown
Bankstown Development Applications
errored mlandauer/theyvoteforyou_policy_positions
The number of Australian MPs in each policy position on TheyVoteForYou.org.au

theyvoteforyou.org.au
errored morph-test-scrapers/theyvoteforyou_policy_positions
The number of Australian MPs in each policy position on TheyVoteForYou.org.au

theyvoteforyou.org.au
PHP
errored LoveMyData/bankstown
Bankstown Development Applications
Ruby
planningalerts-scrapers/BurdekinShire_DAs
Burdekin Shire Current Development Applications
Ruby
planningalerts-scrapers/act
Ruby
errored LoveMyData/muswellbrook
Muswellbrook Shire Council Development Applications
Ruby
openaustralia/australian_local_councillors_images
Stores a copy of Australian local councillor images from Popolo on S3. Runs on morph.io
openaustralia/tas_lg_directory_councillors
The names of elected councillors at local government councils in Tasmania, Australia
Ruby
errored openaustralia/PlanningAlerts_vanity_stats
The vanity weekly metrics displayed on the PlanningAlerts website
openaustralia/west_australian_local_councillors
A list of elected local councillors in Western Australia
openaustralia/members_of_parliament_queensland_australia
A list of current Members of the Parliament of Queensland, Australia
Ruby
errored openaustralia/planningalerts_coverage
The number of authorities in PlanningAlerts and the claimed percentage of the population who live in them
errored openaustralia/jacaranda
a watchful tree and slack messenger to keep you informed of the use of PlanningAlerts
Ruby
errored LoveMyData/scenic_rim
Scenic Rim Regional Council Development Applications
Ruby
errored LoveMyData/maitland
Maitland Development Applications
Ruby
errored planningalerts-scrapers/city_of_busselton_development_applications
City of Busselton Development Applications
openaustralia/jacaranda-righttoknow
a watchful tree and slack messenger to keep you informed of the use of Right To Know
Ruby
planningalerts-scrapers/cardinia
Cardinia Shire Council Planning Applications
errored LoveMyData/manly
Manly Council Development Applications

da.manly.nsw.gov.au, eservices.northernbeaches.nsw.gov.au
Ruby
errored LoveMyData/tamworth
Ruby
errored LoveMyData/wollongong
Ruby
errored LoveMyData/hobart
Hobart City Council Development Applications
errored LoveMyData/city_of_adelaide_development_applications
City of Adelaide development applications

epathway.adelaidecitycouncil.com
openaustralia/qld_lg_directory_councillors
Names of Queensland local government councillors

services.dsdip.qld.gov.au
openaustralia/right_to_know_requests
Data about requests on Right To Know for analysis

www.righttoknow.org.au
gavinrozzi/opramachine_requests
Data about requests on OPRAmachine for analysis

opramachine.com
Ruby
errored jamezpolley/waverley
Waverley Council Development Applications
Ruby
errored LoveMyData/brisbane
Ruby
errored LoveMyData/marrickville
Marrickville Council Development Applications
Ruby
errored LoveMyData/north_sydney
North Sydney Council Development Applications
Ruby
errored LoveMyData/parramatta
Parramatta City Council Development Applications
Ruby
errored jamezpolley/mornington_peninsula
Mornington Peninsula Shire - Development Applications
errored austccr/mca_media_releases_scraper
Collects media releases from minerals.org.au
errored austccr/link_and_attachment_archiver
Parse links out of HTML in a morph.io scraper and do some archiving actions on each of them. This is kind of a meta-archiver really.
Ruby
errored jamezpolley/newcastle_atdis_test
Newcastle Development (ATDIS) (TEST ONLY)
MichaelBone/darebin
errored austccr/bca_media_releases_scraper
Collects media releases from https://www.bca.com.au/newsroom
errored jamezpolley/griffith
jamezpolley/camden
Camden Council Development Applications
jamezpolley/greatlakes
Great Lakes Council Development Applications
errored jamezpolley/goulburn
Goulburn Mulwaree Council Development Applications
jamezpolley/atdis_utcdatetime_test
austccr/fossil_fuel_lobby_mediacloud_mentions
Media mentions of fossil fuel lobby groups in the Australian media, from mediacloud
errored austccr/australian_enterprise_bargaining_agreements
Enterprise Bargaining Agreements from the Fair Work Commission website, which are unfortunately not made available on data.gov.au :\
errored austccr/miningnsw_media_release_scraper
Collects media releases from http://www.nswmining.com.au/menu/media/news
jeremyw24/cardinia
Cardinia Shire Council Planning Applications
errored austccr/bhp_scraper
Archives the public posts from BHP's website