retro8 / wa_fuelwatch

WA FuelWatch

Scrapes www.fuelwatch.wa.gov.au

Fuelwatch


Scrapes the RSS feed from the WA FuelWatch site.

Forked from ScraperWiki

Contributors retro8

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Fetching Unleaded Petrol in Boulder for today... Fetching Premium Unleaded in Boulder for today... Fetching Diesel in Boulder for today... Fetching LPG in Boulder for today... Fetching 98 RON in Boulder for today... Fetching B20 diesel in Boulder for today... Fetching Unleaded Petrol in Broome for today... Fetching Premium Unleaded in Broome for today... Fetching Diesel in Broome for today... Fetching LPG in Broome for today... Fetching 98 RON in Broome for today... Fetching B20 diesel in Broome for today... Fetching Unleaded Petrol in Busselton (Townsite) for today... Fetching Premium Unleaded in Busselton (Townsite) for today... Fetching Diesel in Busselton (Townsite) for today... Fetching LPG in Busselton (Townsite) for today... Fetching 98 RON in Busselton (Townsite) for today... Fetching B20 diesel in Busselton (Townsite) for today... Fetching Unleaded Petrol in Carnarvon for today... Fetching Premium Unleaded in Carnarvon for today... Fetching Diesel in Carnarvon for today... Fetching LPG in Carnarvon for today... Fetching 98 RON in Carnarvon for today... Fetching B20 diesel in Carnarvon for today... Fetching Unleaded Petrol in Collie for today... Fetching Premium Unleaded in Collie for today... Fetching Diesel in Collie for today... Fetching LPG in Collie for today... Fetching 98 RON in Collie for today... Fetching B20 diesel in Collie for today... Fetching Unleaded Petrol in Dampier for today... Fetching Premium Unleaded in Dampier for today... Fetching Diesel in Dampier for today... Fetching LPG in Dampier for today... Fetching 98 RON in Dampier for today... Fetching B20 diesel in Dampier for today... Fetching Unleaded Petrol in Esperance for today... Fetching Premium Unleaded in Esperance for today... Fetching Diesel in Esperance for today... Fetching LPG in Esperance for today... Fetching 98 RON in Esperance for today... Fetching B20 diesel in Esperance for today... Fetching Unleaded Petrol in Kalgoorlie for today... Fetching Premium Unleaded in Kalgoorlie for today... Fetching Diesel in Kalgoorlie for today... Fetching LPG in Kalgoorlie for today... Fetching 98 RON in Kalgoorlie for today... Fetching B20 diesel in Kalgoorlie for today... Fetching Unleaded Petrol in Karratha for today... Fetching Premium Unleaded in Karratha for today... Fetching Diesel in Karratha for today... Fetching LPG in Karratha for today... Fetching 98 RON in Karratha for today... Fetching B20 diesel in Karratha for today... Fetching Unleaded Petrol in Kununurra for today... Fetching Premium Unleaded in Kununurra for today... Fetching Diesel in Kununurra for today... Fetching LPG in Kununurra for today... Fetching 98 RON in Kununurra for today... Fetching B20 diesel in Kununurra for today... Fetching Unleaded Petrol in Narrogin for today... Fetching Premium Unleaded in Narrogin for today... Fetching Diesel in Narrogin for today... Fetching LPG in Narrogin for today... Fetching 98 RON in Narrogin for today... Fetching B20 diesel in Narrogin for today... Fetching Unleaded Petrol in Northam for today... Fetching Premium Unleaded in Northam for today... Fetching Diesel in Northam for today... Fetching LPG in Northam for today... Fetching 98 RON in Northam for today... Fetching B20 diesel in Northam for today... Fetching Unleaded Petrol in Port Hedland for today... Fetching Premium Unleaded in Port Hedland for today... Fetching Diesel in Port Hedland for today... Fetching LPG in Port Hedland for today... Fetching 98 RON in Port Hedland for today... Fetching B20 diesel in Port Hedland for today... Fetching Unleaded Petrol in South Hedland for today... Fetching Premium Unleaded in South Hedland for today... Fetching Diesel in South Hedland for today... Fetching LPG in South Hedland for today... Fetching 98 RON in South Hedland for today... Fetching B20 diesel in South Hedland for today... Fetching Unleaded Petrol in Albany for today... Fetching Premium Unleaded in Albany for today... Fetching Diesel in Albany for today... Fetching LPG in Albany for today... Fetching 98 RON in Albany for today... Fetching B20 diesel in Albany for today... Fetching Unleaded Petrol in Bunbury for today... Fetching Premium Unleaded in Bunbury for today... Fetching Diesel in Bunbury for today... Fetching LPG in Bunbury for today... Fetching 98 RON in Bunbury for today... Fetching B20 diesel in Bunbury for today... Fetching Unleaded Petrol in Geraldton for today... Fetching Premium Unleaded in Geraldton for today... Fetching Diesel in Geraldton for today... Fetching LPG in Geraldton for today... Fetching 98 RON in Geraldton for today... Fetching B20 diesel in Geraldton for today... Fetching Unleaded Petrol in Mandurah for today... Fetching Premium Unleaded in Mandurah for today... Fetching Diesel in Mandurah for today... Fetching LPG in Mandurah for today... Fetching 98 RON in Mandurah for today... Fetching B20 diesel in Mandurah for today... Fetching Unleaded Petrol in Capel for today... Fetching Premium Unleaded in Capel for today... Fetching Diesel in Capel for today... Fetching LPG in Capel for today... Fetching 98 RON in Capel for today... Fetching B20 diesel in Capel for today... Fetching Unleaded Petrol in Dardanup for today... Fetching Premium Unleaded in Dardanup for today... Fetching Diesel in Dardanup for today... Fetching LPG in Dardanup for today... Fetching 98 RON in Dardanup for today... Fetching B20 diesel in Dardanup for today... Fetching Unleaded Petrol in Greenough for today... Fetching Premium Unleaded in Greenough for today... Fetching Diesel in Greenough for today... Fetching LPG in Greenough for today... Fetching 98 RON in Greenough for today... Fetching B20 diesel in Greenough for today... Fetching Unleaded Petrol in Harvey for today... Fetching Premium Unleaded in Harvey for today... Fetching Diesel in Harvey for today... Fetching LPG in Harvey for today... Fetching 98 RON in Harvey for today... Fetching B20 diesel in Harvey for today... Fetching Unleaded Petrol in Murray for today... Fetching Premium Unleaded in Murray for today... Fetching Diesel in Murray for today... Fetching LPG in Murray for today... Fetching 98 RON in Murray for today... Fetching B20 diesel in Murray for today... Fetching Unleaded Petrol in Waroona for today... Fetching Premium Unleaded in Waroona for today... Fetching Diesel in Waroona for today... Fetching LPG in Waroona for today... Fetching 98 RON in Waroona for today... Fetching B20 diesel in Waroona for today... Fetching Unleaded Petrol in Metro : North of River for today... Fetching Premium Unleaded in Metro : North of River for today... Fetching Diesel in Metro : North of River for today... Fetching LPG in Metro : North of River for today... Fetching 98 RON in Metro : North of River for today... Fetching B20 diesel in Metro : North of River for today... Fetching Unleaded Petrol in Metro : South of River for today... Fetching Premium Unleaded in Metro : South of River for today... Fetching Diesel in Metro : South of River for today... Fetching LPG in Metro : South of River for today... Fetching 98 RON in Metro : South of River for today... Fetching B20 diesel in Metro : South of River for today... Fetching Unleaded Petrol in Metro : East/Hills for today... Fetching Premium Unleaded in Metro : East/Hills for today... Fetching Diesel in Metro : East/Hills for today... Fetching LPG in Metro : East/Hills for today... Fetching 98 RON in Metro : East/Hills for today... Fetching B20 diesel in Metro : East/Hills for today... Fetching Unleaded Petrol in Augusta / Margaret River for today... Fetching Premium Unleaded in Augusta / Margaret River for today... Fetching Diesel in Augusta / Margaret River for today... Fetching LPG in Augusta / Margaret River for today... Fetching 98 RON in Augusta / Margaret River for today... Fetching B20 diesel in Augusta / Margaret River for today... Fetching Unleaded Petrol in Busselton (Shire) for today... Fetching Premium Unleaded in Busselton (Shire) for today... Fetching Diesel in Busselton (Shire) for today... Fetching LPG in Busselton (Shire) for today... Fetching 98 RON in Busselton (Shire) for today... Fetching B20 diesel in Busselton (Shire) for today... Fetching Unleaded Petrol in Bridgetown / Greenbushes for today... Fetching Premium Unleaded in Bridgetown / Greenbushes for today... Fetching Diesel in Bridgetown / Greenbushes for today... Fetching LPG in Bridgetown / Greenbushes for today... Fetching 98 RON in Bridgetown / Greenbushes for today... Fetching B20 diesel in Bridgetown / Greenbushes for today... Fetching Unleaded Petrol in Donnybrook / Balingup for today... Fetching Premium Unleaded in Donnybrook / Balingup for today... Fetching Diesel in Donnybrook / Balingup for today... Fetching LPG in Donnybrook / Balingup for today... Fetching 98 RON in Donnybrook / Balingup for today... Fetching B20 diesel in Donnybrook / Balingup for today... Fetching Unleaded Petrol in Manjimup for today... Fetching Premium Unleaded in Manjimup for today... Fetching Diesel in Manjimup for today... Fetching LPG in Manjimup for today... Fetching 98 RON in Manjimup for today... Fetching B20 diesel in Manjimup for today... Fetching Unleaded Petrol in Cataby for today... Fetching Premium Unleaded in Cataby for today... Fetching Diesel in Cataby for today... Fetching LPG in Cataby for today... Fetching 98 RON in Cataby for today... Fetching B20 diesel in Cataby for today... Fetching Unleaded Petrol in Coolgardie for today... Fetching Premium Unleaded in Coolgardie for today... Fetching Diesel in Coolgardie for today... Fetching LPG in Coolgardie for today... Fetching 98 RON in Coolgardie for today... Fetching B20 diesel in Coolgardie for today... Fetching Unleaded Petrol in Cunderdin for today... Fetching Premium Unleaded in Cunderdin for today... Fetching Diesel in Cunderdin for today... Fetching LPG in Cunderdin for today... Fetching 98 RON in Cunderdin for today... Fetching B20 diesel in Cunderdin for today... Fetching Unleaded Petrol in Dalwallinu for today... Traceback (most recent call last): File "scraper.py", line 99, in <module> tree = lxml.etree.parse(urllib2.urlopen(url % (prod, reg, date))) File "lxml.etree.pyx", line 2957, in lxml.etree.parse (src/lxml/lxml.etree.c:56230) File "parser.pxi", line 1555, in lxml.etree._parseDocument (src/lxml/lxml.etree.c:82537) File "parser.pxi", line 1585, in lxml.etree._parseFilelikeDocument (src/lxml/lxml.etree.c:82858) File "parser.pxi", line 1468, in lxml.etree._parseDocFromFilelike (src/lxml/lxml.etree.c:81714) File "parser.pxi", line 1024, in lxml.etree._BaseParser._parseDocFromFilelike (src/lxml/lxml.etree.c:78761) File "parser.pxi", line 569, in lxml.etree._ParserContext._handleParseResultDoc (src/lxml/lxml.etree.c:74498) File "parser.pxi", line 650, in lxml.etree._handleParseResult (src/lxml/lxml.etree.c:75389) File "parser.pxi", line 590, in lxml.etree._raiseParseError (src/lxml/lxml.etree.c:74722) lxml.etree.XMLSyntaxError : PCDATA invalid Char value 19, line 2, column 820

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (89.6 MB) Use the API

rows 10 / 291498

product phone price longitude trading-name suburb address date region latitude brand
Diesel
(08) 9021 2266
155.9
121.484457
Coles Express Boulder
BOULDER
35 Frank St
2011-12-03T00:00:00
Boulder
-30.767542
Coles Express
Diesel
(08) 9093 1543
157.9
121.488963
Shell Boulder
BOULDER
Cnr Lane & Davis Sts
2011-12-03T00:00:00
Boulder
-30.778416
Shell
98 RON
(08) 9093 1167
165
121.488389
BP Boulder Trading Post
BOULDER
70 Piesse St
2011-12-03T00:00:00
Boulder
-30.783546
BP
98 RON
(08) 9093 0266
168.9
121.490543
BP Kalgoorlie-Boulder Truckstop
BOULDER
Celebration Drive
2011-12-03T00:00:00
Boulder
-30.80332
BP
Diesel
(08) 9192 1357
162.5
122.205623
West Kimberley Fuels - Broome Depot
BROOME
Lot 954 Port Drive
2011-12-03T00:00:00
Broome
-18.003949
BP
Diesel
(08) 9192 8181
165.9
122.215105
BP Reid Rd
BROOME
49 Reid Road
2011-12-03T00:00:00
Broome
-17.961207
BP
Diesel
(08) 9193 6347
173.9
122.217975
BP Clementson Street Service Station
BROOME
7 Clementson Street
2011-12-03T00:00:00
Broome
-17.970971
BP
LPG
0418919640
106.9
122.239908
Caltex Star Mart Broome
BROOME
Lot 345 Mavis St
2011-12-03T00:00:00
Broome
-17.927834
Caltex
LPG
(08) 9192 7909
108.9
Caltex Woolworths Broome
BROOME
Broome Boulevard Shopping Centre
2011-12-03T00:00:00
Broome
Caltex Woolworths
LPG
(08) 9192 1702
108.9
122.241945
Coles Express Broome
BROOME
Cnr Hamersley St & Napier Tce
2011-12-03T00:00:00
Broome
-17.95708
Coles Express

Statistics

Total run time: 9 minutes

Total cpu time used: less than 20 seconds

Total disk space used: 89.7 MB

History

  • Manually ran revision 7f94996d and failed .
    522 records added in the database
    210 pages scraped
  • Forked from ScraperWiki

Scraper code

Python

wa_fuelwatch / scraper.py