puffnfresh / domain-tasmanian

Cheap, large and Tasmanian properties on domain.com.au


This is a scraper that runs on Morph. To get started see the documentation

Contributors scrappycat puffnfresh

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 66, in <module> parse_page(page_no) File "scraper.py", line 23, in parse_page "page": page File "/app/.heroku/src/scraperwiki/scraperwiki/utils.py", line 31, in scrape f = urllib2.urlopen(req) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 154, in urlopen return opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 437, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 550, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 469, in error result = self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 409, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 656, in http_error_302 return self.parent.open(new, timeout=req.timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 437, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 550, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 469, in error result = self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 409, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 656, in http_error_302 return self.parent.open(new, timeout=req.timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 431, in open response = self._open(req, data) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 449, in _open '_open', req) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 409, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 1240, in https_open context=self._context) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 1194, in do_open h.request(req.get_method(), req.get_selector(), req.data, headers) File "/app/.heroku/python/lib/python2.7/httplib.py", line 1001, in request self._send_request(method, url, body, headers) File "/app/.heroku/python/lib/python2.7/httplib.py", line 1035, in _send_request self.endheaders(body) File "/app/.heroku/python/lib/python2.7/httplib.py", line 997, in endheaders self._send_output(message_body) File "/app/.heroku/python/lib/python2.7/httplib.py", line 850, in _send_output self.send(msg) File "/app/.heroku/python/lib/python2.7/httplib.py", line 812, in send self.connect() File "/app/.heroku/python/lib/python2.7/httplib.py", line 1212, in connect server_hostname=server_hostname) File "/app/.heroku/python/lib/python2.7/ssl.py", line 350, in wrap_socket _context=self) File "/app/.heroku/python/lib/python2.7/ssl.py", line 566, in __init__ self.do_handshake() File "/app/.heroku/python/lib/python2.7/ssl.py", line 796, in do_handshake match_hostname(self.getpeercert(), self.server_hostname) File "/app/.heroku/python/lib/python2.7/ssl.py", line 269, in match_hostname % (hostname, ', '.join(map(repr, dnsnames)))) ssl.CertificateError: hostname 'p-desktoptest-elb.ra2.dynamic.domain.com.au' doesn't match either of 'domain.com.au', '*.allhomes.com.au', '*.apm.com.au', '*.apmpropertydata.com', '*.apmpropertydata.com.au', '*.auctionresults.com.au', '*.commercialrealestate.com.au', '*.domain.com.au', '*.domaincommercial.com', '*.domaincommercial.com.au', '*.domainhomepriceguide.com.au', '*.domaininsights.com.au', '*.domainprestige.com.au', '*.domainpropertydata.com.au', '*.domainstatic.com.au', '*.firsthomebuyers.com.au', '*.getpropertymatch.com.au', '*.homepriceguide.com', '*.homepriceguide.com.au', '*.moneymanager.com.au', '*.reviewproperty.com.au', '*.starweekly.com.au', '*.theweeklyreview.com.au', '*.valuations.apm.com.au', 'allhomes.com.au', 'apm.com.au', 'apmpropertydata.com', 'apmpropertydata.com.au', 'auctionresults.com.au', 'commercialrealestate.com.au', 'domaincommercial.com', 'domaincommercial.com.au', 'domainhomepriceguide.com.au', 'domaininsights.com.au', 'domainprestige.com.au', 'domainpropertydata.com.au', 'domainstatic.com.au', 'firsthomebuyers.com.au', 'getpropertymatch.com.au', 'homepriceguide.com', 'homepriceguide.com.au', 'moneymanager.com.au', 'reviewproperty.com.au', 'starweekly.com.au', 'theweeklyreview.com.au'

Data

Downloaded 5 times by MikeRalphson puffnfresh

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (8 KB) Use the API

rows 10 / 21

address link price extracted_on beds
192 Gumpits Road, Birchs Bay
Mid $400,000s
2015-10-07 09:27:53
2
Lot 2/120 Johnstons Road, Hillwood
Offers Over $89,000
2015-10-25 21:53:56
3
340 Whites Road, Uxbridge
$150,000
2015-11-05 05:59:34
2
904 Ellendale Road, Ellendale
$199,000
2015-11-12 03:00:14
3
2579 Golconda Road, Nabowla
$195,000
2015-11-12 03:00:14
3
1260 North Ansons Bay Road, Ansons Bay
$195,000
2015-11-12 03:00:14
3
299 Rosedale Road, Bicheno
$190,000
2015-11-12 03:00:14
2
142 Boys Road, Forest
$180,000
2015-11-12 03:00:14
2
303 Paradise Road, Paradise
$179,900
2015-11-12 03:00:14
3
135 Semmens Road, St Marys
$165,000
2015-11-12 03:00:14
1

Statistics

Average successful run time: 1 minute

Total run time: about 11 hours

Total cpu time used: 5 minutes

Total disk space used: 35.4 KB

History

  • Auto ran revision e2e14fc4 and failed .
    nothing changed in the database
  • Auto ran revision e2e14fc4 and completed successfully .
    nothing changed in the database
  • Auto ran revision e2e14fc4 and completed successfully .
    nothing changed in the database
  • Auto ran revision e2e14fc4 and failed .
    nothing changed in the database
  • Auto ran revision e2e14fc4 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

domain-tasmanian / scraper.py