blimpage / sash_windows

Sash windows for sale on renovaterestorerecycle.com.au


Oh hi! This is the code for a scraper that runs daily on Morph.io. It finds all of the sash windows available for sale at https://renovaterestorerecycle.com.au/, and sends an email (via Sendgrid) to a nominated email address if any new windows are found.

If that sounds incredibly niche and not very interesting, that's because it is!

Contributors blimpage

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby/Rack -----> Using Ruby version: ruby-2.6.2 -----> Installing dependencies using bundler version 1.17.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.17.2  Fetching unf_ext 0.0.7.1  Fetching httpclient 2.6.0.1  Fetching mime-types 2.5  Installing mime-types 2.5  Fetching net-http-digest_auth 1.4  Installing httpclient 2.6.0.1  Installing net-http-digest_auth 1.4  Installing unf_ext 0.0.7.1 with native extensions  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile 0.6.2  Fetching ntlm-http 0.1.1  Installing mini_portile 0.6.2  Fetching webrobots 0.1.1  Installing ntlm-http 0.1.1  Installing webrobots 0.1.1  Fetching mustermann 1.0.3  Fetching rack 2.0.7  Installing mustermann 1.0.3  Installing rack 2.0.7  Fetching ruby_http_client 3.3.0  Installing ruby_http_client 3.3.0  Fetching sqlite3 1.3.10  Installing sqlite3 1.3.10 with native extensions  Fetching tilt 2.0.9  Installing tilt 2.0.9  Fetching nokogiri 1.6.6.2  Installing nokogiri 1.6.6.2 with native extensions  Fetching rack-protection 2.0.5  Installing rack-protection 2.0.5  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching sinatra 2.0.5  Installing sinatra 2.0.5  Fetching domain_name 0.5.24  Installing domain_name 0.5.24  Fetching sendgrid-ruby 5.3.0  Installing sendgrid-ruby 5.3.0  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching sqlite_magic 0.0.3  Installing sqlite_magic 0.0.3  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.3  Installing mechanize 2.7.3  Bundle complete! 3 Gemfile dependencies, 24 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into `./vendor/bundle`  Removing bundler (1.15.2)  Bundle completed (25.93s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... /app/vendor/bundle/ruby/2.6.0/gems/nokogiri-1.6.6.2/lib/nokogiri/html/document.rb:164: warning: constant ::Fixnum is deprecated 4 pages found to scrape. Scraping page: https://renovaterestorerecycle.com.au/index.php?pgid=0&subcat=6 12 products found. Scraping page: https://renovaterestorerecycle.com.au/index.php?pgid=12&subcat=6 12 products found. Scraping page: https://renovaterestorerecycle.com.au/index.php?pgid=24&subcat=6 12 products found. Scraping page: https://renovaterestorerecycle.com.au/index.php?pgid=36&subcat=6 4 products found. 14 total available products found. No new products found. Oh well. Seeya.

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (5 KB) Use the API

rows 10 / 14

name description price url
Pair of Victorian Single Sash Windows.
2 @ 1120 wide x 2000 high.
$990
Obscure Etched Glass Single Sash Window.
1110 wide x 1935 high.
$490
Cricket Bat Victorian Single Sash Window.
1110 wide x 1995 high.
$550
Single Double Hung Sash Window.
1050 wide x 1870 high.
$390
Huge Victorian Single Sash Window.
1125 wide x 2280 high.
$690
Double Hung Single Sash Window.
935 wide x 1500 high.
$240
Victorian Single Sash Window.
1080 wide x 1910 high.
$490
4 Light Colonial Single Sash Window.
1100 wide x 1400 high.
$240
8 Light Colonial Single Sash Window.
1040 wide x 1550 high.
$240
Sandblasted Obscure Glass Single Sash Window.
1025 wide x 1510 high.
$490

Statistics

Average successful run time: 1 minute

Total run time: about 1 hour

Total cpu time used: 1 minute

Total disk space used: 47.3 KB

History

  • Auto ran revision ad8792a5 and completed successfully .
    nothing changed in the database
  • Auto ran revision ad8792a5 and completed successfully .
    nothing changed in the database
  • Auto ran revision ad8792a5 and completed successfully .
    nothing changed in the database
  • Auto ran revision ad8792a5 and completed successfully .
    nothing changed in the database
  • Auto ran revision ad8792a5 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

sash_windows / scraper.rb