sitewisely / myer-crawl

Myer store locations in Australia

Scrapes www.myer.com.au

Shop Online at Myer, Australia's largest department store, for the latest in women's & men's clothing, beauty, homewares, electronics, kids toys & more.


Contributors dendrei

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.4.4 [1G-----> Installing dependencies using bundler 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.1). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/........ [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching unf_ext 0.0.7.5 [1G Fetching httpclient 2.8.3 [1G Fetching mime-types-data 3.2016.0521 [1G Installing mime-types-data 3.2016.0521 [1G Fetching net-http-digest_auth 1.4.1 [1G Installing unf_ext 0.0.7.5 with native extensions [1G Installing net-http-digest_auth 1.4.1 [1G Installing httpclient 2.8.3 [1G Fetching net-http-persistent 2.9.4 [1G Installing net-http-persistent 2.9.4 [1G Fetching mini_portile2 2.3.0 [1G Installing mini_portile2 2.3.0 [1G Fetching ntlm-http 0.1.1 [1G Installing ntlm-http 0.1.1 [1G Fetching webrobots 0.1.2 [1G Fetching sqlite3 1.3.13 [1G Installing webrobots 0.1.2 [1G Installing sqlite3 1.3.13 with native extensions [1G Fetching mime-types 3.1 [1G Installing mime-types 3.1 [1G Fetching nokogiri 1.8.2 [1G Installing nokogiri 1.8.2 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20180417 [1G Installing domain_name 0.5.20180417 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.7.5 [1G Installing mechanize 2.7.5 [1G Bundle complete! 2 Gemfile dependencies, 18 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (28.29s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.1). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... {"name"=>"Melbourne City", "address"=>"314-336 Bourke St Melbourne 3000", "wkt_geometry"=>"POINT(144.96408 -37.81388)"} Skipping already saved record Melbourne City {"name"=>"Chadstone", "address"=>"1341 Dandenong Road Chadstone 3148", "wkt_geometry"=>"POINT(145.08126 -37.88738)"} Skipping already saved record Chadstone {"name"=>"Northland", "address"=>"2-50 Murray Road East Preston 3072", "wkt_geometry"=>"POINT(145.02929 -37.74064)"} Skipping already saved record Northland {"name"=>"Eastland", "address"=>"171-197 Maroondah Hwy Ringwood 3134", "wkt_geometry"=>"POINT(145.22955 -37.81491)"} Skipping already saved record Eastland {"name"=>"Southland", "address"=>"1156 Nepean Hwy Cheltenham 3192", "wkt_geometry"=>"POINT(145.05235 -37.95863)"} Skipping already saved record Southland {"name"=>"Doncaster", "address"=>"619 Doncaster Road Doncaster 3108", "wkt_geometry"=>"POINT(145.12530 -37.78376)"} Skipping already saved record Doncaster {"name"=>"Highpoint", "address"=>"Rosamond Road Maribyrnong 3032", "wkt_geometry"=>"POINT(144.88645 -37.76911)"} Skipping already saved record Highpoint {"name"=>"Knox City", "address"=>"Burwood Hwy & Stud Road Wantirna 3152", "wkt_geometry"=>"POINT(145.21855 -37.86333)"} Skipping already saved record Knox City {"name"=>"Frankston", "address"=>"38 Beach Street Frankston 3199", "wkt_geometry"=>"POINT(145.12494 -38.14119)"} Skipping already saved record Frankston {"name"=>"Geelong", "address"=>"105 Malop Street Geelong 3220", "wkt_geometry"=>"POINT(144.36247 -38.14754)"} Skipping already saved record Geelong {"name"=>"Ballarat", "address"=>"Sturt Street Ballarat 3350", "wkt_geometry"=>"POINT(143.85593 -37.56210)"} Skipping already saved record Ballarat {"name"=>"Bendigo", "address"=>"38 Pall Mall Bendigo 3550", "wkt_geometry"=>"POINT(144.27961 -36.75900)"} Skipping already saved record Bendigo {"name"=>"Albury", "address"=>"525 David Street Albury 2640", "wkt_geometry"=>"POINT(146.91978 -36.08003)"} Skipping already saved record Albury {"name"=>"Hobart", "address"=>"96-106 Liverpool Street Hobart 7000", "wkt_geometry"=>"POINT(147.32624 -42.88277)"} Skipping already saved record Hobart {"name"=>"Launceston", "address"=>"108 Brisbane Street Launceston 7250", "wkt_geometry"=>"POINT(147.13851 -41.43742)"} Skipping already saved record Launceston {"name"=>"Fountain Gate", "address"=>"25-55 Overland Drive, Narre Warren Fountain Gate 3805", "wkt_geometry"=>"POINT(145.30431 -38.01731)"} Skipping already saved record Fountain Gate {"name"=>"Perth City", "address"=>"200 Murray Street Perth 6000", "wkt_geometry"=>"POINT(115.85877 -31.95273)"} Skipping already saved record Perth City {"name"=>"Carousel", "address"=>"1358 Albany Hwy Cannington 6107", "wkt_geometry"=>"POINT(115.93480 -32.01813)"} Skipping already saved record Carousel {"name"=>"Morley", "address"=>"Collier Road Morley 6062", "wkt_geometry"=>"POINT(115.90247 -31.89490)"} Skipping already saved record Morley {"name"=>"Garden City", "address"=>"125 Riseley Street Booragoon 6154", "wkt_geometry"=>"POINT(115.83802 -32.03233)"} Skipping already saved record Garden City {"name"=>"Mt Gravatt", "address"=>"Corner Logan and Kessels Road Upper Mt Gravatt 4122", "wkt_geometry"=>"POINT(153.08112 -27.55998)"} Skipping already saved record Mt Gravatt {"name"=>"Mackay", "address"=>"Caneland Central Shopping Centre, Corner Mangrove Rd & Victoria St Mackay 4740", "wkt_geometry"=>"POINT(149.17839 -21.13999)"} Skipping already saved record Mackay {"name"=>"Robina", "address"=>"Corner Shop M8 Level 3, Robina Town Centre, 167-191 Robina Town Centre Drive Robina 4226", "wkt_geometry"=>"POINT(153.38486 -28.07809)"} Skipping already saved record Robina {"name"=>"Loganholme", "address"=>"12 Mandew Street Loganholme 4129", "wkt_geometry"=>"POINT(153.17087 -27.65942)"} Skipping already saved record Loganholme {"name"=>"North Lakes", "address"=>"Lot 101 Northlakes Drive Mango Hill 4509", "wkt_geometry"=>"POINT(153.01773 -27.24047)"} Skipping already saved record North Lakes {"name"=>"Maroochydore", "address"=>"AMaroo Street Maroochydore 4558", "wkt_geometry"=>"POINT(153.08643 -26.65445)"} Skipping already saved record Maroochydore {"name"=>"Brisbane City", "address"=>"91 Queen Street Brisbane 4000", "wkt_geometry"=>"POINT(153.02462 -27.47026)"} Skipping already saved record Brisbane City {"name"=>"Cairns", "address"=>"Cnr Mcleod And Spence Streets Cairns 4870", "wkt_geometry"=>"POINT(145.77418 -16.92628)"} Skipping already saved record Cairns {"name"=>"Chermside", "address"=>"Gympie Road Chermside 4032", "wkt_geometry"=>"POINT(153.03242 -27.38433)"} Skipping already saved record Chermside {"name"=>"Toowoomba", "address"=>"Cnr Margaret And Dent Streets Toowoomba 4350", "wkt_geometry"=>"POINT(151.95010 -27.56135)"} Skipping already saved record Toowoomba {"name"=>"Indooroopilly", "address"=>"318 Moggill Road Indooroopilly 4068", "wkt_geometry"=>"POINT(152.97346 -27.49752)"} Skipping already saved record Indooroopilly {"name"=>"Carindale", "address"=>"1151 Creek Road Carina 4152", "wkt_geometry"=>"POINT(153.10151 -27.50332)"} Skipping already saved record Carindale {"name"=>"Pacific Fair", "address"=>"Hooker Blvd Broadbeach 4217", "wkt_geometry"=>"POINT(153.43058 -28.03435)"} Skipping already saved record Pacific Fair {"name"=>"Townsville", "address"=>"Stockland Shopping Centre, 310-330 Ross River Road Aitkenvale 4814", "wkt_geometry"=>"POINT(146.76315 -19.29923)"} Skipping already saved record Townsville {"name"=>"Adelaide", "address"=>"22 Rundle Mall Adelaide 5000", "wkt_geometry"=>"POINT(138.60081 -34.92279)"} Skipping already saved record Adelaide {"name"=>"Marion", "address"=>"297 Diagonal Road Oaklands Park 5046", "wkt_geometry"=>"POINT(138.54771 -35.01596)"} Skipping already saved record Marion {"name"=>"Tea Tree Plaza", "address"=>"976 North East Road Modbury 5092", "wkt_geometry"=>"POINT(138.69064 -34.82974)"} Skipping already saved record Tea Tree Plaza {"name"=>"Joondalup", "address"=>"Lakeside Joondalup Shopping Centre, 420 Joondalup Dve Joondalup 6027", "wkt_geometry"=>"POINT(115.76582 -31.74478)"} Skipping already saved record Joondalup {"name"=>"Karrinyup", "address"=>"Karrinyup Road Karrinyup 6018", "wkt_geometry"=>"POINT(115.77133 -31.87352)"} Skipping already saved record Karrinyup {"name"=>"Parramatta", "address"=>"159-175 Church Street Parramatta 2150", "wkt_geometry"=>"POINT(151.00335 -33.81713)"} Skipping already saved record Parramatta {"name"=>"Bondi", "address"=>"Oxford Street Bondi Junction 2022", "wkt_geometry"=>"POINT(151.24789 -33.89188)"} Skipping already saved record Bondi {"name"=>"Chatswood", "address"=>"49-59 Albert Avenue Chatswood 2067", "wkt_geometry"=>"POINT(151.18333 -33.79780)"} Skipping already saved record Chatswood {"name"=>"Warringah", "address"=>"Old Pittwater Rd (Cnr Condamine St) Brookvale 2100", "wkt_geometry"=>"POINT(151.27168 -33.76190)"} Skipping already saved record Warringah {"name"=>"ShellHarbour", "address"=>"211 Lake Entrance Road Shellharbour 2529", "wkt_geometry"=>"POINT(150.84377 -34.55888)"} Skipping already saved record ShellHarbour {"name"=>"Roselands", "address"=>"Roselands Drive Roselands 2196", "wkt_geometry"=>"POINT(151.06904 -33.93526)"} Skipping already saved record Roselands {"name"=>"Miranda", "address"=>"The Kingsway Miranda 2228", "wkt_geometry"=>"POINT(151.10274 -34.03447)"} Skipping already saved record Miranda {"name"=>"Liverpool", "address"=>"Macquarie Street Liverpool 2170", "wkt_geometry"=>"POINT(150.92488 -33.91823)"} Skipping already saved record Liverpool {"name"=>"Hornsby", "address"=>"Cnr Florence And Muriel Sts Hornsby 2077", "wkt_geometry"=>"POINT(151.10263 -33.70429)"} Skipping already saved record Hornsby {"name"=>"Macquarie", "address"=>"Herring Road North Ryde 2113", "wkt_geometry"=>"POINT(151.11006 -33.78480)"} Skipping already saved record Macquarie {"name"=>"Sydney City", "address"=>"436 George St Sydney 2000", "wkt_geometry"=>"POINT(151.20712 -33.87031)"} Skipping already saved record Sydney City {"name"=>"Blacktown", "address"=>"Kildare Street Blacktown 2148", "wkt_geometry"=>"POINT(150.90541 -33.76892)"} Skipping already saved record Blacktown {"name"=>"Penrith", "address"=>"585 High St Penrith 2750", "wkt_geometry"=>"POINT(150.69171 -33.75209)"} Skipping already saved record Penrith {"name"=>"Belconnen", "address"=>"Benjamin Way Belconnen 2617", "wkt_geometry"=>"POINT(149.06667 -35.23874)"} Skipping already saved record Belconnen {"name"=>"Dubbo", "address"=>"Macquarie Street Dubbo 2830", "wkt_geometry"=>"POINT(148.60118 -32.24787)"} Skipping already saved record Dubbo {"name"=>"Erina", "address"=>"Karalta Road Erina 2250", "wkt_geometry"=>"POINT(151.39373 -33.44005)"} Skipping already saved record Erina {"name"=>"Charlestown", "address"=>"Chapman Street Charlestown 2290", "wkt_geometry"=>"POINT(151.69466 -32.96254)"} Skipping already saved record Charlestown {"name"=>"Canberra City", "address"=>"Akuna Street Canberra 2600", "wkt_geometry"=>"POINT(149.13215 -35.28187)"} Skipping already saved record Canberra City {"name"=>"Wagga", "address"=>"233 Baylis Street Wagga Wagga 2650", "wkt_geometry"=>"POINT(147.37060 -35.11025)"} Skipping already saved record Wagga {"name"=>"Eastgardens", "address"=>"152 Bunnerong Road Eastgardens 2036", "wkt_geometry"=>"POINT(151.22648 -33.94494)"} Skipping already saved record Eastgardens {"name"=>"Bankstown", "address"=>"North Terrace Bankstown 2200", "wkt_geometry"=>"POINT(151.03915 -33.91590)"} Skipping already saved record Bankstown {"name"=>"Werribee", "address"=>"Pacific Werribee, Corner Heath and Derrimut Roads Werribee 3030", "wkt_geometry"=>"POINT(144.68047 -37.87714)"} Skipping already saved record Werribee {"name"=>"Castle Hill", "address"=>"Castle Street Castle Hill 2154", "wkt_geometry"=>"POINT(151.00322 -33.73065)"} Skipping already saved record Castle Hill

Data

Downloaded 1 time by jkarsz

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (16 KB) Use the API

rows 10 / 62

name address wkt_geometry
Melbourne City
314-336 Bourke St Melbourne 3000
POINT(144.96408 -37.81388)
Chadstone
1341 Dandenong Road Chadstone 3148
POINT(145.08126 -37.88738)
Northland
2-50 Murray Road East Preston 3072
POINT(145.02929 -37.74064)
Eastland
171-197 Maroondah Hwy Ringwood 3134
POINT(145.22955 -37.81491)
Southland
1156 Nepean Hwy Cheltenham 3192
POINT(145.05235 -37.95863)
Doncaster
619 Doncaster Road Doncaster 3108
POINT(145.12530 -37.78376)
Highpoint
Rosamond Road Maribyrnong 3032
POINT(144.88645 -37.76911)
Knox City
Burwood Hwy & Stud Road Wantirna 3152
POINT(145.21855 -37.86333)
Frankston
38 Beach Street Frankston 3199
POINT(145.12494 -38.14119)
Geelong
105 Malop Street Geelong 3220
POINT(144.36247 -38.14754)

Statistics

Average successful run time: half a minute

Total run time: less than a minute

Total cpu time used: less than 5 seconds

Total disk space used: 41.2 KB

History

  • Manually ran revision 42592f3e and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 42592f3e and completed successfully .
    62 records added in the database
    1 page scraped
  • Created on morph.io

Scraper code

myer-crawl