sitewisely / sydney-tools-crawler

Crawl Sydney Tools Locations

Scrapes sydneytools.com.au


Contributors newmana

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... {"name"=>"Dulwich Hill ", "street_address"=>"429 New Canterbury Road", "locality"=>"Dulwich Hill", "region"=>"NSW", "postal_code"=>"2203", "wkt_geometry"=>"POINT(151.1430333 -33.9028463)"} Skipping already saved record Dulwich Hill {"name"=>"Alexandria", "street_address"=>"88 Bourke Rd", "locality"=>"Alexandria", "region"=>"NSW", "postal_code"=>"2015", "wkt_geometry"=>"POINT(151.196166 -33.910285)"} Skipping already saved record Alexandria {"name"=>"Castle Hill", "street_address"=>"Unit 4/7-13 Victoria Avenue", "locality"=>"Castle Hill", "region"=>"NSW", "postal_code"=>"2154", "wkt_geometry"=>"POINT(150.981398 -33.732916)"} Skipping already saved record Castle Hill {"name"=>"Smithfield", "street_address"=>"14 Cumberland Highway", "locality"=>"Smithfield", "region"=>"NSW", "postal_code"=>"2164", "wkt_geometry"=>"POINT(150.9430126 -33.8515815)"} Skipping already saved record Smithfield {"name"=>"Brookvale", "street_address"=>"24 Mitchell Rd", "locality"=>"Brookvale", "region"=>"NSW", "postal_code"=>"2100", "wkt_geometry"=>"POINT(151.2741280 -33.7640240)"} Skipping already saved record Brookvale {"name"=>"Taren Point", "street_address"=>"169-171 Taren Point Rd", "locality"=>"Taren Point", "region"=>"NSW", "postal_code"=>"2229", "wkt_geometry"=>"POINT(151.120121 -34.025633)"} Skipping already saved record Taren Point {"name"=>"Penrith", "street_address"=>"95 Batt St", "locality"=>"Jamisontown", "region"=>"NSW", "postal_code"=>"2750", "wkt_geometry"=>"POINT(150.6808133 -33.7667909)"} Skipping already saved record Penrith {"name"=>"Fyshwick", "street_address"=>"84 Newcastle St", "locality"=>"Fyshwick", "region"=>"UNK", "postal_code"=>"2609", "wkt_geometry"=>"POINT(149.1786177 -35.3288580)"} Skipping already saved record Fyshwick {"name"=>"Roselands Warehouse", "street_address"=>"30a Eva Street", "locality"=>"Roselands ", "region"=>"NSW", "postal_code"=>"2196", "wkt_geometry"=>"POINT(151.063560 -33.937792)"} Skipping already saved record Roselands Warehouse {"name"=>"Kotara(Newcastle)", "street_address"=>"Shop G004 Kotara Home, 30 Northcott Drive", "locality"=>"Kotara", "region"=>"NSW", "postal_code"=>"2290", "wkt_geometry"=>"POINT(151.711431 -32.938982)"} Skipping already saved record Kotara(Newcastle) {"name"=>"Mitchell", "street_address"=>"Unit 2, 101 Flemington Rd", "locality"=>"Mitchell", "region"=>"UNK", "postal_code"=>"2911", "wkt_geometry"=>"POINT(149.144671 -35.220995)"} Skipping already saved record Mitchell {"name"=>"Silverwater", "street_address"=>"50 Silverwater Rd", "locality"=>"Silverwater", "region"=>"NSW", "postal_code"=>"2128", "wkt_geometry"=>"POINT(151.045872 -33.839317)"} Skipping already saved record Silverwater {"name"=>"Roselands", "street_address"=>"102 Bonds Rd ", "locality"=>"Roselands", "region"=>"NSW", "postal_code"=>"2196", "wkt_geometry"=>"POINT(151.061632 -33.938564)"} Skipping already saved record Roselands {"name"=>"Gregory Hills", "street_address"=>"Unit 1, No 1 Gregory Hills Drive ", "locality"=>"Gledswood Hill", "region"=>"NSW", "postal_code"=>"2557", "wkt_geometry"=>"POINT(150.766054 -34.021964)"} Skipping already saved record Gregory Hills {"name"=>"Warrawong", "street_address"=>"Unit 1/139 King St", "locality"=>"Warrawong", "region"=>"NSW", "postal_code"=>"2502", "wkt_geometry"=>"POINT(150.889573 -34.495374)"} Skipping already saved record Warrawong {"name"=>"Blackburn", "street_address"=>"101 Whitehorse Road", "locality"=>"Blackburn", "region"=>"VIC", "postal_code"=>"3130", "wkt_geometry"=>"POINT(145.150728 -37.8172172)"} Skipping already saved record Blackburn {"name"=>"Repairs", "street_address"=>"102-104 Bonds Road", "locality"=>"Riverwood", "region"=>"NSW", "postal_code"=>"2210", "wkt_geometry"=>"POINT(151.061477 -33.938547)"} Skipping already saved record Repairs {"name"=>"Bayswater", "street_address"=>"31/172 Canterbury Road", "locality"=>"Bayswater North", "region"=>"VIC", "postal_code"=>"3153", "wkt_geometry"=>"POINT(145.2836256 -37.825687)"} Skipping already saved record Bayswater {"name"=>"Rutherford", "street_address"=>"Unit 3, 387 New England Hwy", "locality"=>"Rutherford", "region"=>"NSW", "postal_code"=>"2320", "wkt_geometry"=>"POINT(151.5053462 -32.7079834)"} Skipping already saved record Rutherford {"name"=>"Gosford", "street_address"=>"1 Yandina Road", "locality"=>"West Gosford", "region"=>"NSW", "postal_code"=>"2250", "wkt_geometry"=>"POINT(151.3179801 -33.4185879)"} Skipping already saved record Gosford {"name"=>"Port Melbourne", "street_address"=>"282 Normanby Road", "locality"=>"Port Melbourne", "region"=>"VIC", "postal_code"=>"3207", "wkt_geometry"=>"POINT(144.9428634 -37.8305004)"} Skipping already saved record Port Melbourne {"name"=>"Epping", "street_address"=>"Unit 1, 330 Cooper Street", "locality"=>"Epping", "region"=>"VIC", "postal_code"=>"3076", "wkt_geometry"=>"POINT(145.0038202 -37.649505)"} Skipping already saved record Epping {"name"=>"Sunshine", "street_address"=>"476 Ballarat Road", "locality"=>"Sunshine", "region"=>"VIC", "postal_code"=>"3020", "wkt_geometry"=>"POINT(144.8313385 -37.7768884)"} Skipping already saved record Sunshine {"name"=>"North Geelong", "street_address"=>"312 Melbourne Road", "locality"=>"North Geelong", "region"=>"VIC", "postal_code"=>"3215", "wkt_geometry"=>"POINT(144.3527237 -38.1100795)"} Skipping already saved record North Geelong

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (7 KB) Use the API

rows 10 / 24

name street_address locality region postal_code wkt_geometry
Dulwich Hill
429 New Canterbury Road
Dulwich Hill
NSW
2203
POINT(151.1430333 -33.9028463)
Alexandria
88 Bourke Rd
Alexandria
NSW
2015
POINT(151.196166 -33.910285)
Castle Hill
Unit 4/7-13 Victoria Avenue
Castle Hill
NSW
2154
POINT(150.981398 -33.732916)
Smithfield
14 Cumberland Highway
Smithfield
NSW
2164
POINT(150.9430126 -33.8515815)
Brookvale
24 Mitchell Rd
Brookvale
NSW
2100
POINT(151.2741280 -33.7640240)
Taren Point
169-171 Taren Point Rd
Taren Point
NSW
2229
POINT(151.120121 -34.025633)
Penrith
95 Batt St
Jamisontown
NSW
2750
POINT(150.6808133 -33.7667909)
Kotara(Newcastle)
Shop G004 Kotara Home, 30 Northcott Drive
Kotara
NSW
2290
POINT(151.711431 -32.938982)
Silverwater
50 Silverwater Rd
Silverwater
NSW
2128
POINT(151.045872 -33.839317)
Roselands
102 Bonds Rd
Roselands
NSW
2196
POINT(151.061632 -33.938564)

Statistics

Average successful run time: less than a minute

Total run time: 7 minutes

Total cpu time used: less than 20 seconds

Total disk space used: 54.1 KB

History

  • Manually ran revision 54e3c872 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision dc5536d4 and completed successfully .
    3 records added in the database
    1 page scraped
  • Manually ran revision 3f305607 and completed successfully .
    21 records added in the database
    2 pages scraped
  • Manually ran and failed .
  • Manually ran revision 3f305607 and failed .
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

sydney-tools-crawler