Brandhunt / Brandhunt_produpdate_scraper_phantomjs_py_module_5

Collects product information to be updated from product URLs stored at Brandhunt.se - Only products that require usage of headless browser! Module scraper 5 for centrailzed main scraper


This is a scraper that runs on Morph. To get started see the documentation

Contributors Brandhunt

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Data

Downloaded 6925 times by Brandhunt

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (4.24 MB) Use the API

rows 10 / 1704

productid url domain price salesprice domainmisc prodlogurls prodlogurl finalimgurls validimgurls imgurls notfound notavailable removeon404 soldoutfix soldouthtmlfix catstoaddresult attributes sizetypemapsqls
33707
www.careofcarl.com
8199
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_7.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_2.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_6.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_1.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_8.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_3.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_7.jpg", "6": "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_4.jpg", "7": "https://www.careofcarl.com/bilder/artiklar/zoom/15534011r_5.jpg"}
false
false
false
false
false
""
[{"name": "Brand", "options": [[{"term_id": 961, "name": "Aquascutum", "slug": "brand-aquascutum", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 120, "name": "Blue", "slug": "color-blue", "taxonomy": "pa_color"}, false], [{"term_id": 699, "name": "Navy", "slug": "color-navy", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}, {"name": "Size", "options": [[{"term_id": 2136, "name": "UK42-EU52", "slug": "size-uk42-eu52", "taxonomy": "pa_size"}, false]], "position": 4, "visible": 1, "variation": 1}, {"name": "Sizetypemisc", "options": [[{"term_id": 2032, "name": "Other", "slug": "sizetypemisc-other", "taxonomy": "pa_sizetypemisc"}, false]], "position": 5, "visible": 1, "variation": 1}]
["", "", [[2136, 2032, "33707"]], ""]
33709
www.careofcarl.com
0
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_7.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_3.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_7.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_2.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_4.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_6.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_5.jpg", "6": "https://www.careofcarl.com/bilder/artiklar/zoom/16629311r_1.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 939, "name": "BOSS", "slug": "brand-boss", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 117, "name": "Black", "slug": "color-black", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
33711
www.careofcarl.com
0
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_7.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_5.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_3.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_2.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_8.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_7.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_4.jpg", "6": "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_1.jpg", "7": "https://www.careofcarl.com/bilder/artiklar/zoom/16070911r_6.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 135, "name": "Ralph Lauren", "slug": "brand-ralphlauren", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 120, "name": "Blue", "slug": "color-blue", "taxonomy": "pa_color"}, false], [{"term_id": 481, "name": "Purple", "slug": "color-purple", "taxonomy": "pa_color"}, false], [{"term_id": 699, "name": "Navy", "slug": "color-navy", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
33713
www.careofcarl.com
0
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_7.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_7.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_8.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_2.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_6.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_4.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_1.jpg", "6": "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_5.jpg", "7": "https://www.careofcarl.com/bilder/artiklar/zoom/16437011r_3.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 923, "name": "Woolrich", "slug": "brand-woolrich", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 475, "name": "Green", "slug": "color-green", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
33715
www.careofcarl.com
0
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_7.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_5.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_3.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_2.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_6.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_4.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_8.jpg", "6": "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_7.jpg", "7": "https://www.careofcarl.com/bilder/artiklar/zoom/16631011r_1.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 932, "name": "J.Lindeberg", "slug": "brand-j-lindeberg", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 117, "name": "Black", "slug": "color-black", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
33717
www.careofcarl.com
0
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_7.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_4.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_5.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_3.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_8.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_6.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_2.jpg", "6": "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_1.jpg", "7": "https://www.careofcarl.com/bilder/artiklar/zoom/16467811r_7.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 994, "name": "Care of Carl", "slug": "brand-care-of-carl", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 2, "visible": 1, "variation": 1}]
["", "", "", ""]
33719
www.careofcarl.com
0
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_1.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_6.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_8.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_4.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_3.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_2.jpg", "6": "https://www.careofcarl.com/bilder/artiklar/zoom/16237111r_5.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 935, "name": "Barbour Lifestyle", "slug": "brand-barbour-lifestyle", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 475, "name": "Green", "slug": "color-green", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
33721
www.careofcarl.com
0
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_7.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_5.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_4.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_7.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_1.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_2.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_8.jpg", "6": "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_6.jpg", "7": "https://www.careofcarl.com/bilder/artiklar/zoom/16534811r_3.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 987, "name": "Swims", "slug": "brand-swims", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 120, "name": "Blue", "slug": "color-blue", "taxonomy": "pa_color"}, false], [{"term_id": 699, "name": "Navy", "slug": "color-navy", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
33723
www.careofcarl.com
0
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_7.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_2.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_1.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_5.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_3.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_7.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_8.jpg", "6": "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_6.jpg", "7": "https://www.careofcarl.com/bilder/artiklar/zoom/16513911r_4.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 135, "name": "Ralph Lauren", "slug": "brand-ralphlauren", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 120, "name": "Blue", "slug": "color-blue", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
33725
www.careofcarl.com
0
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_7.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_6.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_2.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_8.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_5.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_7.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_3.jpg", "6": "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_4.jpg", "7": "https://www.careofcarl.com/bilder/artiklar/zoom/16086611r_1.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 244, "name": "Herno", "slug": "brand-herno", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 475, "name": "Green", "slug": "color-green", "taxonomy": "pa_color"}, false], [{"term_id": 829, "name": "Dark Green", "slug": "color-dark-green", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]

Statistics

Average successful run time: about 8 hours

Total run time: 14 days

Total cpu time used: about 8 hours

Total disk space used: 4.27 MB

History

  • Auto ran revision d3b35f4e and completed successfully .
    nothing changed in the database
  • Auto ran revision d3b35f4e and completed successfully .
    nothing changed in the database
  • Auto ran revision d3b35f4e and completed successfully .
    nothing changed in the database
  • Auto ran revision d3b35f4e and completed successfully .
    nothing changed in the database
  • Auto ran revision d3b35f4e and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history