Brandhunt / Brandhunt_produpdate_scraper_phantomjs_py_module_8

Collects product information to be updated from product URLs stored at Brandhunt.se - Only products that require usage of headless browser! Module scraper 8 for centrailzed main scraper


This is a scraper that runs on Morph. To get started see the documentation

Contributors Brandhunt

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Data

Downloaded 5288 times by Brandhunt

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3 MB) Use the API

rows 10 / 1226

productid url domain price salesprice domainmisc prodlogurls prodlogurl finalimgurls validimgurls imgurls notfound notavailable removeon404 soldoutfix soldouthtmlfix catstoaddresult attributes sizetypemapsqls
41307
www.careofcarl.com
0
480
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16103610_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16103610_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16103610_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16103610_4.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16103610_2.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16103610_1.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16103610_4.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16103610_3.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 996, "name": "Drake's", "slug": "brand-drakes", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 417, "name": "Brown", "slug": "color-brown", "taxonomy": "pa_color"}, false], [{"term_id": 116, "name": "Grey", "slug": "color-grey", "taxonomy": "pa_color"}, false], [{"term_id": 1183, "name": "Ash", "slug": "color-ash", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
41308
www.careofcarl.com
0
300
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16205210_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16205210_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16205210_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16205210_4.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16205210_4.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16205210_2.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16205210_3.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16205210_1.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 941, "name": "Eton", "slug": "brand-eton", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 475, "name": "Green", "slug": "color-green", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
41309
www.careofcarl.com
169
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/14324510_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14324510_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14324510_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14324510_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14324510_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14324510_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/14324510_1.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/14324510_2.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/14324510_4.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/14324510_6.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/14324510_3.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/14324510_8.jpg"}
false
false
false
false
false
""
[{"name": "Brand", "options": [[{"term_id": 513, "name": "Book", "slug": "brand-book", "taxonomy": "pa_brand"}, false], [{"term_id": 1036, "name": "Moleskine", "slug": "brand-moleskine", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 120, "name": "Blue", "slug": "color-blue", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
41310
www.careofcarl.com
0
240
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16082210_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16082210_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16082210_3.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16082210_1.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16082210_2.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16082210_3.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 153, "name": "Altea", "slug": "brand-altea", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 112, "name": "Red", "slug": "color-red", "taxonomy": "pa_color"}, false], [{"term_id": 699, "name": "Navy", "slug": "color-navy", "taxonomy": "pa_color"}, false], [{"term_id": 120, "name": "Blue", "slug": "color-blue", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
41312
www.careofcarl.com
1500
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/14009310_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14009310_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14009310_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14009310_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/14009310_4.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/14009310_1.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/14009310_8.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/14009310_3.jpg"}
false
false
false
false
false
""
[{"name": "Brand", "options": [[{"term_id": 1017, "name": "Montblanc", "slug": "brand-montblanc", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 112, "name": "Red", "slug": "color-red", "taxonomy": "pa_color"}, false], [{"term_id": 117, "name": "Black", "slug": "color-black", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
41314
www.careofcarl.com
0
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/15022110_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15022110_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15022110_3.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/15022110_3.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/15022110_2.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/15022110_1.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 975, "name": "Paul Smith", "slug": "brand-paul-smith", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 2, "visible": 1, "variation": 1}]
["", "", "", ""]
41316
www.careofcarl.com
1399
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/14955010_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14955010_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14955010_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14955010_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14955010_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/14955010_6.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/14955010_2.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/14955010_4.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/14955010_1.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/14955010_3.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/14955010_6.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/14955010_5.jpg"}
false
false
false
false
false
""
[{"name": "Brand", "options": [[{"term_id": 996, "name": "Drake's", "slug": "brand-drakes", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 417, "name": "Brown", "slug": "color-brown", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
41318
www.careofcarl.com
4800
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16057110_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_5.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_6.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_7.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_8.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_3.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_8.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_1.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_7.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_2.jpg", "5": "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_6.jpg", "6": "https://www.careofcarl.com/bilder/artiklar/zoom/16057110_5.jpg"}
false
false
false
false
false
""
[{"name": "Brand", "options": [[{"term_id": 1017, "name": "Montblanc", "slug": "brand-montblanc", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 117, "name": "Black", "slug": "color-black", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
41320
www.careofcarl.com
0
330
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/16081310_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16081310_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16081310_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/16081310_4.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/16081310_3.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/16081310_2.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/16081310_4.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/16081310_1.jpg"}
false
false
false
true
false
""
[{"name": "Brand", "options": [[{"term_id": 153, "name": "Altea", "slug": "brand-altea", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 120, "name": "Blue", "slug": "color-blue", "taxonomy": "pa_color"}, false], [{"term_id": 699, "name": "Navy", "slug": "color-navy", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
41322
www.careofcarl.com
749
1
""
""
""
["https://www.careofcarl.com/bilder/artiklar/zoom/15712610_1.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15712610_2.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15712610_3.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15712610_4.jpg", "https://www.careofcarl.com/bilder/artiklar/zoom/15712610_5.jpg"]
{"0": "https://www.careofcarl.com/bilder/artiklar/zoom/15712610_2.jpg", "1": "https://www.careofcarl.com/bilder/artiklar/zoom/15712610_4.jpg", "2": "https://www.careofcarl.com/bilder/artiklar/zoom/15712610_1.jpg", "3": "https://www.careofcarl.com/bilder/artiklar/zoom/15712610_5.jpg", "4": "https://www.careofcarl.com/bilder/artiklar/zoom/15712610_3.jpg"}
false
false
false
false
false
""
[{"name": "Brand", "options": [[{"term_id": 994, "name": "Care of Carl", "slug": "brand-care-of-carl", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 456, "name": "Burgundy", "slug": "color-burgundy", "taxonomy": "pa_color"}, false], [{"term_id": 481, "name": "Purple", "slug": "color-purple", "taxonomy": "pa_color"}, false], [{"term_id": 112, "name": "Red", "slug": "color-red", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]

Statistics

Average successful run time: about 6 hours

Total run time: 10 days

Total cpu time used: about 8 hours

Total disk space used: 3.03 MB

History

  • Auto ran revision 92761fc6 and completed successfully .
    nothing changed in the database
  • Auto ran revision 92761fc6 and completed successfully .
    nothing changed in the database
  • Auto ran revision 92761fc6 and completed successfully .
    nothing changed in the database
  • Auto ran revision 92761fc6 and completed successfully .
    nothing changed in the database
  • Auto ran revision 92761fc6 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history