Brandhunt / Brandhunt_produpdate_scraper_phantomjs_py_module_1

Collects product information to be updated from product URLs stored at Brandhunt.se - Only products that require usage of headless browser! Module scraper 1 for centrailzed main scraper


This is a scraper that runs on Morph. To get started see the documentation

Contributors Brandhunt

The scraper is running. It was queued automatically .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Currently scraping product with ID 14957 Currently scraping product with ID 15123 Currently scraping product with ID 15163 Currently scraping product with ID 15223 Currently scraping product with ID 15225 Currently scraping product with ID 15227 Currently scraping product with ID 15229 Currently scraping product with ID 15231 Currently scraping product with ID 15233 Currently scraping product with ID 15235 Currently scraping product with ID 15237 Currently scraping product with ID 15239 Currently scraping product with ID 15241 Currently scraping product with ID 15243 Currently scraping product with ID 15245 Currently scraping product with ID 15247 Currently scraping product with ID 15249 Currently scraping product with ID 15251 Currently scraping product with ID 15253 Currently scraping product with ID 15255 Currently scraping product with ID 15257 Currently scraping product with ID 15259 Currently scraping product with ID 15261 Currently scraping product with ID 15263 Currently scraping product with ID 15265 Currently scraping product with ID 15267 Currently scraping product with ID 15269 Currently scraping product with ID 15271 Currently scraping product with ID 15273 Currently scraping product with ID 15275 Currently scraping product with ID 15277 Currently scraping product with ID 15281 Currently scraping product with ID 15283 Currently scraping product with ID 15286 Currently scraping product with ID 15289 Currently scraping product with ID 15292 Currently scraping product with ID 15295 Currently scraping product with ID 15305 Currently scraping product with ID 15308 Currently scraping product with ID 15311 Currently scraping product with ID 15314 Currently scraping product with ID 15317 Currently scraping product with ID 15323 Currently scraping product with ID 15329 Currently scraping product with ID 15332 Currently scraping product with ID 15335 Currently scraping product with ID 15338 Currently scraping product with ID 15341 Currently scraping product with ID 15344 Currently scraping product with ID 15347 Currently scraping product with ID 15352 Currently scraping product with ID 15357 Currently scraping product with ID 15360 Currently scraping product with ID 15363 Currently scraping product with ID 15366 Currently scraping product with ID 15369 Currently scraping product with ID 15372 Currently scraping product with ID 15375 Currently scraping product with ID 15378 Currently scraping product with ID 15383 Currently scraping product with ID 15387 Currently scraping product with ID 15390 Currently scraping product with ID 15392 Currently scraping product with ID 15394 Currently scraping product with ID 15397 Currently scraping product with ID 15400 Currently scraping product with ID 15402 Currently scraping product with ID 15404 Currently scraping product with ID 15406 Currently scraping product with ID 15408 Currently scraping product with ID 15410 Currently scraping product with ID 15412 Currently scraping product with ID 15414 Currently scraping product with ID 15416 Currently scraping product with ID 15418 Currently scraping product with ID 15421 Currently scraping product with ID 15424 Currently scraping product with ID 15429 Currently scraping product with ID 15432 Currently scraping product with ID 15435 Currently scraping product with ID 15438 Currently scraping product with ID 15441 Currently scraping product with ID 15444 Currently scraping product with ID 15447 Currently scraping product with ID 15450 Currently scraping product with ID 15453 Currently scraping product with ID 15456 Currently scraping product with ID 15459 Currently scraping product with ID 15461 Currently scraping product with ID 15464 Currently scraping product with ID 15466 Currently scraping product with ID 15468 Currently scraping product with ID 15470 Currently scraping product with ID 15472 Currently scraping product with ID 15475 Currently scraping product with ID 15477 Currently scraping product with ID 15480 Currently scraping product with ID 15482 Currently scraping product with ID 15485 Currently scraping product with ID 15488 Currently scraping product with ID 15491 Currently scraping product with ID 15493 Currently scraping product with ID 15495 Currently scraping product with ID 15497 Currently scraping product with ID 15499 Currently scraping product with ID 15501 Currently scraping product with ID 15503 Currently scraping product with ID 15505 Currently scraping product with ID 15507 Currently scraping product with ID 15509 Currently scraping product with ID 15513 Currently scraping product with ID 15515 Currently scraping product with ID 15518 Currently scraping product with ID 15520 Currently scraping product with ID 15522 Currently scraping product with ID 15524 Currently scraping product with ID 15526 Currently scraping product with ID 15528 Currently scraping product with ID 15532 Currently scraping product with ID 15534 Currently scraping product with ID 15536 Currently scraping product with ID 15538 Currently scraping product with ID 15540 Currently scraping product with ID 15542 Currently scraping product with ID 15544 Currently scraping product with ID 15548 Currently scraping product with ID 15550 Currently scraping product with ID 15552 Currently scraping product with ID 15556 Currently scraping product with ID 15558 Currently scraping product with ID 15560 Currently scraping product with ID 15562 Currently scraping product with ID 15564 Currently scraping product with ID 15570 Currently scraping product with ID 15574 Currently scraping product with ID 15576 Currently scraping product with ID 15579 Currently scraping product with ID 15581 Currently scraping product with ID 15583 Currently scraping product with ID 15585 Currently scraping product with ID 15588 Currently scraping product with ID 15591 Currently scraping product with ID 15594 Currently scraping product with ID 15597 Currently scraping product with ID 15600 Currently scraping product with ID 15603 Currently scraping product with ID 15606 Currently scraping product with ID 15609 Currently scraping product with ID 15612 Currently scraping product with ID 15619 Currently scraping product with ID 15622 Currently scraping product with ID 15625 Currently scraping product with ID 15628 Currently scraping product with ID 15631 Currently scraping product with ID 15634 Currently scraping product with ID 15637 Currently scraping product with ID 15642 Currently scraping product with ID 15645 Currently scraping product with ID 15648 Currently scraping product with ID 15651 Currently scraping product with ID 15654 Currently scraping product with ID 15657 Currently scraping product with ID 15664 Currently scraping product with ID 15667 Currently scraping product with ID 15670 Currently scraping product with ID 15673 Currently scraping product with ID 15676 Currently scraping product with ID 15679 Currently scraping product with ID 15682 Currently scraping product with ID 15685 Currently scraping product with ID 15688 Currently scraping product with ID 15691 Currently scraping product with ID 15697 Currently scraping product with ID 15700 Currently scraping product with ID 15703 Currently scraping product with ID 15706 Currently scraping product with ID 15709 Currently scraping product with ID 15712 Currently scraping product with ID 15715 Currently scraping product with ID 15718 Currently scraping product with ID 15721 Currently scraping product with ID 15724 Currently scraping product with ID 15726 Currently scraping product with ID 15728 Currently scraping product with ID 15730 Currently scraping product with ID 15733 Currently scraping product with ID 15736 Currently scraping product with ID 15739 Currently scraping product with ID 15742 Currently scraping product with ID 15745 Currently scraping product with ID 15748 Currently scraping product with ID 15751 Currently scraping product with ID 15754 Currently scraping product with ID 15757 Currently scraping product with ID 15759 Currently scraping product with ID 15761 Currently scraping product with ID 15764 Currently scraping product with ID 15767 Currently scraping product with ID 15770 Currently scraping product with ID 15773 Currently scraping product with ID 15776 Currently scraping product with ID 15779 Currently scraping product with ID 15782 Currently scraping product with ID 15785 Currently scraping product with ID 15788 Currently scraping product with ID 15790 Currently scraping product with ID 15793 Currently scraping product with ID 15796 Currently scraping product with ID 15799 Currently scraping product with ID 15804

Data

Downloaded 7187 times by Brandhunt

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (5.84 MB) Use the API

rows 10 / 1649

productid url domain price salesprice domainmisc prodlogurls prodlogurl finalimgurls validimgurls imgurls notfound notavailable removeon404 soldoutfix soldouthtmlfix catstoaddresult attributes sizetypemapsqls
15141
bergbergstore.com
1
1
""
""
""
""
""
true
false
true
false
false
""
[{"name": "Brand", "options": [[{"term_id": -1, "name": "Berg & Berg", "slug": "berg-berg", "taxonomy": "pa_brand"}, true]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 417, "name": "Brown", "slug": "color-brown", "taxonomy": "pa_color"}, false], [{"term_id": 438, "name": "Dark Brown", "slug": "color-dark-brown", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
14859
bergbergstore.com
1
1
""
""
""
""
""
true
false
true
false
false
[[{"term_id": 92, "name": "Trousers", "slug": "trousers", "taxonomy": "product_cat", "ancestors": [73]}, false], [{"term_id": 73, "name": "Trousers & Chinos", "slug": "trousers-chinos", "taxonomy": "product_cat", "ancestors": []}, false]]
[{"name": "Brand", "options": [[{"term_id": -1, "name": "Berg & Berg", "slug": "berg-berg", "taxonomy": "pa_brand"}, true]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 117, "name": "Black", "slug": "color-black", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
14861
bergbergstore.com
1
1
""
""
""
""
""
true
false
true
false
false
[[{"term_id": 92, "name": "Trousers", "slug": "trousers", "taxonomy": "product_cat", "ancestors": [73]}, false], [{"term_id": 73, "name": "Trousers & Chinos", "slug": "trousers-chinos", "taxonomy": "product_cat", "ancestors": []}, false]]
[{"name": "Brand", "options": [[{"term_id": -1, "name": "Berg & Berg", "slug": "berg-berg", "taxonomy": "pa_brand"}, true]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 417, "name": "Brown", "slug": "color-brown", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
14863
bergbergstore.com
1
1
""
""
""
""
""
true
false
true
false
false
[[{"term_id": 92, "name": "Trousers", "slug": "trousers", "taxonomy": "product_cat", "ancestors": [73]}, false], [{"term_id": 73, "name": "Trousers & Chinos", "slug": "trousers-chinos", "taxonomy": "product_cat", "ancestors": []}, false]]
[{"name": "Brand", "options": [[{"term_id": -1, "name": "Berg & Berg", "slug": "berg-berg", "taxonomy": "pa_brand"}, true]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 699, "name": "Navy", "slug": "color-navy", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
14865
bergbergstore.com
1
1
""
""
""
""
""
true
false
true
false
false
[[{"term_id": 92, "name": "Trousers", "slug": "trousers", "taxonomy": "product_cat", "ancestors": [73]}, false], [{"term_id": 73, "name": "Trousers & Chinos", "slug": "trousers-chinos", "taxonomy": "product_cat", "ancestors": []}, false]]
[{"name": "Brand", "options": [[{"term_id": -1, "name": "Berg & Berg", "slug": "berg-berg", "taxonomy": "pa_brand"}, true]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 419, "name": "Olive", "slug": "color-olive", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
14867
bergbergstore.com
1
1
""
""
""
""
""
true
false
true
false
false
[[{"term_id": 92, "name": "Trousers", "slug": "trousers", "taxonomy": "product_cat", "ancestors": [73]}, false], [{"term_id": 73, "name": "Trousers & Chinos", "slug": "trousers-chinos", "taxonomy": "product_cat", "ancestors": []}, false]]
[{"name": "Brand", "options": [[{"term_id": -1, "name": "Berg & Berg", "slug": "berg-berg", "taxonomy": "pa_brand"}, true]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 420, "name": "Sand", "slug": "color-sand", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
14869
bergbergstore.com
1
1
""
""
""
""
""
true
false
true
false
false
[[{"term_id": 92, "name": "Trousers", "slug": "trousers", "taxonomy": "product_cat", "ancestors": [73]}, false], [{"term_id": 73, "name": "Trousers & Chinos", "slug": "trousers-chinos", "taxonomy": "product_cat", "ancestors": []}, false]]
[{"name": "Brand", "options": [[{"term_id": -1, "name": "Berg & Berg", "slug": "berg-berg", "taxonomy": "pa_brand"}, true]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 417, "name": "Brown", "slug": "color-brown", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
14871
bergbergstore.com
1
1
""
""
""
""
""
true
false
true
false
false
[[{"term_id": 92, "name": "Trousers", "slug": "trousers", "taxonomy": "product_cat", "ancestors": [73]}, false], [{"term_id": 73, "name": "Trousers & Chinos", "slug": "trousers-chinos", "taxonomy": "product_cat", "ancestors": []}, false]]
[{"name": "Brand", "options": [[{"term_id": -1, "name": "Berg & Berg", "slug": "berg-berg", "taxonomy": "pa_brand"}, true]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 699, "name": "Navy", "slug": "color-navy", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
14873
bergbergstore.com
1
1
""
""
""
""
""
true
false
true
false
false
[[{"term_id": 92, "name": "Trousers", "slug": "trousers", "taxonomy": "product_cat", "ancestors": [73]}, false], [{"term_id": 73, "name": "Trousers & Chinos", "slug": "trousers-chinos", "taxonomy": "product_cat", "ancestors": []}, false]]
[{"name": "Brand", "options": [[{"term_id": -1, "name": "Berg & Berg", "slug": "berg-berg", "taxonomy": "pa_brand"}, true]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 421, "name": "Charcoal", "slug": "color-charcoal", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]
14875
bergbergstore.com
1
1
""
""
""
""
""
true
false
true
false
false
[[{"term_id": 92, "name": "Trousers", "slug": "trousers", "taxonomy": "product_cat", "ancestors": [73]}, false], [{"term_id": 73, "name": "Trousers & Chinos", "slug": "trousers-chinos", "taxonomy": "product_cat", "ancestors": []}, false]]
[{"name": "Brand", "options": [[{"term_id": -1, "name": "Berg & Berg", "slug": "berg-berg", "taxonomy": "pa_brand"}, true]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 422, "name": "Mid Grey", "slug": "color-mid-grey", "taxonomy": "pa_color"}, false], [{"term_id": 116, "name": "Grey", "slug": "color-grey", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
["", "", "", ""]

Statistics

Average successful run time: about 3 hours

Total run time: 6 days

Total cpu time used: about 23 hours

Total disk space used: 5.89 MB

History

  • Auto ran revision cf41d503 and completed successfully .
    1500 records added, 1500 records removed in the database
  • Auto ran revision cf41d503 and completed successfully .
    1500 records added, 1500 records removed in the database
  • Auto ran revision cf41d503 and completed successfully .
    1500 records added, 1500 records removed in the database
  • Auto ran revision cf41d503 and completed successfully .
    1500 records added, 1500 records removed in the database
  • Auto ran revision cf41d503 and failed .
    425 records added, 425 records removed in the database
  • ...
  • Created on morph.io

Show complete history