Allexx119 / exist_scraper
Scrape exist.ru
Scrapes exist.ru, netdna.bootstrapcdn.com, s.exist.ru, and 13 other domains
Интернет-магазин Exist.ru - крупнейший в России портал по продаже автозапчастей для иномарок. Все автозапчасти поставляются от производителей и официальных дилеров
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
Injecting scraper and running...
Start scraping: https://exist.ru
Current article:326012
Error: Execution context was destroyed, most likely because of a navigation.
at rewriteError (/app/node_modules/puppeteer/lib/ExecutionContext.js:159:15)
at process._tickCallback (internal/process/next_tick.js:68:7)
-- ASYNC --
at ExecutionContext.<anonymous> (/app/node_modules/puppeteer/lib/helper.js:108:27)
at ExecutionContext.evaluate (/app/node_modules/puppeteer/lib/ExecutionContext.js:48:31)
at ExecutionContext.<anonymous> (/app/node_modules/puppeteer/lib/helper.js:109:23)
at DOMWorld.evaluate (/app/node_modules/puppeteer/lib/DOMWorld.js:105:20)
-- ASYNC --
at Frame.<anonymous> (/app/node_modules/puppeteer/lib/helper.js:108:27)
at Page.evaluate (/app/node_modules/puppeteer/lib/Page.js:809:43)
at Page.<anonymous> (/app/node_modules/puppeteer/lib/helper.js:109:23)
at gotoPage (/app/scraper.js:74:30)
Script done!
Data
Downloaded
2 times
by
Statistics
Average successful run time: half a minute
Total run time: about 3 hours
Total cpu time used: 2 minutes
Total disk space used: 364 KB
History
-
Manually
ran
revision
10536eb9
and
completed successfully
.
nothing changed in the database153 pages scraped
-
Manually
ran
revision
baf78831
and
completed successfully
.
nothing changed in the database90 pages scraped
-
Manually
ran
revision
eef5d3e2
and
completed successfully
.
nothing changed in the database90 pages scraped
-
Manually
ran
revision
5f4328b1
and
completed successfully
.
nothing changed in the database
-
Manually
ran
revision
4efa82ce
and
failed
.
nothing changed in the database156 pages scraped
- ...
- Created on morph.io