Allexx119 / exist_scraper

Scrape exist.ru

Scrapes exist.ru, netdna.bootstrapcdn.com, s.exist.ru, and 13 other domains

Интернет-магазин Exist.ru - крупнейший в России портал по продаже автозапчастей для иномарок. Все автозапчасти поставляются от производителей и официальных дилеров


This is a scraper that runs on Morph. To get started see the documentation

Contributors Allexx119

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Start scraping: https://exist.ru Current article:326012 Error: Execution context was destroyed, most likely because of a navigation. at rewriteError (/app/node_modules/puppeteer/lib/ExecutionContext.js:159:15) at process._tickCallback (internal/process/next_tick.js:68:7) -- ASYNC -- at ExecutionContext.<anonymous> (/app/node_modules/puppeteer/lib/helper.js:108:27) at ExecutionContext.evaluate (/app/node_modules/puppeteer/lib/ExecutionContext.js:48:31) at ExecutionContext.<anonymous> (/app/node_modules/puppeteer/lib/helper.js:109:23) at DOMWorld.evaluate (/app/node_modules/puppeteer/lib/DOMWorld.js:105:20) -- ASYNC -- at Frame.<anonymous> (/app/node_modules/puppeteer/lib/helper.js:108:27) at Page.evaluate (/app/node_modules/puppeteer/lib/Page.js:809:43) at Page.<anonymous> (/app/node_modules/puppeteer/lib/helper.js:109:23) at gotoPage (/app/scraper.js:74:30) Script done!

Data

Downloaded 2 times by Allexx119

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (8 KB) Use the API

rows 0 / 0

Statistics

Average successful run time: half a minute

Total run time: about 3 hours

Total cpu time used: 2 minutes

Total disk space used: 364 KB

History

  • Manually ran revision 10536eb9 and completed successfully .
    nothing changed in the database
    153 pages scraped
  • Manually ran revision baf78831 and completed successfully .
    nothing changed in the database
    90 pages scraped
  • Manually ran revision eef5d3e2 and completed successfully .
    nothing changed in the database
    90 pages scraped
  • Manually ran revision 5f4328b1 and completed successfully .
    nothing changed in the database
  • Manually ran revision 4efa82ce and failed .
    nothing changed in the database
    156 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Node.js

exist_scraper / scraper.js