piducancore / cneLocations

Scrapes morph.io and www.legvi.org

Get structured data out of the web. Code collaboration through GitHub. Run your scrapers in the cloud.

Contributors piducancore

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Node.js app detected [1G [1G-----> Creating runtime environment [1G [1G NPM_CONFIG_LOGLEVEL=error [1G NPM_CONFIG_PRODUCTION=true [1G NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt [1G NODE_VERBOSE=false [1G NODE_ENV=production [1G NODE_TLS_REJECT_UNAUTHORIZED=0 [1G NODE_MODULES_CACHE=true [1G [1G-----> Installing binaries [1G engines.node (package.json): unspecified [1G engines.npm (package.json): unspecified (use default) [1G [1G Resolving node version 6.x... [1G Downloading and installing node 6.14.3... [1G Using default npm version: 3.10.10 [1G [1G-----> Restoring cache [1G Skipping cache restore (not-found) [1G [1G-----> Building dependencies [1G Installing node modules (package.json) [1G [1G > sqlite3@4.0.0 install /tmp/build/node_modules/sqlite3 [1G > node-pre-gyp install --fallback-to-build [1G [1G [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v48-linux-x64/node_sqlite3.node" is installed via remote [1G @0.0.1 /tmp/build [1G +-- cheerio@1.0.0-rc.2 [1G | +-- css-select@1.2.0 [1G | | +-- boolbase@1.0.0 [1G | | +-- css-what@2.1.0 [1G | | +-- domutils@1.5.1 [1G | | `-- nth-check@1.0.1 [1G | +-- dom-serializer@0.1.0 [1G | | `-- domelementtype@1.1.3 [1G | +-- entities@1.1.1 [1G | +-- htmlparser2@3.9.2 [1G | | +-- domelementtype@1.3.0 [1G | | +-- domhandler@2.4.2 [1G | | +-- inherits@2.0.3 [1G | | `-- readable-stream@2.3.6 [1G | | +-- core-util-is@1.0.2 [1G | | +-- isarray@1.0.0 [1G | | +-- process-nextick-args@2.0.0 [1G | | +-- string_decoder@1.1.1 [1G | | `-- util-deprecate@1.0.2 [1G | +-- lodash@4.17.10 [1G | `-- parse5@3.0.3 [1G | `-- @types/node@10.3.3 [1G +-- request@2.87.0 [1G | +-- aws-sign2@0.7.0 [1G | +-- aws4@1.7.0 [1G | +-- caseless@0.12.0 [1G | +-- combined-stream@1.0.6 [1G | | `-- delayed-stream@1.0.0 [1G | +-- extend@3.0.1 [1G | +-- forever-agent@0.6.1 [1G | +-- form-data@2.3.2 [1G | | `-- asynckit@0.4.0 [1G | +-- har-validator@5.0.3 [1G | | +-- ajv@5.5.2 [1G | | | +-- co@4.6.0 [1G | | | +-- fast-deep-equal@1.1.0 [1G | | | +-- fast-json-stable-stringify@2.0.0 [1G | | | `-- json-schema-traverse@0.3.1 [1G | | `-- har-schema@2.0.0 [1G | +-- http-signature@1.2.0 [1G | | +-- assert-plus@1.0.0 [1G | | +-- jsprim@1.4.1 [1G | | | +-- extsprintf@1.3.0 [1G | | | +-- json-schema@0.2.3 [1G | | | `-- verror@1.10.0 [1G | | `-- sshpk@1.14.2 [1G | | +-- asn1@0.2.3 [1G | | +-- bcrypt-pbkdf@1.0.1 [1G | | +-- dashdash@1.14.1 [1G | | +-- ecc-jsbn@0.1.1 [1G | | +-- getpass@0.1.7 [1G | | +-- jsbn@0.1.1 [1G | | +-- safer-buffer@2.1.2 [1G | | `-- tweetnacl@0.14.5 [1G | +-- is-typedarray@1.0.0 [1G | +-- isstream@0.1.2 [1G | +-- json-stringify-safe@5.0.1 [1G | +-- mime-types@2.1.18 [1G | | `-- mime-db@1.33.0 [1G | +-- oauth-sign@0.8.2 [1G | +-- performance-now@2.1.0 [1G | +-- qs@6.5.2 [1G | +-- safe-buffer@5.1.2 [1G | +-- tough-cookie@2.3.4 [1G | | `-- punycode@1.4.1 [1G | +-- tunnel-agent@0.6.0 [1G | `-- uuid@3.2.1 [1G `-- sqlite3@4.0.0 [1G +-- nan@2.9.2 [1G `-- node-pre-gyp@0.9.0 [1G +-- detect-libc@1.0.3 [1G +-- mkdirp@0.5.1 [1G | `-- minimist@0.0.8 [1G +-- needle@2.2.0 [1G | +-- debug@2.6.9 [1G | | `-- ms@2.0.0 [1G | +-- iconv-lite@0.4.19 [1G | `-- sax@1.2.4 [1G +-- nopt@4.0.1 [1G | +-- abbrev@1.1.1 [1G | `-- osenv@0.1.5 [1G | +-- os-homedir@1.0.2 [1G | `-- os-tmpdir@1.0.2 [1G +-- npm-packlist@1.1.10 [1G | +-- ignore-walk@3.0.1 [1G | | `-- minimatch@3.0.4 [1G | | `-- brace-expansion@1.1.11 [1G | | +-- balanced-match@1.0.0 [1G | | `-- concat-map@0.0.1 [1G | `-- npm-bundled@1.0.3 [1G +-- npmlog@4.1.2 [1G | +-- are-we-there-yet@1.1.4 [1G | | +-- delegates@1.0.0 [1G | | `-- readable-stream@2.3.5 [1G | | +-- core-util-is@1.0.2 [1G | | +-- isarray@1.0.0 [1G | | +-- process-nextick-args@2.0.0 [1G | | +-- safe-buffer@5.1.1 [1G | | +-- string_decoder@1.0.3 [1G | | `-- util-deprecate@1.0.2 [1G | +-- console-control-strings@1.1.0 [1G | +-- gauge@2.7.4 [1G | | +-- aproba@1.2.0 [1G | | +-- has-unicode@2.0.1 [1G | | +-- object-assign@4.1.1 [1G | | +-- signal-exit@3.0.2 [1G | | +-- string-width@1.0.2 [1G | | | +-- code-point-at@1.1.0 [1G | | | `-- is-fullwidth-code-point@1.0.0 [1G | | | `-- number-is-nan@1.0.1 [1G | | +-- strip-ansi@3.0.1 [1G | | | `-- ansi-regex@2.1.1 [1G | | `-- wide-align@1.1.2 [1G | `-- set-blocking@2.0.0 [1G +-- rc@1.2.6 [1G | +-- deep-extend@0.4.2 [1G | +-- ini@1.3.5 [1G | +-- minimist@1.2.0 [1G | `-- strip-json-comments@2.0.1 [1G +-- rimraf@2.6.2 [1G | `-- glob@7.1.2 [1G | +-- fs.realpath@1.0.0 [1G | +-- inflight@1.0.6 [1G | | `-- wrappy@1.0.2 [1G | +-- inherits@2.0.3 [1G | +-- once@1.4.0 [1G | `-- path-is-absolute@1.0.1 [1G +-- semver@5.5.0 [1G `-- tar@4.4.0 [1G +-- chownr@1.0.1 [1G +-- fs-minipass@1.2.5 [1G +-- minipass@2.2.1 [1G +-- minizlib@1.1.0 [1G `-- yallist@3.0.2 [1G [1G [1G-----> Caching build [1G Clearing previous node cache [1G Saving 2 cacheDirectories (default): [1G - node_modules [1G - bower_components (nothing to cache) [1G [1G-----> Build succeeded! [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... 1: J. Pablo Pérez Trabucco 2: Will Ockenden 3: Professor Wendy Bacon

Statistics

Average successful run time: less than a minute

Total run time: less than a minute

Total cpu time used: less than 5 seconds

Total disk space used: 28.3 KB

History

  • Manually ran revision 1d1d038f and completed successfully .
    3 records added in the database
    3 pages scraped
  • Created on morph.io

Scraper code

cneLocations