GityUpNow / heilbronn_amenityOpeningHours_scraper

Scrapes the current opening Hours of the amenities of the city heilbronn. The link of our project is recycling.gonam.de


This is a scraper that runs on Morph. To get started see the documentation. It scrapes the opening Hours and the Adresses of the amenities of the city Heilbronn(Germany) once per day, adds the coordinates from Google Maps and pushes the data into the data.sqlite file. Our project can be visited at recycling.gonam.de If you have any questions about my code or if you need help with creating a nodejs Scraper at morph.io, just send me a message.

~Programmed by GityUpNow

Contributors GityUpNow

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): unspecified  engines.npm (package.json): unspecified (use default)   Resolving node version (latest stable) via semver.io...  Downloading and installing node 7.7.2...  Using default npm version: 4.1.2  -----> Restoring cache  Skipping cache restore (new runtime signature)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@3.1.8 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v51-linux-x64/node_sqlite3.node" is installed via remote  /tmp/build  +-- cheerio@0.22.0  | +-- css-select@1.2.0  | | +-- boolbase@1.0.0  | | +-- css-what@2.1.0  | | +-- domutils@1.5.1  | | `-- nth-check@1.0.1  | +-- dom-serializer@0.1.0  | | `-- domelementtype@1.1.3  | +-- entities@1.1.1  | +-- htmlparser2@3.9.2  | | +-- domelementtype@1.3.0  | | +-- domhandler@2.3.0  | | +-- inherits@2.0.3  | | `-- readable-stream@2.2.3  | | +-- buffer-shims@1.0.0  | | +-- core-util-is@1.0.2  | | +-- isarray@1.0.0  | | +-- process-nextick-args@1.0.7  | | +-- string_decoder@0.10.31  | | `-- util-deprecate@1.0.2  | +-- lodash.assignin@4.2.0  | +-- lodash.bind@4.2.1  | +-- lodash.defaults@4.2.0  | +-- lodash.filter@4.6.0  | +-- lodash.flatten@4.4.0  | +-- lodash.foreach@4.5.0  | +-- lodash.map@4.6.0  | +-- lodash.merge@4.6.0  | +-- lodash.pick@4.4.0  | +-- lodash.reduce@4.6.0  | +-- lodash.reject@4.6.0  | `-- lodash.some@4.6.0  +-- nodejs@0.0.0  +-- request@2.80.0  | +-- aws-sign2@0.6.0  | +-- aws4@1.6.0  | +-- caseless@0.12.0  | +-- combined-stream@1.0.5  | | `-- delayed-stream@1.0.0  | +-- extend@3.0.0  | +-- forever-agent@0.6.1  | +-- form-data@2.1.2  | | `-- asynckit@0.4.0  | +-- har-validator@4.2.1  | | +-- ajv@4.11.4  | | | +-- co@4.6.0  | | | `-- json-stable-stringify@1.0.1  | | | `-- jsonify@0.0.0  | | `-- har-schema@1.0.5  | +-- hawk@3.1.3  | | +-- boom@2.10.1  | | +-- cryptiles@2.0.5  | | +-- hoek@2.16.3  | | `-- sntp@1.0.9  | +-- http-signature@1.1.1  | | +-- assert-plus@0.2.0  | | +-- jsprim@1.3.1  | | | +-- extsprintf@1.0.2  | | | +-- json-schema@0.2.3  | | | `-- verror@1.3.6  | | `-- sshpk@1.11.0  | | +-- asn1@0.2.3  | | +-- assert-plus@1.0.0  | | +-- bcrypt-pbkdf@1.0.1  | | +-- dashdash@1.14.1  | | | `-- assert-plus@1.0.0  | | +-- ecc-jsbn@0.1.1  | | +-- getpass@0.1.6  | | | `-- assert-plus@1.0.0  | | +-- jodid25519@1.0.2  | | +-- jsbn@0.1.1  | | `-- tweetnacl@0.14.5  | +-- is-typedarray@1.0.0  | +-- isstream@0.1.2  | +-- json-stringify-safe@5.0.1  | +-- mime-types@2.1.14  | | `-- mime-db@1.26.0  | +-- oauth-sign@0.8.2  | +-- performance-now@0.2.0  | +-- qs@6.3.2  | +-- stringstream@0.0.5  | +-- tough-cookie@2.3.2  | | `-- punycode@1.4.1  | +-- tunnel-agent@0.4.3  | `-- uuid@3.0.1  `-- sqlite3@3.1.8  +-- nan@2.4.0  `-- node-pre-gyp@0.6.31  +-- mkdirp@0.5.1  | `-- minimist@0.0.8  +-- nopt@3.0.6  | `-- abbrev@1.0.9  +-- npmlog@4.0.0  | +-- are-we-there-yet@1.1.2  | | +-- delegates@1.0.0  | | `-- readable-stream@2.1.5  | | +-- buffer-shims@1.0.0  | | +-- core-util-is@1.0.2  | | +-- inherits@2.0.3  | | +-- isarray@1.0.0  | | +-- process-nextick-args@1.0.7  | | +-- string_decoder@0.10.31  | | `-- util-deprecate@1.0.2  | +-- console-control-strings@1.1.0  | +-- gauge@2.6.0  | | +-- aproba@1.0.4  | | +-- has-color@0.1.7  | | +-- has-unicode@2.0.1  | | +-- object-assign@4.1.0  | | +-- signal-exit@3.0.1  | | +-- string-width@1.0.2  | | | +-- code-point-at@1.0.1  | | | | `-- number-is-nan@1.0.1  | | | `-- is-fullwidth-code-point@1.0.0  | | | `-- number-is-nan@1.0.1  | | +-- strip-ansi@3.0.1  | | | `-- ansi-regex@2.0.0  | | `-- wide-align@1.1.0  | `-- set-blocking@2.0.0  +-- rc@1.1.6  | +-- deep-extend@0.4.1  | +-- ini@1.3.4  | +-- minimist@1.2.0  | `-- strip-json-comments@1.0.4  +-- request@2.76.0  | +-- aws-sign2@0.6.0  | +-- aws4@1.5.0  | +-- caseless@0.11.0  | +-- combined-stream@1.0.5  | | `-- delayed-stream@1.0.0  | +-- extend@3.0.0  | +-- forever-agent@0.6.1  | +-- form-data@2.1.1  | | `-- asynckit@0.4.0  | +-- har-validator@2.0.6  | | +-- chalk@1.1.3  | | | +-- ansi-styles@2.2.1  | | | +-- escape-string-regexp@1.0.5  | | | +-- has-ansi@2.0.0  | | | | `-- ansi-regex@2.0.0  | | | +-- strip-ansi@3.0.1  | | | | `-- ansi-regex@2.0.0  | | | `-- supports-color@2.0.0  | | +-- commander@2.9.0  | | | `-- graceful-readlink@1.0.1  | | +-- is-my-json-valid@2.15.0  | | | +-- generate-function@2.0.0  | | | +-- generate-object-property@1.2.0  | | | | `-- is-property@1.0.2  | | | +-- jsonpointer@4.0.0  | | | `-- xtend@4.0.1  | | `-- pinkie-promise@2.0.1  | | `-- pinkie@2.0.4  | +-- hawk@3.1.3  | | +-- boom@2.10.1  | | +-- cryptiles@2.0.5  | | +-- hoek@2.16.3  | | `-- sntp@1.0.9  | +-- http-signature@1.1.1  | | +-- assert-plus@0.2.0  | | +-- jsprim@1.3.1  | | | +-- extsprintf@1.0.2  | | | +-- json-schema@0.2.3  | | | `-- verror@1.3.6  | | `-- sshpk@1.10.1  | | +-- asn1@0.2.3  | | +-- assert-plus@1.0.0  | | +-- bcrypt-pbkdf@1.0.0  | | +-- dashdash@1.14.0  | | +-- ecc-jsbn@0.1.1  | | +-- getpass@0.1.6  | | +-- jodid25519@1.0.2  | | +-- jsbn@0.1.0  | | `-- tweetnacl@0.14.3  | +-- is-typedarray@1.0.0  | +-- isstream@0.1.2  | +-- json-stringify-safe@5.0.1  | +-- mime-types@2.1.12  | | `-- mime-db@1.24.0  | +-- node-uuid@1.4.7  | +-- oauth-sign@0.8.2  | +-- qs@6.3.0  | +-- stringstream@0.0.5  | +-- tough-cookie@2.3.2  | | `-- punycode@1.4.1  | `-- tunnel-agent@0.4.3  +-- rimraf@2.5.4  | `-- glob@7.1.1  | +-- fs.realpath@1.0.0  | +-- inflight@1.0.6  | | `-- wrappy@1.0.2  | +-- inherits@2.0.3  | +-- minimatch@3.0.3  | | `-- brace-expansion@1.1.6  | | +-- balanced-match@0.4.2  | | `-- concat-map@0.0.1  | +-- once@1.4.0  | | `-- wrappy@1.0.2  | `-- path-is-absolute@1.0.1  +-- semver@5.3.0  +-- tar@2.2.1  | +-- block-stream@0.0.9  | +-- fstream@1.0.10  | | `-- graceful-fs@4.1.9  | `-- inherits@2.0.3  `-- tar-pack@3.3.0  +-- debug@2.2.0  | `-- ms@0.7.1  +-- fstream@1.0.10  | +-- graceful-fs@4.1.9  | `-- inherits@2.0.3  +-- fstream-ignore@1.0.5  | +-- inherits@2.0.3  | `-- minimatch@3.0.3  | `-- brace-expansion@1.1.6  | +-- balanced-match@0.4.2  | `-- concat-map@0.0.1  +-- once@1.3.3  | `-- wrappy@1.0.2  +-- readable-stream@2.1.5  | +-- buffer-shims@1.0.0  | +-- core-util-is@1.0.2  | +-- inherits@2.0.3  | +-- isarray@1.0.0  | +-- process-nextick-args@1.0.7  | +-- string_decoder@0.10.31  | `-- util-deprecate@1.0.2  `-- uid-number@0.0.6   -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  +-- cheerio@0.22.0  +-- nodejs@0.0.0  +-- request@2.80.0  `-- sqlite3@3.1.8   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... module.js:472 throw err; ^ Error: Cannot find module 'async' at Function.Module._resolveFilename (module.js:470:15) at Function.Module._load (module.js:418:25) at Module.require (module.js:498:17) at require (internal/module.js:20:19) at Object.<anonymous> (/app/scraper.js:4:13) at Module._compile (module.js:571:32) at Object.Module._extensions..js (module.js:580:10) at Module.load (module.js:488:32) at tryModuleLoad (module.js:447:12) at Function.Module._load (module.js:439:3)

Data

Downloaded 527 times by GityUpNow MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (10 KB) Use the API

rows 0 / 0

Statistics

Average successful run time: 1 minute

Total run time: about 6 hours

Total cpu time used: 8 minutes

Total disk space used: 41.2 KB

History

  • Auto ran revision 187f4ef0 and failed .
    nothing changed in the database
  • Auto ran revision 187f4ef0 and failed .
    nothing changed in the database
  • Auto ran revision 187f4ef0 and failed .
    nothing changed in the database
  • Auto ran revision 187f4ef0 and failed .
    nothing changed in the database
  • Auto ran revision 187f4ef0 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history