shandanjay / shandanjay

shandanjay

Scrapes google.com and www.google.com

Search the world's information, including webpages, images, videos and more. Google has many special features to help you find exactly what you're looking for.


This is a scraper that runs on Morph. To get started see the documentation

Contributors shandanjay

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Perl/PSGI app detected -----> Bootstrapping cpanm  Successfully installed App-cpanminus-1.7043  1 distribution installed -----> Installing dependencies  Successfully installed IO-HTML-1.001  Successfully installed Encode-Locale-1.05  Successfully installed URI-1.73  Successfully installed LWP-MediaTypes-6.02  Successfully installed HTTP-Date-6.02  Successfully installed HTTP-Message-6.14  Successfully installed HTTP-Negotiate-6.01  Successfully installed HTTP-Cookies-6.04  Successfully installed WWW-RobotRules-6.02  Successfully installed Net-HTTP-6.17  Successfully installed HTTP-Daemon-6.01  Successfully installed HTML-Tagset-3.20  Successfully installed HTML-Parser-3.72  Successfully installed Try-Tiny-0.30  Successfully installed File-Listing-6.04  Successfully installed libwww-perl-6.31  Successfully installed Sub-Uplevel-0.2800  Successfully installed Test-Exception-0.43  Successfully installed Test-Pod-1.51  Successfully installed JSON-2.97001  Successfully installed DBI-1.640  Successfully installed DBD-SQLite-1.54  Successfully installed Database-DumpTruck-1.2  Successfully installed Test-Fatal-0.014  Successfully installed HTML-Tree-5.07  25 distributions installed -----> Installing Starman  Successfully installed ExtUtils-Config-0.008  Successfully installed ExtUtils-InstallPaths-0.011  Successfully installed Test-Harness-3.39  Successfully installed ExtUtils-Helpers-0.026  Successfully installed Module-Build-Tiny-0.039  Successfully installed HTTP-Parser-XS-0.17  Successfully installed Net-Server-2.009  Successfully installed File-ShareDir-Install-0.11  Successfully installed Class-Inspector-1.32  Successfully installed File-ShareDir-1.104  Successfully installed CPAN-Meta-YAML-0.018 (upgraded from 0.008)  Successfully installed JSON-PP-2.97001 (upgraded from 2.27202)  Successfully installed CPAN-Meta-2.150010 (upgraded from 2.120921)  Successfully installed Module-Build-0.4224 (upgraded from 0.4003)  Successfully installed WWW-Form-UrlEncoded-0.24  Successfully installed Stream-Buffered-0.03  Successfully installed Filesys-Notify-Simple-0.12  Successfully installed HTTP-Tiny-0.070 (upgraded from 0.025)  Successfully installed Devel-StackTrace-2.03  Successfully installed Devel-StackTrace-AsHTML-0.15  Successfully installed Hash-MultiValue-0.16  Successfully installed IO-Socket-IP-0.39  Successfully installed Test-SharedFork-0.35  Successfully installed Test-TCP-2.19  Successfully installed Cookie-Baker-0.08  Successfully installed HTTP-Headers-Fast-0.21  Successfully installed POSIX-strftime-Compiler-0.42  Successfully installed Apache-LogFormat-Compiler-0.35  Successfully installed Cpanel-JSON-XS-4.01  Successfully installed JSON-MaybeXS-1.003010  Successfully installed Test-Deep-1.127  Successfully installed HTTP-MultiPartParser-0.02  Successfully installed HTTP-Entity-Parser-0.20  Successfully installed Plack-1.0047  Successfully installed Data-Dump-1.23  Successfully installed Starman-0.4014  36 distributions installed  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 4 times by MikeRalphson shandanjay

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (20 KB) Use the API

rows 10 / 671

Name Occupation
_
Software Developer
_
Software Developer
_
Software Developer
_
Software Developer
_
Software Developer
_
Software Developer
_
Software Developer
_
Software Developer
_
Software Developer
_
Software Developer

Statistics

Average successful run time: 2 minutes

Total run time: about 1 month

Total cpu time used: 4 minutes

Total disk space used: 40.8 KB

History

  • Auto ran revision f0d40ea9 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision f0d40ea9 and failed .
    nothing changed in the database
  • Auto ran revision f0d40ea9 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision f0d40ea9 and completed successfully .
    1 record added in the database
  • Auto ran revision f0d40ea9 and completed successfully .
    1 record added in the database
    3 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Perl

shandanjay / scraper.pl