adricl / Bayside_Victoria

Bayside City Council


This gets data from the Bayside City Council website.

I have my scraper working but not all the required data can be collected as the links are dynamically generated.

Data from the website is all generated for each session. This means links are not going to work.

This is a scraper that runs on Morph. To get started see the documentation

Contributors adricl

Last run failed with status code 2.

Console output of last run

Injecting configuration and compiling... -----> Perl/PSGI app detected -----> Bootstrapping cpanm  Successfully installed App-cpanminus-1.7039  1 distribution installed -----> Installing dependencies  Successfully installed URI-1.69  Successfully installed Net-HTTP-6.09  Successfully installed HTTP-Date-6.02  Successfully installed IO-HTML-1.001  Successfully installed LWP-MediaTypes-6.02  Successfully installed Encode-Locale-1.05  Successfully installed HTTP-Message-6.11  Successfully installed HTTP-Daemon-6.01  Successfully installed HTML-Tagset-3.20  Successfully installed HTML-Parser-3.71  Successfully installed HTTP-Negotiate-6.01  Successfully installed File-Listing-6.04  Successfully installed HTTP-Cookies-6.01  Successfully installed WWW-RobotRules-6.02  Successfully installed libwww-perl-6.13  Successfully installed Try-Tiny-0.22  Successfully installed Test-Fatal-0.014  Successfully installed HTML-Tree-5.03  ! Couldn't find module or a distribution HTML::TreeBuilder::XPath; (0.14)  Successfully installed Sub-Uplevel-0.25  Successfully installed Test-Exception-0.40  Successfully installed Test-Pod-1.51  Successfully installed DBI-1.634  Successfully installed DBD-SQLite-1.48  Successfully installed JSON-2.90  Successfully installed Database-DumpTruck-1.2  Successfully installed Net-SSLeay-1.72  Successfully installed Mozilla-CA-20150826  Successfully installed IO-Socket-SSL-2.020  Successfully installed LWP-Protocol-https-6.06  ! Installing the dependencies failed: Module 'HTML::TreeBuilder::XPath;' is not installed  ! Bailing out the installation for ..  29 distributions installed -----> Installing Starman  Successfully installed ExtUtils-Config-0.008  Successfully installed Test-Harness-3.35  Successfully installed ExtUtils-Helpers-0.022  Successfully installed ExtUtils-InstallPaths-0.011  Successfully installed Module-Build-Tiny-0.039  Successfully installed IO-Socket-IP-0.37  Successfully installed Test-SharedFork-0.34  Successfully installed Test-TCP-2.14  Successfully installed Data-Dump-1.23  Successfully installed Net-Server-2.008  Successfully installed HTTP-Parser-XS-0.17  Successfully installed File-ShareDir-Install-0.10  Successfully installed HTTP-Tiny-0.056 (upgraded from 0.025)  Successfully installed HTTP-Headers-Fast-0.20  Successfully installed POSIX-strftime-Compiler-0.41  Successfully installed Apache-LogFormat-Compiler-0.32  Successfully installed Cookie-Baker-0.06  Successfully installed Hash-MultiValue-0.16  Successfully installed Filesys-Notify-Simple-0.12  Successfully installed Stream-Buffered-0.03  Successfully installed Devel-StackTrace-2.00  Successfully installed Devel-StackTrace-AsHTML-0.14  Successfully installed HTTP-Body-1.22  Successfully installed Class-Inspector-1.28  Successfully installed File-ShareDir-1.102  Successfully installed Plack-1.0038  Successfully installed Starman-0.4014  27 distributions installed -----> Discovering process types  Procfile declares types -> scraper  Default process types for Perl/PSGI -> web Injecting scraper and running... Can't locate HTML/TreeBuilder/XPath.pm in @INC (you may need to install the HTML::TreeBuilder::XPath module) (@INC contains: /app/local/lib/perl5/x86_64-linux-gnu-thread-multi /app/local/lib/perl5 /etc/perl /usr/local/lib/perl/5.18.2 /usr/local/share/perl/5.18.2 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.18 /usr/share/perl/5.18 /usr/local/lib/site_perl .) at scraper.pl line 7. BEGIN failed--compilation aborted at scraper.pl line 7.

Statistics

Total run time: 4 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 25.9 KB

History

  • Manually ran revision 77acfc58 and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Perl

Bayside_Victoria / scraper.pl