jamezpolley / multiple_atdis

Scrapes multiple authorities that have ATDIS feed


This is a scraper that runs on Morph. To get started see the documentation

Contributors mlandauer jamezpolley

Last run failed with status code 998.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Collecting ATDIS feed data for newcastle... I, [2020-06-23T02:42:16.767193 #15] INFO -- : Feed https://ncc-test-web.t1cloud.com/T1PRDefault/WebAppServices/ATDIS/atdis/1.0/applications.json I, [2020-06-23T02:42:17.626127 #15] INFO -- : nil W, [2020-06-23T02:42:17.626218 #15] WARN -- : No/invalid pagination, assuming no records/aborting Scraper didn't create an SQLite database in your current working directory called data.sqlite. If you've just created your first scraper and not edited the code yet this is to be expected. To fix this make your scraper write to an SQLite database at data.sqlite. However, this could also be related to an intermittent problem which we're working hard to resolve: https://github.com/openaustralia/morph/issues/1064

Statistics

Total run time: 25 minutes

Total cpu time used: less than 20 seconds

Total disk space used: 1.99 MB

History

  • Manually ran revision 562cfdc1 and failed .
  • Manually ran revision 77bbc87b and failed .
  • Manually ran revision 46d30154 and failed .
  • Manually ran revision d65d22a7 and failed .
  • Manually ran revision 8405245e and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_atdis / scraper.rb