yotam-gafni / openbudget_israel

israeli budget information


This is a scraper that runs on Morph. To get started see the documentation

Contributors yotam-gafni

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Another hcode and title ! Another hcode and title ! Another hcode and title ! [] Another hcode and title ! Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! [] Another hcode and title ! Traceback (most recent call last): File "scraper.py", line 149, in <module> runner = scrape_supports().process(year) File "scraper.py", line 91, in process item_codes = session.get(CodesURL % fmt).text File "/app/.heroku/python/lib/python2.7/site-packages/requesocks/sessions.py", line 220, in get return self.request('get', url, **kwargs) File "/app/.heroku/python/lib/python2.7/site-packages/requesocks/sessions.py", line 203, in request r.send(prefetch=prefetch) File "/app/.heroku/python/lib/python2.7/site-packages/requesocks/models.py", line 601, in send raise ConnectionError(e) requesocks.exceptions.ConnectionError: HTTPConnectionPool(host='tmichot.gov.il', port=80): Max retries exceeded with url: /ibi_apps/WFServlet?IBIF_ex=runtrig&TRIGGER0=1&TRIGGER1=suppe_trg_lst_cc_commit&SW_CURROBJ=COMP_CODE&APPID=supp_ext_app&LSTFRMID=suppe_notif_item_all6&FRAMEPCT=0&DO_fex=suppe_notif_item_all6&SW_CLICKED=&LSMYEAR=2012&COMP_CODE=2000&NOTTYPE_LIST=FOC_NONE&NOTTYPE=FOC_NONE&LSMCOMMITXT=&LSCOMMIT_LIST=FOC_NONE&LSCOMMIT=FOC_NONE&OUTPUT=HTML&LSMYEAR_DISPLAY=2012&COMP_CODE_DISPLAY=%E4%EE%F9%F8%E3+%EC%E1%E8%E7%E5%EF+%F4%F0%E9%ED&NOTTYPE_DISPLAY=%E4%EB%EC&LSCOMMIT_DISPLAY=%E4%EB%EC&OUTPUT_DISPLAY=%E4%F6%E2%FA+%E3%E5%E7&SW_INITIAL=N&RAND=0.9564581164158881

Statistics

Average successful run time: about 2 hours

Total run time: 24 days

Total cpu time used: 5 minutes

Total disk space used: 31 KB

History

  • Auto ran revision 26b64cdc and failed .
    nothing changed in the database
  • Auto ran revision 26b64cdc and completed successfully .
    nothing changed in the database
  • Auto ran revision 26b64cdc and failed .
    nothing changed in the database
  • Auto ran revision 26b64cdc and failed .
    nothing changed in the database
  • Auto ran revision 26b64cdc and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

openbudget_israel / scraper.py