This is a scraper that runs on Morph. To get started see the documentation

Contributors jonasmerlin

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.9  $ pip install -r requirements.txt  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting beautifulsoup4 (from -r requirements.txt (line 10))  Downloading beautifulsoup4-4.5.1-py2-none-any.whl (83kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r requirements.txt (line 6))  Downloading requests-2.12.1-py2.py3-none-any.whl (574kB)  Installing collected packages: dumptruck, requests, scraperwiki, lxml, cssselect, beautifulsoup4  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Successfully installed beautifulsoup4-4.5.1 cssselect-0.9.1 dumptruck-0.1.6 lxml-3.4.4 requests-2.12.1 scraperwiki   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 44, in <module> scraperwiki.sqlite.execute("DELETE * FROM data"); File "/app/.heroku/src/scraperwiki/scraperwiki/sqlite.py", line 19, in execute result = dt.execute(sqlquery, data, commit=False) File "/app/.heroku/python/lib/python2.7/site-packages/dumptruck/dumptruck.py", line 136, in execute self.cursor.execute(sql, *args) sqlite3.OperationalError: near "*": syntax error

Data

Downloaded 3 times by jonasmerlin

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (10.4 MB) Use the API

rows 10 / 57284

tag zeiten stadt film kino typ
2016-10-15
14:00,17:00,20:15,23:10
Berlin
Inferno (OV)
CineStar Berlin - Original.
2016-10-15
14:00,15:00,17:40,20:30,23:10
Berlin
Findet Dorie (OV)
CineStar Berlin - Original.
2016-10-15
13:50,16:45,19:50,23:15
Berlin
Die Insel der besonderen Kinder (OV)
CineStar Berlin - Original.
2016-10-15
14:10,16:30,19:30,23:00
Berlin
Snowden (OV)
CineStar Berlin - Original.
2016-10-15
17:15,20:20
Berlin
Sausage Party - Es geht um die Wurst (OV)
CineStar Berlin - Original.
2016-10-15
20:00,22:30
Berlin
Swiss Army Man (OV)
CineStar Berlin - Original.
2016-10-15
16:30,19:30
Berlin
American Honey (OV)
CineStar Berlin - Original.
2016-10-15
22:30
Berlin
War Dogs (OV)
CineStar Berlin - Original.
2016-10-15
14:00,17:10,19:40
Berlin
Bad Moms (OV)
CineStar Berlin - Original.
2016-10-15
22:45
Berlin
Die glorreichen Sieben (OV)
CineStar Berlin - Original.

Statistics

Average successful run time: about 1 hour

Total run time: 1 day

Total cpu time used: about 2 hours

Total disk space used: 10.5 MB

History

  • Auto ran revision 24172b17 and failed .
    nothing changed in the database
  • Auto ran revision 24172b17 and failed .
    nothing changed in the database
  • Auto ran revision 24172b17 and failed .
    nothing changed in the database
  • Auto ran revision 24172b17 and failed .
    nothing changed in the database
  • Auto ran revision 24172b17 and failed .
    nothing changed in the database
  • Auto ran revision 24172b17 and failed .
    nothing changed in the database
  • Auto ran revision 24172b17 and failed .
    nothing changed in the database
  • Auto ran revision 24172b17 and failed .
    nothing changed in the database
  • Auto ran revision 24172b17 and failed .
    nothing changed in the database
  • Manually ran revision 24172b17 and failed .
    nothing changed in the database
  • Manually ran revision c9bd2d29 and failed .
    nothing changed in the database
  • Auto ran and failed .
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
    5528 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
    5528 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
    5528 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
    5528 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
    5528 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    1894 records added, 688 records removed in the database
    5151 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    840 records added, 484 records removed in the database
  • Auto ran revision d1256003 and completed successfully .
    9327 records added, 6822 records removed in the database
    2762 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    9094 records added, 3809 records removed in the database
    2769 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    7116 records added, 6826 records removed in the database
    2762 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    10515 records added, 8329 records removed in the database
    2762 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    10635 records added, 8402 records removed in the database
  • Auto ran revision d1256003 and completed successfully .
    10857 records added, 7397 records removed in the database
  • Auto ran revision d1256003 and completed successfully .
    10273 records added, 6994 records removed in the database
  • Auto ran revision d1256003 and completed successfully .
    9242 records added, 4938 records removed in the database
    2763 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    8232 records added, 4282 records removed in the database
    2760 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    7971 records added in the database
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
    2764 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
  • Auto ran revision d1256003 and completed successfully .
    nothing changed in the database
    2764 pages scraped
  • Auto ran revision d1256003 and completed successfully .
    8709 records added, 4521 records removed in the database
  • Auto ran revision d1256003 and completed successfully .
    7582 records added, 7417 records removed in the database
    2764 pages scraped
  • Manually ran revision d1256003 and completed successfully .
    10556 records added, 5350 records updated in the database
    2764 pages scraped
  • Manually ran revision 5d3c7011 and completed successfully .
    5350 records added in the database
    2764 pages scraped
  • Manually ran revision 1ad8b96d and completed successfully .
    119 records added, 73 records removed in the database
    12 pages scraped
  • Manually ran revision de9cd1b7 and failed .
    73 records added, 73 records removed in the database
    8 pages scraped
  • Manually ran revision de9cd1b7 and failed .
    73 records added in the database
    8 pages scraped
  • Manually ran revision 81ba044d and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

german_ov_from_google / scraper.py