lhm / allris-scraper

Scraper for allris


Contributors lhm

Last run failed with status code 2.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.6.2 -----> Installing pip -----> Installing requirements with pip  Collecting asn1crypto==1.1.0  Downloading asn1crypto-1.1.0-py2.py3-none-any.whl (103 kB)  Collecting attrs==19.2.0  Downloading attrs-19.2.0-py2.py3-none-any.whl (40 kB)  Collecting Automat==0.7.0  Downloading Automat-0.7.0-py2.py3-none-any.whl (37 kB)  Collecting cffi==1.12.3  Downloading cffi-1.12.3-cp36-cp36m-manylinux1_x86_64.whl (430 kB)  Collecting constantly==15.1.0  Downloading constantly-15.1.0-py2.py3-none-any.whl (7.9 kB)  Collecting cryptography==2.7  Downloading cryptography-2.7-cp34-abi3-manylinux1_x86_64.whl (2.3 MB)  Collecting cssselect==1.1.0  Downloading cssselect-1.1.0-py2.py3-none-any.whl (16 kB)  Collecting furl==2.1.0  Downloading furl-2.1.0-py2.py3-none-any.whl (20 kB)  Collecting hyperlink==19.0.0  Downloading hyperlink-19.0.0-py2.py3-none-any.whl (38 kB)  Collecting idna==2.8  Downloading idna-2.8-py2.py3-none-any.whl (58 kB)  Collecting incremental==17.5.0  Downloading incremental-17.5.0-py2.py3-none-any.whl (16 kB)  Collecting lxml==4.4.1  Downloading lxml-4.4.1-cp36-cp36m-manylinux1_x86_64.whl (5.8 MB)  Collecting parsel==1.5.2  Downloading parsel-1.5.2-py2.py3-none-any.whl (12 kB)  Collecting pyasn1==0.4.7  Downloading pyasn1-0.4.7-py2.py3-none-any.whl (76 kB)  Collecting pyasn1-modules==0.2.7  Downloading pyasn1_modules-0.2.7-py2.py3-none-any.whl (131 kB)  Collecting pycparser==2.19  Downloading pycparser-2.19.tar.gz (158 kB)  Preparing metadata (setup.py): started  Preparing metadata (setup.py): finished with status 'done'  Collecting PyDispatcher==2.0.5  Downloading PyDispatcher-2.0.5.zip (47 kB)  Preparing metadata (setup.py): started  Preparing metadata (setup.py): finished with status 'done'  Collecting PyHamcrest==1.9.0  Downloading PyHamcrest-1.9.0-py2.py3-none-any.whl (52 kB)  Collecting pyOpenSSL==19.0.0  Downloading pyOpenSSL-19.0.0-py2.py3-none-any.whl (53 kB)  Collecting queuelib==1.5.0  Downloading queuelib-1.5.0-py2.py3-none-any.whl (13 kB)  Collecting Scrapy==1.7.3  Downloading Scrapy-1.7.3-py2.py3-none-any.whl (234 kB)  Collecting scraperwiki==0.5.1  Downloading scraperwiki-0.5.1.tar.gz (7.7 kB)  Preparing metadata (setup.py): started  Preparing metadata (setup.py): finished with status 'done'  Collecting service-identity==18.1.0  Downloading service_identity-18.1.0-py2.py3-none-any.whl (11 kB)  Collecting six==1.12.0  Downloading six-1.12.0-py2.py3-none-any.whl (10 kB)  Collecting Twisted==19.7.0  Downloading Twisted-19.7.0-cp36-cp36m-manylinux1_x86_64.whl (3.1 MB)  Collecting w3lib==1.21.0  Downloading w3lib-1.21.0-py2.py3-none-any.whl (20 kB)  Collecting zope.interface==4.6.0  Downloading zope.interface-4.6.0-cp36-cp36m-manylinux1_x86_64.whl (167 kB)  Collecting orderedmultidict>=1.0.1  Downloading orderedmultidict-1.0.1-py2.py3-none-any.whl (11 kB)  Collecting requests  Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB)  Collecting sqlalchemy  Downloading SQLAlchemy-1.4.36-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)  Collecting alembic  Downloading alembic-1.7.7-py3-none-any.whl (210 kB)  Collecting importlib-resources  Downloading importlib_resources-5.4.0-py3-none-any.whl (28 kB)  Collecting Mako  Downloading Mako-1.1.6-py2.py3-none-any.whl (75 kB)  Collecting importlib-metadata  Downloading importlib_metadata-4.8.3-py3-none-any.whl (17 kB)  Collecting greenlet!=0.4.17  Downloading greenlet-1.1.2-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147 kB)  Collecting certifi>=2017.4.17  Downloading certifi-2022.5.18.1-py3-none-any.whl (155 kB)  Collecting urllib3<1.27,>=1.21.1  Downloading urllib3-1.26.9-py2.py3-none-any.whl (138 kB)  Collecting charset-normalizer~=2.0.0  Downloading charset_normalizer-2.0.12-py3-none-any.whl (39 kB)  Collecting typing-extensions>=3.6.4  Downloading typing_extensions-4.1.1-py3-none-any.whl (26 kB)  Collecting zipp>=0.5  Downloading zipp-3.6.0-py3-none-any.whl (5.3 kB)  Collecting MarkupSafe>=0.9.2  Downloading MarkupSafe-2.0.1-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (30 kB)  Building wheels for collected packages: pycparser, PyDispatcher, scraperwiki  Building wheel for pycparser (setup.py): started  Building wheel for pycparser (setup.py): finished with status 'done'  Created wheel for pycparser: filename=pycparser-2.19-py2.py3-none-any.whl size=111051 sha256=04e454a667b7585764837624bfbd86555362074ebdc1e1eda53d1eae6b7f1f0a  Stored in directory: /tmp/pip-ephem-wheel-cache-w9_pjbid/wheels/c6/6b/83/2608afaa57ecfb0a66ac89191a8d9bad71c62ca55ee499c2d0  Building wheel for PyDispatcher (setup.py): started  Building wheel for PyDispatcher (setup.py): finished with status 'done'  Created wheel for PyDispatcher: filename=PyDispatcher-2.0.5-py3-none-any.whl size=11516 sha256=83d8fdfec3ac692fe1b96cf240c78e17e1e1d003e08d3556f23ca847faee040b  Stored in directory: /tmp/pip-ephem-wheel-cache-w9_pjbid/wheels/69/20/28/fbdcea83fadaf56e6e3ed24df2a1b409a8d950d3cce69bbfce  Building wheel for scraperwiki (setup.py): started  Building wheel for scraperwiki (setup.py): finished with status 'done'  Created wheel for scraperwiki: filename=scraperwiki-0.5.1-py3-none-any.whl size=6545 sha256=f74ca5dc9ce9705bce276f596ecf16d77d6ef868ce420d09143dad25355a1927  Stored in directory: /tmp/pip-ephem-wheel-cache-w9_pjbid/wheels/cd/f8/ac/cd66eb1c557ab40d35c1ed852da3e9b37baa3e21b61906a5cf  Successfully built pycparser PyDispatcher scraperwiki  Installing collected packages: zipp, typing-extensions, pycparser, six, pyasn1, MarkupSafe, importlib-metadata, idna, greenlet, cffi, attrs, asn1crypto, zope.interface, w3lib, urllib3, sqlalchemy, PyHamcrest, pyasn1-modules, Mako, lxml, incremental, importlib-resources, hyperlink, cssselect, cryptography, constantly, charset-normalizer, certifi, Automat, Twisted, service-identity, requests, queuelib, pyOpenSSL, PyDispatcher, parsel, orderedmultidict, alembic, Scrapy, scraperwiki, furl  Successfully installed Automat-0.7.0 Mako-1.1.6 MarkupSafe-2.0.1 PyDispatcher-2.0.5 PyHamcrest-1.9.0 Scrapy-1.7.3 Twisted-19.7.0 alembic-1.7.7 asn1crypto-1.1.0 attrs-19.2.0 certifi-2022.5.18.1 cffi-1.12.3 charset-normalizer-2.0.12 constantly-15.1.0 cryptography-2.7 cssselect-1.1.0 furl-2.1.0 greenlet-1.1.2 hyperlink-19.0.0 idna-2.8 importlib-metadata-4.8.3 importlib-resources-5.4.0 incremental-17.5.0 lxml-4.4.1 orderedmultidict-1.0.1 parsel-1.5.2 pyOpenSSL-19.0.0 pyasn1-0.4.7 pyasn1-modules-0.2.7 pycparser-2.19 queuelib-1.5.0 requests-2.27.1 scraperwiki-0.5.1 service-identity-18.1.0 six-1.12.0 sqlalchemy-1.4.36 typing-extensions-4.1.1 urllib3-1.26.9 w3lib-1.21.0 zipp-3.6.0 zope.interface-4.6.0   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... python: can't open file 'scraper.py': [Errno 2] No such file or directory

Data

Downloaded 2 times by lhm

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (19 KB) Use the API

rows 10 / 48

id name start end web
OR Plaußig
2019-09-30T19:00:00+02:00
2019-09-30T19:00:00+02:00
N/Ato010.asp?SILFDNR=1005357
OR Plaußig
2019-10-28T19:00:00+01:00
2019-10-28T19:00:00+01:00
N/Ato010.asp?SILFDNR=1005358
OR Plaußig
2019-11-25T19:00:00+01:00
2019-11-25T20:15:00+01:00
N/Ato010.asp?SILFDNR=1005359
OR Plaußig
2019-12-16T19:00:00+01:00
2019-12-16T19:00:00+01:00
N/Ato010.asp?SILFDNR=1005360
AUSFALL SBB Nord (vertagt auf 10.01.2019)
2018-12-13T17:30:00+01:00
2018-12-13T17:30:00+01:00
N/Ato010.asp?SILFDNR=1005364
SBB Südwest
2018-12-10T18:30:00+01:00
2018-12-10T19:30:00+01:00
N/Ato010.asp?SILFDNR=1005373
BA Stadtreinigung
2019-01-10T15:30:00+01:00
2019-01-10T16:20:00+01:00
N/Ato010.asp?SILFDNR=1005382
OR Miltitz
2019-01-23T18:00:00+01:00
2019-01-23T20:00:00+01:00
N/Ato010.asp?SILFDNR=1005406
Beirat ´Kuratorium Tag der Friedlichen Revolution 1989´
2019-01-18T17:00:00+01:00
2019-01-18T18:40:00+01:00
N/Ato010.asp?SILFDNR=1005448
Beirat ´Kuratorium Tag der Friedlichen Revolution 1989´
2019-02-04T17:00:00+01:00
2019-02-04T19:00:00+01:00
N/Ato010.asp?SILFDNR=1005449

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (19 KB) Use the API

rows 1 / 1

Statistics

Average successful run time: 1 minute

Total run time: about 19 hours

Total cpu time used: 4 minutes

Total disk space used: 127 KB

History

  • Auto ran revision ab9e3c6e and failed .
    nothing changed in the database
  • Auto ran revision ab9e3c6e and failed .
    nothing changed in the database
  • Auto ran revision ab9e3c6e and failed .
    nothing changed in the database
  • Auto ran revision ab9e3c6e and failed .
    nothing changed in the database
  • Auto ran revision ab9e3c6e and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

allris-scraper / scraper.py