loleg / kanton-basel-stadt-pdf-publikationen

README.md

Publications (in German) from the City of Basel, Switzerland, since 2000

https://morph.io/loleg/kanton-basel-stadt-pdf-publikationen

This is a scraper that runs on Morph. To get started see the documentation

Based on scraper code by metaodi.

Contributors loleg

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.13, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.13 -----> Installing pip -----> Installing requirements with pip  DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support  Collecting beautifulsoup4>=4.6.0  Downloading https://files.pythonhosted.org/packages/f9/d9/183705a87492249b212d88eef740995f55076195bcf45ed59306c146e42d/beautifulsoup4-4.8.1-py2-none-any.whl (102kB)  Collecting requests>=2.18.4  Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB)  Collecting dateparser>=0.6.0  Downloading https://files.pythonhosted.org/packages/82/9d/51126ac615bbc4418478d725a5fa1a0f112059f6f111e4b48cfbe17ef9d0/dateparser-0.7.2-py2.py3-none-any.whl (352kB)  Collecting soupsieve>=1.2  Downloading https://files.pythonhosted.org/packages/81/94/03c0f04471fc245d08d0a99f7946ac228ca98da4fa75796c507f61e688c2/soupsieve-1.9.5-py2.py3-none-any.whl  Collecting certifi>=2017.4.17  Downloading https://files.pythonhosted.org/packages/b9/63/df50cac98ea0d5b006c55a399c3bf1db9da7b5a24de7890bc9cfd5dd9e99/certifi-2019.11.28-py2.py3-none-any.whl (156kB)  Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1  Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB)  Collecting idna<2.9,>=2.5  Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)  Collecting chardet<3.1.0,>=3.0.2  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting tzlocal  Downloading https://files.pythonhosted.org/packages/ef/99/53bd1ac9349262f59c1c421d8fcc2559ae8a5eeffed9202684756b648d33/tzlocal-2.0.0-py2.py3-none-any.whl  Collecting pytz  Downloading https://files.pythonhosted.org/packages/e7/f9/f0b53f88060247251bf481fa6ea62cd0d25bf1b11a87888e53ce5b7c8ad2/pytz-2019.3-py2.py3-none-any.whl (509kB)  Collecting regex  Downloading https://files.pythonhosted.org/packages/fc/1d/13cc7d174cd2d05808abac3f5fb37433e30c4cd93b152d2a9c09c926d7e8/regex-2019.11.1.tar.gz (669kB)  Collecting python-dateutil  Downloading https://files.pythonhosted.org/packages/d4/70/d60450c3dd48ef87586924207ae8907090de0b306af2bce5d134d78615cb/python_dateutil-2.8.1-py2.py3-none-any.whl (227kB)  Collecting backports.functools-lru-cache; python_version < "3"  Downloading https://files.pythonhosted.org/packages/da/d1/080d2bb13773803648281a49e3918f65b31b7beebf009887a529357fd44a/backports.functools_lru_cache-1.6.1-py2.py3-none-any.whl  Collecting six>=1.5  Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl  Building wheels for collected packages: regex  Building wheel for regex (setup.py): started  Building wheel for regex (setup.py): finished with status 'done'  Created wheel for regex: filename=regex-2019.11.1-cp27-cp27mu-linux_x86_64.whl size=627261 sha256=a435f3973647711870607bcdd1c45aca3d7ad807289668062bac185939e9de2d  Stored in directory: /tmp/pip-ephem-wheel-cache-VHyWhf/wheels/5c/c6/c1/0bc8d16ea38c44536a82dd1bec665996e5af37489fa88826b6  Successfully built regex  Installing collected packages: backports.functools-lru-cache, soupsieve, beautifulsoup4, certifi, urllib3, idna, chardet, requests, pytz, tzlocal, regex, six, python-dateutil, dateparser  Successfully installed backports.functools-lru-cache-1.6.1 beautifulsoup4-4.8.1 certifi-2019.11.28 chardet-3.0.4 dateparser-0.7.2 idna-2.8 python-dateutil-2.8.1 pytz-2019.3 regex-2019.11.1 requests-2.22.0 six-1.13.0 soupsieve-1.9.5 tzlocal-2.0.0 urllib3-1.25.7 DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support    -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Collecting page 0 Collecting page 1 Collecting page 2 Collecting page 3

Data

Downloaded 525 times by loleg sabinsc

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.76 MB) Use the API

rows 10 / 2755

title subtitle image link
Der Kindergarten Basel-Stadt
Informationsbroschüre
http://www.bs.ch/.imaging/stk/webbs-desktop/publication-small/dam/ed/download/publikationen/Bild-Der-Kindergarten-BS.jpg/jcr:content/Bild%20Der%20Kindergarten%20BS.jpg.jpg
http://www.bs.ch/publikationen/ed/der-kindergarten-basel-stadt.html?currentOffset=0&searchPageUuid=04ffaf82-e415-4132-b15a-f2789a1f53ff
Die Primarschule Basel-Stadt
Informationsbroschüre
http://www.bs.ch/.imaging/stk/webbs-desktop/publication-small/dam/ed/download/publikationen/Bild-die-Primarschule.jpg/jcr:content/Bild%20die%20Primarschule.jpg.jpg
http://www.bs.ch/publikationen/ed/die-primarschule-basel-stadt.html?currentOffset=1&searchPageUuid=04ffaf82-e415-4132-b15a-f2789a1f53ff
Frühe Deutschförderung
Frühe Deutschförderung
http://www.bs.ch/.imaging/stk/webbs-desktop/publication-small/dam/ed/download/publikationen/Bild-Broschuere-Fruehe-Deutschfoerderung.jpg/jcr:content/Bild%20Broschuere%20Fruehe%20Deutschfoerderung.jpg.jpg
http://www.bs.ch/publikationen/ed/fruehe_deutschfoerderung.html?currentOffset=2&searchPageUuid=04ffaf82-e415-4132-b15a-f2789a1f53ff
Der Kindergarten Basel-Stadt
Informationsbroschüre
http://www.bs.ch/.imaging/stk/webbs-desktop/publication-small/dam/ed/download/publikationen/Bild-Der-Kindergarten-BS.jpg/jcr:content/Bild%20Der%20Kindergarten%20BS.jpg.jpg
http://www.bs.ch/publikationen/volksschulen/der-kindergarten-basel-stadt.html?currentOffset=3&searchPageUuid=04ffaf82-e415-4132-b15a-f2789a1f53ff
Die Primarschule Basel-Stadt
Informationsbroschüre
http://www.bs.ch/.imaging/stk/webbs-desktop/publication-small/dam/ed/download/publikationen/Bild-die-Primarschule.jpg/jcr:content/Bild%20die%20Primarschule.jpg.jpg
http://www.bs.ch/publikationen/volksschulen/die-primarschule-basel-stadt.html?currentOffset=4&searchPageUuid=04ffaf82-e415-4132-b15a-f2789a1f53ff
Frühe Deutschförderung
Frühe Deutschförderung
http://www.bs.ch/.imaging/stk/webbs-desktop/publication-small/dam/ed/download/publikationen/Bild-Broschuere-Fruehe-Deutschfoerderung.jpg/jcr:content/Bild%20Broschuere%20Fruehe%20Deutschfoerderung.jpg.jpg
http://www.bs.ch/publikationen/volksschulen/fruehe_deutschfoerderung0.html?currentOffset=5&searchPageUuid=04ffaf82-e415-4132-b15a-f2789a1f53ff
Die Sekundarschule Basel-Stadt
Alle wichtigen Themen und Angebote der Sekundarschule im Überblick
http://www.bs.ch/.imaging/stk/webbs-desktop/publication-small/dam/volksschulen/download/publikationen/Titelseite_ED-Flyer_SEK.jpg/jcr:content/Titelseite_ED%20Flyer_SEK.jpg.jpg
http://www.bs.ch/publikationen/volksschulen/sekundarschule-basel-stadt.html?currentOffset=6&searchPageUuid=04ffaf82-e415-4132-b15a-f2789a1f53ff
NEUAUFLAGE: ausgesucht.bs „Sucht am Arbeitsplatz - Work-Life aus der Balance"
Information und Unterstützung für Führungsverantwortliche über Suchtprobleme am Arbeitsplatz
http://www.bs.ch/.imaging/stk/webbs-desktop/publication-small/dam/bs/Bilder/publikationen/sucht/ausgesucht-sucht-am-arbeitsplatz/Sucht_am_Arbeitsplatz/jcr:content/2019-11-01%2014_07_37-ausgesucht_SuchtArbeitsplatz.pdf%20-%20Adobe%C2%A0Acrobat%C2%A0Reader%C2%A0DC.jpg.jpg
http://www.bs.ch/publikationen/abteilungsucht/ausgesucht-sucht-am-arbeitsplatz.html?currentOffset=7&searchPageUuid=04ffaf82-e415-4132-b15a-f2789a1f53ff
Jahresbericht des Appellationsgerichts
Jahresbericht 2018 des Appellationsgerichts Basel-Stadt
http://www.bs.ch/.imaging/stk/webbs-desktop/publication-small/dam/appellationsgericht/download/Bilder/Deckblatt-Jahresbericht-AG-2018.png/jcr:content/Deckblatt%20Jahresbericht%20AG%202018.png.png
http://www.bs.ch/publikationen/appellationsgericht/jahresbericht-des-appellationsgerichts-2019.html?currentOffset=8&searchPageUuid=04ffaf82-e415-4132-b15a-f2789a1f53ff
Archäologie live 2019
Veranstaltungsprogramm der Archäologischen Bodenforschung
http://www.bs.ch/.imaging/stk/webbs-desktop/publication-small/dam/archaeologie/bilder/vermittlung/veranstaltungen/veranstaltungen-2019/T07935.jpg/jcr:content/T07935.jpg.jpg
http://www.bs.ch/publikationen/archeologie/archaeologie-live-2019.html?currentOffset=9&searchPageUuid=04ffaf82-e415-4132-b15a-f2789a1f53ff

Statistics

Average successful run time: 2 minutes

Total run time: about 20 hours

Total cpu time used: about 5 hours

Total disk space used: 1.79 MB

History

  • Auto ran revision 87ebb2f5 and completed successfully .
    1755 records added in the database
  • Auto ran revision 87ebb2f5 and failed .
    1755 records removed in the database
  • Auto ran revision 87ebb2f5 and completed successfully .
    nothing changed in the database
  • Auto ran revision 87ebb2f5 and completed successfully .
    2755 records added in the database
  • Auto ran revision 87ebb2f5 and failed .
    2740 records removed in the database
  • ...
  • Created on morph.io

Show complete history