soit-sk / slovakia_post_codes

Scraper for slovak mail service post codes.


This is a scraper that runs on Morph. To get started see the documentation

This scraper mines streets, towns and their post codes from the Slovak mail service.

Contributors mnagy hanecak j91321 katkad

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.12, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.12 -----> Installing pip -----> Installing requirements with pip  DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 2))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki  Running command git clone -q http://github.com/openaustralia/scraperwiki-python.git /app/.heroku/src/scraperwiki  Running command git checkout -b morph_defaults --track origin/morph_defaults  Switched to a new branch 'morph_defaults'  Branch morph_defaults set up to track remote branch morph_defaults from origin.  Collecting xlrd==0.9.2 (from -r /tmp/build/requirements.txt (line 3))  Downloading https://files.pythonhosted.org/packages/31/69/cc9aa897cf25e8ace34e36144d95cfbe4ce0837b41b1ed980b77997f5b95/xlrd-0.9.2.tar.gz (167kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 2))  Downloading https://files.pythonhosted.org/packages/15/27/3330a343de80d6849545b6c7723f8c9a08b4b104de964ac366e7e6b318df/dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 2))  Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 2))  Downloading https://files.pythonhosted.org/packages/69/1b/b853c7a9d4f6a6d00749e94eb6f3a041e342a885b87340b79c1ef73e3a78/certifi-2019.6.16-py2.py3-none-any.whl (157kB)  Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 2))  Downloading https://files.pythonhosted.org/packages/e6/60/247f23a7121ae632d62811ba7f273d0e58972d75e58a94d329d51550a47d/urllib3-1.25.3-py2.py3-none-any.whl (150kB)  Collecting idna<2.9,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 2))  Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 2))  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Building wheels for collected packages: xlrd, dumptruck  Building wheel for xlrd (setup.py): started  Building wheel for xlrd (setup.py): finished with status 'done'  Created wheel for xlrd: filename=xlrd-0.9.2-cp27-none-any.whl size=141918 sha256=91cfca2d478040137b7bd6cb2bd450fb62aa2c55bbf3170c3677cae9656e7188  Stored in directory: /tmp/pip-ephem-wheel-cache-4rPxgM/wheels/89/1f/45/68221392b9b00c16a5e2b494a8e13f70cac1902dce5113267a  Building wheel for dumptruck (setup.py): started  Building wheel for dumptruck (setup.py): finished with status 'done'  Created wheel for dumptruck: filename=dumptruck-0.1.6-cp27-none-any.whl size=11845 sha256=e1e27680dd68864fe2028e5a1005477c3df632c938f9fae0e3ba84fa7f678d5b  Stored in directory: /tmp/pip-ephem-wheel-cache-4rPxgM/wheels/57/df/83/32654ae89119876c7a7db66829bbdb646caa151589dbaf226e  Successfully built xlrd dumptruck  Installing collected packages: dumptruck, certifi, urllib3, idna, chardet, requests, scraperwiki, xlrd  Running setup.py develop for scraperwiki  Successfully installed certifi-2019.6.16 chardet-3.0.4 dumptruck-0.1.6 idna-2.8 requests-2.22.0 scraperwiki urllib3-1.25.3 xlrd-0.9.2 DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support    -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 17 times by pato1 lubosvanta usamec melezhik

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (864 KB) Use the API

rows 10 / 3962

okres kraj psc obec
Košice III
KI
Dargovských Hrdinov
Košice IV
KI
Nad Jazerom
Liptovský Mikuláš
ZI
031 01
Andice
Žilina
ZI
010 04
Bánová
Liptovský Mikuláš
ZI
031 01
Beňušovce
Ružomberok
ZI
034 03
Biely Potok
Liptovský Mikuláš
ZI
031 01
Bodice
Komárno
NI
947 03
Bohatá
Žilina
ZI
010 14
Brodno
Žilina
ZI
010 03
Budatín

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (864 KB) Use the API

rows 10 / 6647

psc ulica obec
040 01
Bankov - baňa
Košice
040 01
Čermeľská
Košice
040 01
Dominikánske nám.
Košice
040 01
Festivalové nám.
Košice
040 01
Hájnícká
Košice
040 01
Heringeš
Košice
040 01
Horný Bankov
Košice
040 01
Južné nábr.
Košice
040 01
Kasárenské nám.
Košice
040 01
Kavečany
Košice

Statistics

Average successful run time: 1 minute

Total run time: 3 days

Total cpu time used: about 7 hours

Total disk space used: 890 KB

History

  • Auto ran revision e1d2e8a7 and completed successfully .
    9670 records added, 9670 records removed in the database
  • Auto ran revision e1d2e8a7 and completed successfully .
    9670 records added, 9670 records removed in the database
  • Auto ran revision e1d2e8a7 and completed successfully .
    9670 records added, 9670 records removed in the database
  • Auto ran revision e1d2e8a7 and completed successfully .
    9670 records added, 9670 records removed in the database
  • Auto ran revision e1d2e8a7 and completed successfully .
    9670 records added, 9670 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

slovakia_post_codes / scraper.py