This is a scraper that runs on Morph. To get started see the documentation

Contributors andylolz

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 3 is python-3.6.2 (you are using python-3.4.3, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-3.6.2).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-3.4.3 -----> Installing pip -----> Installing requirements with pip  DEPRECATION: Python 3.4 support has been deprecated. pip 19.1 will be the last one supporting it. Please upgrade your Python as Python 3.4 won't be maintained after March 2019 (cf PEP 429).  Collecting scraperwiki==0.5.1 (from -r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/30/84/d874847baad89f03e6984fcd87505a37bf924b66519d1e07bf76e2369af0/scraperwiki-0.5.1.tar.gz  Collecting beautifulsoup4==4.5.3 (from -r /tmp/build/requirements.txt (line 2))  Downloading https://files.pythonhosted.org/packages/af/a3/9e803f838b3eeb313d45d916d4387cda8572c92e1aafeb53fd43ddb5da2c/beautifulsoup4-4.5.3-py3-none-any.whl (85kB)  Collecting requests==2.20.0 (from -r /tmp/build/requirements.txt (line 3))  Downloading https://files.pythonhosted.org/packages/f1/ca/10332a30cb25b627192b4ea272c351bce3ca1091e541245cccbace6051d8/requests-2.20.0-py2.py3-none-any.whl (60kB)  Collecting six (from scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl  Collecting sqlalchemy (from scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/55/98/56b7155bab287cd0c78dee26258835db36e91f2efef41f125ed6f6f1f334/SQLAlchemy-1.3.6.tar.gz (5.9MB)  Collecting alembic (from scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/7b/8b/0c98c378d93165d9809193f274c3c6e2151120d955b752419c7d43e4d857/alembic-1.0.11.tar.gz (1.0MB)  Collecting chardet<3.1.0,>=3.0.2 (from requests==2.20.0->-r /tmp/build/requirements.txt (line 3))  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting urllib3<1.25,>=1.21.1 (from requests==2.20.0->-r /tmp/build/requirements.txt (line 3))  Downloading https://files.pythonhosted.org/packages/01/11/525b02e4acc0c747de8b6ccdab376331597c569c42ea66ab0a1dbd36eca2/urllib3-1.24.3-py2.py3-none-any.whl (118kB)  Collecting certifi>=2017.4.17 (from requests==2.20.0->-r /tmp/build/requirements.txt (line 3))  Downloading https://files.pythonhosted.org/packages/69/1b/b853c7a9d4f6a6d00749e94eb6f3a041e342a885b87340b79c1ef73e3a78/certifi-2019.6.16-py2.py3-none-any.whl (157kB)  Collecting idna<2.8,>=2.5 (from requests==2.20.0->-r /tmp/build/requirements.txt (line 3))  Downloading https://files.pythonhosted.org/packages/4b/2a/0276479a4b3caeb8a8c1af2f8e4355746a97fab05a372e4a2c6a6b876165/idna-2.7-py2.py3-none-any.whl (58kB)  Collecting Mako (from alembic->scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/1b/a5/023aba3d69aacef6bfc13797bdc3dd03c6fb4ae2dcd2fde7dffc37233924/Mako-1.0.14.tar.gz (462kB)  Collecting python-editor>=0.3 (from alembic->scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/c6/d3/201fc3abe391bbae6606e6f1d598c15d367033332bd54352b12f35513717/python_editor-1.0.4-py3-none-any.whl  Collecting python-dateutil (from alembic->scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB)  Collecting MarkupSafe>=0.9.2 (from Mako->alembic->scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/99/c9/5d5dcf2aa90f1d4500e92467a04f63b3708ee6e5764b40b2445e767ab8dc/MarkupSafe-1.1.1-cp34-cp34m-manylinux1_x86_64.whl  Building wheels for collected packages: scraperwiki, sqlalchemy, alembic, Mako  Building wheel for scraperwiki (setup.py): started  Building wheel for scraperwiki (setup.py): finished with status 'done'  Stored in directory: /tmp/pip-ephem-wheel-cache-218iliju/wheels/6a/6e/60/e13b585339206922e816bb90c355b79aa077ab2b15d7cc26a7  Building wheel for sqlalchemy (setup.py): started  Building wheel for sqlalchemy (setup.py): finished with status 'done'  Stored in directory: /tmp/pip-ephem-wheel-cache-218iliju/wheels/f2/ec/e0/d7deb0c981557e373edf7370574b7001690892afe5fea30c3c  Building wheel for alembic (setup.py): started  Building wheel for alembic (setup.py): finished with status 'done'  Stored in directory: /tmp/pip-ephem-wheel-cache-218iliju/wheels/8b/65/b2/9837b4422d13e739c3324c428f1b3aa9e3c3df666bb420e4b3  Building wheel for Mako (setup.py): started  Building wheel for Mako (setup.py): finished with status 'done'  Stored in directory: /tmp/pip-ephem-wheel-cache-218iliju/wheels/36/0e/1d/4b28d9bc3f835432132648d6d1d038a7b3d9dbfd7df453e0f1  Successfully built scraperwiki sqlalchemy alembic Mako  Installing collected packages: chardet, urllib3, certifi, idna, requests, six, sqlalchemy, MarkupSafe, Mako, python-editor, python-dateutil, alembic, scraperwiki, beautifulsoup4  Successfully installed Mako-1.0.14 MarkupSafe-1.1.1 alembic-1.0.11 beautifulsoup4-4.5.3 certifi-2019.6.16 chardet-3.0.4 idna-2.7 python-dateutil-2.8.0 python-editor-1.0.4 requests-2.20.0 scraperwiki-0.5.1 six-1.12.0 sqlalchemy-1.3.6 urllib3-1.24.3 DEPRECATION: Python 3.4 support has been deprecated. pip 19.1 will be the last one supporting it. Please upgrade your Python as Python 3.4 won't be maintained after March 2019 (cf PEP 429).  DEPRECATION: Python 3.4 support has been deprecated. pip 19.1 will be the last one supporting it. Please upgrade your Python as Python 3.4 won't be maintained after March 2019 (cf PEP 429).   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (33 KB) Use the API

rows 9 / 9

name code
Administrative Regions
A
Hydrographic
H
Areas/Localities
L
Populated Places
P
Transportation Networks
R
Spot Features
S
Hypsographic
T
Undersea
U
Vegetation
V

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (33 KB) Use the API

rows 10 / 632

category name code
A
first-order administrative division
ADM1
A
historical first-order administrative division
ADM1H
A
second-order administrative division
ADM2
A
third-order administrative division
ADM3
A
fourth-order administrative division
ADM4
A
administrative division
ADMD
A
school district
ADMS
A
leased area
LTER
A
political entity
PCL
A
dependent political entity
PCLD

Statistics

Average successful run time: less than a minute

Total run time: about 12 hours

Total cpu time used: 17 minutes

Total disk space used: 55.3 KB

History

  • Auto ran revision 8b5001ed and completed successfully .
    641 records added, 641 records removed in the database
  • Auto ran revision 8b5001ed and completed successfully .
    641 records added, 641 records removed in the database
  • Auto ran revision 8b5001ed and completed successfully .
    641 records added, 641 records removed in the database
  • Auto ran revision 8b5001ed and completed successfully .
    641 records added, 641 records removed in the database
  • Auto ran revision 8b5001ed and completed successfully .
    641 records added, 641 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

feature-designation-codes / scraper.py