opensanctions / kg-fiu-national

Kyrgyz Financial Intelligence Unit National List

Scrapes publicsuffix.org and fiu.gov.kg

Public Suffix List


Kyrgyz FIU National list

State Financial Intelligence Service under the Government of the Kyrgyz Republic

  • https://fiu.gov.kg/sked/1

License

The MIT License (MIT)

Copyright (c) 2015-2017 Friedrich Lindenberg

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Contributors krasch pudo

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.10, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.10 -----> Installing pip -----> Installing requirements with pip  Collecting git+https://github.com/opensanctions/libsanctions (from -r /tmp/build/requirements.txt (line 1))  Cloning https://github.com/opensanctions/libsanctions to /tmp/pip-B0LtA7-build  Collecting unicodecsv==0.14.1 (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading unicodecsv-0.14.1.tar.gz  Collecting normality>=0.4.2 (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading normality-0.5.11-py2.py3-none-any.whl  Collecting fingerprints>=0.4.0 (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading fingerprints-0.5.3-py2-none-any.whl  Collecting countrynames (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading countrynames-1.5-py2-none-any.whl (226kB)  Collecting jsonschema>=2.6.0 (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading jsonschema-2.6.0-py2.py3-none-any.whl  Collecting sqlalchemy>=1.1.0 (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading SQLAlchemy-1.2.4.tar.gz (5.6MB)  Collecting requests>=2.13 (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting morphium (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading morphium-0.2.0-py2-none-any.whl  Collecting dalet (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading dalet-1.3.0-py2-none-any.whl  Collecting lxml (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading lxml-4.1.1-cp27-cp27m-manylinux1_x86_64.whl (5.5MB)  Collecting xlrd (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading xlrd-1.1.0-py2.py3-none-any.whl (108kB)  Collecting six (from libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading six-1.11.0-py2.py3-none-any.whl  Collecting chardet (from normality>=0.4.2->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting banal (from normality>=0.4.2->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading banal-0.3.3-py2.py3-none-any.whl  Collecting pyyaml (from fingerprints>=0.4.0->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading PyYAML-3.12.tar.gz (253kB)  Collecting unidecode (from fingerprints>=0.4.0->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading Unidecode-1.0.22-py2.py3-none-any.whl (235kB)  Collecting pycountry (from countrynames->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading pycountry-18.2.23.tar.gz (9.7MB)  Collecting python-Levenshtein (from countrynames->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading python-Levenshtein-0.12.0.tar.gz (48kB)  Collecting functools32; python_version == "2.7" (from jsonschema>=2.6.0->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading functools32-3.2.3-2.zip  Collecting idna<2.7,>=2.5 (from requests>=2.13->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading idna-2.6-py2.py3-none-any.whl (56kB)  Collecting urllib3<1.23,>=1.21.1 (from requests>=2.13->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting certifi>=2017.4.17 (from requests>=2.13->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading certifi-2018.1.18-py2.py3-none-any.whl (151kB)  Collecting boto3 (from morphium->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading boto3-1.5.36-py2.py3-none-any.whl (128kB)  Collecting boto (from morphium->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading boto-2.48.0-py2.py3-none-any.whl (1.4MB)  Collecting phonenumbers>=8.8.4 (from dalet->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading phonenumbers-8.9.0-py2.py3-none-any.whl (3.0MB)  Collecting babel>=2.5.1 (from dalet->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading Babel-2.5.3-py2.py3-none-any.whl (6.8MB)  Collecting urltools>=0.3.2 (from dalet->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading urltools-0.3.2-py2.py3-none-any.whl  Collecting parsedatetime>=2.1 (from dalet->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading parsedatetime-2.4-py2-none-any.whl (40kB)  Collecting jmespath<1.0.0,>=0.7.1 (from boto3->morphium->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading jmespath-0.9.3-py2.py3-none-any.whl  Collecting botocore<1.9.0,>=1.8.50 (from boto3->morphium->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading botocore-1.8.50-py2.py3-none-any.whl (4.1MB)  Collecting s3transfer<0.2.0,>=0.1.10 (from boto3->morphium->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading s3transfer-0.1.13-py2.py3-none-any.whl (59kB)  Collecting pytz>=0a (from babel>=2.5.1->dalet->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading pytz-2018.3-py2.py3-none-any.whl (509kB)  Collecting future (from parsedatetime>=2.1->dalet->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading future-0.16.0.tar.gz (824kB)  Collecting docutils>=0.10 (from botocore<1.9.0,>=1.8.50->boto3->morphium->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading docutils-0.14-py2-none-any.whl (543kB)  Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.9.0,>=1.8.50->boto3->morphium->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading python_dateutil-2.6.1-py2.py3-none-any.whl (194kB)  Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" (from s3transfer<0.2.0,>=0.1.10->boto3->morphium->libsanctions==0.1.0->-r /tmp/build/requirements.txt (line 1))  Downloading futures-3.2.0-py2-none-any.whl  Installing collected packages: unicodecsv, chardet, six, banal, normality, pyyaml, unidecode, fingerprints, pycountry, python-Levenshtein, countrynames, functools32, jsonschema, sqlalchemy, idna, urllib3, certifi, requests, jmespath, docutils, python-dateutil, botocore, futures, s3transfer, boto3, boto, morphium, phonenumbers, pytz, babel, urltools, future, parsedatetime, dalet, lxml, xlrd, libsanctions  Running setup.py install for unicodecsv: started  Running setup.py install for unicodecsv: finished with status 'done'  Running setup.py install for pyyaml: started  Running setup.py install for pyyaml: finished with status 'done'  Running setup.py install for pycountry: started  Running setup.py install for pycountry: finished with status 'done'  Running setup.py install for python-Levenshtein: started  Running setup.py install for python-Levenshtein: finished with status 'done'  Running setup.py install for functools32: started  Running setup.py install for functools32: finished with status 'done'  Running setup.py install for sqlalchemy: started  Running setup.py install for sqlalchemy: finished with status 'done'  Running setup.py install for future: started  Running setup.py install for future: finished with status 'done'  Running setup.py install for libsanctions: started  Running setup.py install for libsanctions: finished with status 'done'  Successfully installed babel-2.5.3 banal-0.3.3 boto-2.48.0 boto3-1.5.36 botocore-1.8.50 certifi-2018.1.18 chardet-3.0.4 countrynames-1.5 dalet-1.3.0 docutils-0.14 fingerprints-0.5.3 functools32-3.2.3.post2 future-0.16.0 futures-3.2.0 idna-2.6 jmespath-0.9.3 jsonschema-2.6.0 libsanctions-0.1.0 lxml-4.1.1 morphium-0.2.0 normality-0.5.11 parsedatetime-2.4 phonenumbers-8.9.0 pycountry-18.2.23 python-Levenshtein-0.12.0 python-dateutil-2.6.1 pytz-2018.3 pyyaml-3.12 requests-2.18.4 s3transfer-0.1.13 six-1.11.0 sqlalchemy-1.2.4 unicodecsv-0.14.1 unidecode-1.0.22 urllib3-1.22 urltools-0.3.2 xlrd-1.1.0   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (418 KB) Use the API

rows 10 / 635

name title first_name second_name third_name father_name last_name id source type summary function program url gender listed_at updated_at timestamp
Шухрат
Камилович
Абашев
kg-fiu-national.cea869f962eba6fbbaa39a0615e66c89093bba4a
kg-fiu-national
individual
Приговор Верховного суда от 23.06.2010 года
экстремист
2017-10-13T02:00:32+00:00
Аьлоуддин
-
Абдивоп уулу
kg-fiu-national.e739765ebc76cbc2c87f06a48ca70d9ce3242bda
kg-fiu-national
individual
Приговор городского суда г. Кара-Суу, Ошской области от 30.09.2015 года
экстремист
2017-06-01
2017-10-13T02:00:32+00:00
Даминбай
Абибиллаевич
Абдиев
kg-fiu-national.c639a45b2bb884a7e85f5f07ccf782f0d195fbd8
kg-fiu-national
individual
Приговор Первомайского районного суда города Бишкек от 29.04.2014 года
экстремист
2017-10-13T02:00:32+00:00
Бахадир
Хурмирзаевич
Абдикаримов
kg-fiu-national.48864f24ca4473ce63c3e4cf547b706060e4c5df
kg-fiu-national
individual
Приговор Ошского городского суда от 14.08.2012 года
экстремист
2017-10-13T02:00:32+00:00
Илхом
Рахматиллоевич
Абдираиймов
kg-fiu-national.754d921e63c5bb78f49e7109e341a60a0691a25c
kg-fiu-national
individual
Приговор городского суда г. Кара-Суу, Ошской области от 20.01.2016 года
экстремист
2017-06-01
2017-10-13T02:00:32+00:00
Бегимай
-
Абдисаттар кызы
kg-fiu-national.6e8f8492505b06ed3cfad442095877aacc1ff88f
kg-fiu-national
individual
Приговор Ноокенского районного суда Жалал-Абадской области от 15.12.2014 года
экстремист
2017-10-13T02:00:32+00:00
Кубатбек
Шамшикеевич
Абдраманов
kg-fiu-national.016b14a721dac9ffebbde04052c92dc00f8a4b9b
kg-fiu-national
individual
Приговор Первомайского районного суда города Бишкек от 27.02.2014 года
экстремист
2017-10-13T02:00:32+00:00
Эдиль
Алимжанович
Абдрахманов
kg-fiu-national.a3a8686b7d2d72991b5c88cb04672eeaeca4d185
kg-fiu-national
individual
Приговор Октябрьского районного суда города Бишкек от 16.07.2013 года
террорист
2017-10-13T02:00:32+00:00
Алишер
Нурланбекович
Абдрахманов
kg-fiu-national.cfb183445f5df0813cd45b8079c8dbe491bd00b8
kg-fiu-national
individual
Постановление по уголовному делу № 082-14-0110 - в розыске
террорист
2016-10-20
2017-10-13T02:00:32+00:00
Лукманжан
Саттарович
Абдрахманов
kg-fiu-national.4cac82e659a9e59e0e76273876e1343753fec2c6
kg-fiu-national
individual
Постановление по уголовному делу № 43-14-157 - в розыске
террорист
2016-10-20
2017-10-13T02:00:32+00:00

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (418 KB) Use the API

rows 0 / 0

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (418 KB) Use the API

rows 0 / 0

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (418 KB) Use the API

rows 0 / 0

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (418 KB) Use the API

rows 10 / 19

name title first_name second_name third_name father_name last_name quality id entity_id type description
Ансарул Аллах
1
kg-fiu-national.8858cc67f1ab4ac93b998aa486b6bc67676d12fe
Джамаат Ансаруллох
2
kg-fiu-national.8858cc67f1ab4ac93b998aa486b6bc67676d12fe
Ат- Такфир Вал-Хиджра
3
kg-fiu-national.80cdea14cc3aa0e60f4686cc3a4ca1bfd1445e7d
Шарки Туркестан ислам партиясы
4
kg-fiu-national.59042868b29449ac96b54090023085ce8b7cdd16
Союз Исламского джихада
5
kg-fiu-national.57759ffc488016d342ab704c494930422fa2b49d
Исламская группа джихада
6
kg-fiu-national.57759ffc488016d342ab704c494930422fa2b49d
Джамаат аль- джихад
7
kg-fiu-national.57759ffc488016d342ab704c494930422fa2b49d
Исламский джихад- джамаат маджахедов
8
kg-fiu-national.57759ffc488016d342ab704c494930422fa2b49d
Джамаат маджахедов Центральной Азии
9
kg-fiu-national.57759ffc488016d342ab704c494930422fa2b49d
Джунд-уль Халифат
10
kg-fiu-national.f0ffd1033fb2fcb61b3f9eb1743970a1a2a78e77

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (418 KB) Use the API

rows 0 / 0

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (418 KB) Use the API

rows 10 / 1252

quality id entity_id date
1
kg-fiu-national.cea869f962eba6fbbaa39a0615e66c89093bba4a
1973-04-29
2
kg-fiu-national.cea869f962eba6fbbaa39a0615e66c89093bba4a
3
kg-fiu-national.e739765ebc76cbc2c87f06a48ca70d9ce3242bda
1992-12-06
4
kg-fiu-national.e739765ebc76cbc2c87f06a48ca70d9ce3242bda
5
kg-fiu-national.c639a45b2bb884a7e85f5f07ccf782f0d195fbd8
1983-09-02
6
kg-fiu-national.c639a45b2bb884a7e85f5f07ccf782f0d195fbd8
7
kg-fiu-national.48864f24ca4473ce63c3e4cf547b706060e4c5df
1967-09-15
8
kg-fiu-national.48864f24ca4473ce63c3e4cf547b706060e4c5df
9
kg-fiu-national.754d921e63c5bb78f49e7109e341a60a0691a25c
1991-10-22
10
kg-fiu-national.754d921e63c5bb78f49e7109e341a60a0691a25c

Statistics

Average successful run time: 2 minutes

Total run time: about 7 hours

Total cpu time used: 22 minutes

Total disk space used: 448 KB

History

  • Auto ran revision c9db94aa and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c9db94aa and failed .
    nothing changed in the database
  • Auto ran revision c9db94aa and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision c9db94aa and failed .
    nothing changed in the database
  • Auto ran revision c9db94aa and completed successfully .
    nothing changed in the database
    2 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

kg-fiu-national / scraper.py