marcusmeisel / datacenters
datacenters
datacenters
datacenters
scrapes all commercially available datacenters of the world from www.datacentermap.com Finds their Country, Area, City, Datacentername, Postalcode, Street Address, and tries to reverse lookup their geolocation in openstreetmap or google maps API.
** shortcommings **
- Very little exception handling (it does run through with the current website status)
- Does not check for duplicates (no identifyer) - so if you run scraper again, it will add the whole dataset again into the table
- Best effort location lookup (but with accuracy statement of found locations)
- does not try to find datacenter capacity or pricing
Forked from ScraperWiki
Last run completed successfully
.
Console output of last run
Status: checking country:
Angola,
Argentina,
Australia,
Austria,
Azerbaijan,
Bahrain,
Belarus,
Belgium,
Bolivia,
Brazil,
Bulgaria,
Cambodia,
Canada,
Cayman Islands,
Chile,
China,
Colombia,
Costa Rica,
Croatia,
Cyprus,
Czech Republic,
Denmark,
Egypt,
Estonia,
Finland,
France,
Germany,
Gibraltar,
Greece,
Greenland,
Guernsey,
Guernsey,
Hong Kong,
Hungary,
Iceland,
India,
Indonesia,
Iran,
Ireland,
Isle Of Man,
Israel,
Italy,
Japan,
Jersey,
Jordan,
Kenya,
Kuwait,
Latvia,
Lebanon,
Libya,
Liechtenstein,
Lithuania,
Luxembourg,
Macedonia,
Malaysia,
Malta,
Mauritius,
Mexico,
Moldova,
Montenegro,
Morocco,
Nepal,
Netherlands Antilles,
New Zealand,
Nigeria,
Norway,
Pakistan,
Palestine,
Panama,
Philippines,
Poland,
Portugal,
Puerto Rico,
Qatar,
Romania,
Russia,
Saudi Arabia,
Serbia,
Singapore,
Slovakia,
Slovenia,
South Africa,
South Korea,
Spain,
Sweden,
Switzerland,
Taiwan,
Thailand,
The Bahamas,
The Netherlands,
Turkey,
Ukraine,
United Arab Emirates,
United Kingdom,
Uruguay,
USA,
Alabama,
Arizona,
Arkansas,
California,
Colorado,
Connecticut,
Delaware,
District Of Columbia,
Florida,
Georgia,
Hawaii,
Idaho,
Illinois,
Indiana,
Iowa,
Kansas,
Kentucky,
Louisiana,
Maine,
Maryland,
Massachusetts,
Michigan,
Minnesota,
Mississippi,
Missouri,
Montana,
Nebraska,
Nevada,
New Hampshire,
New Jersey,
New Mexico,
New York,
North Carolina,
Ohio,
Oklahoma,
Oregon,
Pennsylvania,
Rhode Island,
South Carolina,
South Dakota,
Tennessee,
Texas,
Utah,
Vermont,
Virginia,
Washington,
West Virginia,
Wisconsin,
Wyoming,
Venezuela,
Vietnam,
Data
Downloaded
2 times
by
To download data sign in with GitHub
rows 10 / 2085
| id | country | area | detailarea | datacentercity | datacentername | postalcode | streetaddress | organizationname | latitude | longitude | accuracy |
|---|---|---|---|---|---|---|---|---|---|---|---|
|
1
|
Angola
|
Luanda
|
Luanda
|
Luanda
|
MULTIPLA
|
1
|
ESTRADA DE VIANA KM 19
|
|
41.6348464
|
-84.9992683
|
city
|
|
2
|
Australia
|
Adelaide
|
Adelaide
|
Adelaide
|
Colocity
|
5000
|
247 Pulteney Street
|
|
-34.92687
|
138.6058883
|
secondary
|
|
3
|
Australia
|
Adelaide
|
Adelaide
|
Adelaide
|
EscapeNet
|
5000
|
90 King William Street
|
|
-34.9217186
|
138.5993429
|
secondary
|
|
4
|
Australia
|
Adelaide
|
Adelaide
|
Adelaide
|
AAPT Adelaide
|
SA 5000
|
45 Pirie Street, Level 1
|
|
-34.92562005
|
138.60005736053
|
administrative
|
|
5
|
Australia
|
Adelaide
|
Adelaide
|
Perth
|
amcom Adelaide
|
6000
|
Level 18, 44 St Georges Tce
|
|
49.4121347
|
2.40645157682922
|
administrative
|
|
6
|
Australia
|
Adelaide
|
Adelaide
|
Adelaide
|
PIPE Networks Adelaide
|
SA 5000
|
Franklin St, Level 2
|
|
-34.92562005
|
138.60005736053
|
administrative
|
|
7
|
Australia
|
Adelaide
|
Adelaide
|
Adelaide
|
HostExpress
|
5000
|
Franklin St
|
|
-34.9274692
|
138.5937865
|
tertiary
|
|
8
|
Australia
|
Adelaide
|
Adelaide
|
Adelaide
|
Logic Plus
|
5000
|
202 Halifax Street
|
|
-34.9326862
|
138.6036566
|
tertiary
|
|
9
|
Australia
|
Adelaide
|
Adelaide
|
Adelaide
|
Metronode Adelaide 1
|
5000
|
|
|
-34.9274284
|
138.599899
|
city
|
|
10
|
Australia
|
Brisbane
|
Brisbane
|
Brisbane Airport
|
iseek Data Centre-Brisbane Airport
|
4009
|
Lomandra Drive, Brisbane Airport, QLD
|
|
44.00991675
|
-0.643407959309177
|
administrative
|
Statistics
Average successful run time: about 1 hour
Total run time: about 9 hours
Total cpu time used: 22 minutes
Total disk space used: 503 KB
History
-
Manually
ran
revision
90f65db4
and
completed successfully
.
2086 records added in the database
-
Manually
ran
revision
5d24a38b
and
failed
.
nothing changed in the database
-
Manually
ran
revision
f62fd929
and
completed successfully
.
2085 records added in the database
-
Manually
ran
revision
3d17ce8e
and
completed successfully
.
2 records added in the database
-
Manually
ran
revision
218df035
and
failed
.
nothing changed in the database
- ...
- Forked from ScraperWiki