marcusmeisel / datacenters

datacenters


datacenters

datacenters

scrapes all commercially available datacenters of the world from www.datacentermap.com Finds their Country, Area, City, Datacentername, Postalcode, Street Address, and tries to reverse lookup their geolocation in openstreetmap or google maps API.

** shortcommings **

  • Very little exception handling (it does run through with the current website status)
  • Does not check for duplicates (no identifyer) - so if you run scraper again, it will add the whole dataset again into the table
  • Best effort location lookup (but with accuracy statement of found locations)
  • does not try to find datacenter capacity or pricing

Forked from ScraperWiki

Contributors marcusmeisel

Last run completed successfully .

Console output of last run

Status: checking country: Angola, Argentina, Australia, Austria, Azerbaijan, Bahrain, Belarus, Belgium, Bolivia, Brazil, Bulgaria, Cambodia, Canada, Cayman Islands, Chile, China, Colombia, Costa Rica, Croatia, Cyprus, Czech Republic, Denmark, Egypt, Estonia, Finland, France, Germany, Gibraltar, Greece, Greenland, Guernsey, Guernsey, Hong Kong, Hungary, Iceland, India, Indonesia, Iran, Ireland, Isle Of Man, Israel, Italy, Japan, Jersey, Jordan, Kenya, Kuwait, Latvia, Lebanon, Libya, Liechtenstein, Lithuania, Luxembourg, Macedonia, Malaysia, Malta, Mauritius, Mexico, Moldova, Montenegro, Morocco, Nepal, Netherlands Antilles, New Zealand, Nigeria, Norway, Pakistan, Palestine, Panama, Philippines, Poland, Portugal, Puerto Rico, Qatar, Romania, Russia, Saudi Arabia, Serbia, Singapore, Slovakia, Slovenia, South Africa, South Korea, Spain, Sweden, Switzerland, Taiwan, Thailand, The Bahamas, The Netherlands, Turkey, Ukraine, United Arab Emirates, United Kingdom, Uruguay, USA, Alabama, Arizona, Arkansas, California, Colorado, Connecticut, Delaware, District Of Columbia, Florida, Georgia, Hawaii, Idaho, Illinois, Indiana, Iowa, Kansas, Kentucky, Louisiana, Maine, Maryland, Massachusetts, Michigan, Minnesota, Mississippi, Missouri, Montana, Nebraska, Nevada, New Hampshire, New Jersey, New Mexico, New York, North Carolina, Ohio, Oklahoma, Oregon, Pennsylvania, Rhode Island, South Carolina, South Dakota, Tennessee, Texas, Utah, Vermont, Virginia, Washington, West Virginia, Wisconsin, Wyoming, Venezuela, Vietnam,

Data

Downloaded 1 time by MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (452 KB) Use the API

rows 10 / 2085

id country area detailarea datacentercity datacentername postalcode streetaddress organizationname latitude longitude accuracy
1
Angola
Luanda
Luanda
Luanda
MULTIPLA
1
ESTRADA DE VIANA KM 19
41.6348464
-84.9992683
city
2
Australia
Adelaide
Adelaide
Adelaide
Colocity
5000
247 Pulteney Street
-34.92687
138.6058883
secondary
3
Australia
Adelaide
Adelaide
Adelaide
EscapeNet
5000
90 King William Street
-34.9217186
138.5993429
secondary
4
Australia
Adelaide
Adelaide
Adelaide
AAPT Adelaide
SA 5000
45 Pirie Street, Level 1
-34.92562005
138.60005736053
administrative
5
Australia
Adelaide
Adelaide
Perth
amcom Adelaide
6000
Level 18, 44 St Georges Tce
49.4121347
2.40645157682922
administrative
6
Australia
Adelaide
Adelaide
Adelaide
PIPE Networks Adelaide
SA 5000
Franklin St, Level 2
-34.92562005
138.60005736053
administrative
7
Australia
Adelaide
Adelaide
Adelaide
HostExpress
5000
Franklin St
-34.9274692
138.5937865
tertiary
8
Australia
Adelaide
Adelaide
Adelaide
Logic Plus
5000
202 Halifax Street
-34.9326862
138.6036566
tertiary
9
Australia
Adelaide
Adelaide
Adelaide
Metronode Adelaide 1
5000
-34.9274284
138.599899
city
10
Australia
Brisbane
Brisbane
Brisbane Airport
iseek Data Centre-Brisbane Airport
4009
Lomandra Drive, Brisbane Airport, QLD
44.00991675
-0.643407959309177
administrative

Statistics

Average successful run time: about 1 hour

Total run time: about 9 hours

Total cpu time used: 22 minutes

Total disk space used: 501 KB

History

  • Manually ran revision 90f65db4 and completed successfully .
    2086 records added in the database
  • Manually ran revision 5d24a38b and failed .
    nothing changed in the database
  • Manually ran revision f62fd929 and completed successfully .
    2085 records added in the database
  • Manually ran revision 3d17ce8e and completed successfully .
    2 records added in the database
  • Manually ran revision 218df035 and failed .
    nothing changed in the database
  • Manually ran revision e352d7ce and completed successfully .
    nothing changed in the database
  • Manually ran revision 5be4b51c and failed .
    nothing changed in the database
  • Manually ran revision 20afe1e5 and failed .
    nothing changed in the database
  • Manually ran revision bd27ca12 and completed successfully .
    nothing changed in the database
  • Manually ran revision 693bdb92 and completed successfully .
    nothing changed in the database
  • Manually ran revision 087e0f6d and completed successfully .
    nothing changed in the database
  • Manually ran revision 0c31507b and completed successfully .
    nothing changed in the database
  • Manually ran revision e7e3bc00 and completed successfully .
    nothing changed in the database
  • Manually ran revision 5584bc5b and failed .
    nothing changed in the database
  • Manually ran revision fd746ff0 and failed .
    nothing changed in the database
  • Manually ran revision 6eb93345 and failed .
    nothing changed in the database
  • Manually ran revision 24653ed3 and failed .
    nothing changed in the database
  • Manually ran revision e0b82613 and failed .
    nothing changed in the database
  • Manually ran revision e97fc4ff and failed .
    nothing changed in the database
  • Manually ran revision e97fc4ff and failed .
    nothing changed in the database
  • Manually ran revision 9bf5a18b and failed .
    nothing changed in the database
  • Manually ran revision 0bc5b9d3 and failed .
    nothing changed in the database
  • Forked from ScraperWiki

Scraper code

PHP

datacenters / scraper.php