miedzinski / hltv

HLTV matches

Scrapes www.hltv.org

HLTV.org is the leading csgo site in the world, featuring news, demos, pictures, statistics, on-site coverage and much much more!


This is a scraper that runs on Morph. To get started see the documentation

This scraper

Aims to collect CSGO matches from HLTV results page.

To get to know what's scraped see hltv.models.

Contributors miedzinski

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... 2015-11-01 16:12:40 [scrapy] ERROR: Spider error processing <GET http://www.hltv.org/match/> (referer: http://www.hltv.org/results/350/) Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 588, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/app/hltv/spiders/results.py", line 16, in parse_result match['id'] = int(response.url.split('/')[-1].split('-')[0]) ValueError: invalid literal for int() with base 10: ''

Data

Downloaded 168 times by wluxion koooooooooo hubrian astaunton baabelfish MikeRalphson neoantox VIGGEEN Champ586 Tom-Lo iTsFILIPOficial BringMaster MatejVitek mariovrocha miedzinski larion93 sdieunidou Viiprogrammer TrueCarry dumdum85

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (969 KB) Use the API

rows 10 / 2265

id hltv_id nickname
1
5185
DomiNate
2
3329
quix
3
8555
jayzaR
4
9034
dejvin
5
9261
Lekr0
6
7238
stonde
7
5479
suNny
8
7775
juho
9
7235
disturbed
10
7537
xartE

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (969 KB) Use the API

rows 10 / 1277

id name
1
Publiclir.se
2
MIXCAT
3
DenDD
4
Orgless
5
Space Soldiers
6
stfuNerd
7
EnVyUs
8
dignitas
9
Arcade
10
ESC

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (969 KB) Use the API

rows 10 / 6385

player_id team_id
5
1
1
1
2
1
3
1
4
1
6
2
7
2
8
2
9
2
10
2

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (969 KB) Use the API

rows 10 / 6290

hltv_id date tournament best_of score team1_id team2_id
2292323
2014-08-12
SLTV StarSeries X
1
1:0
939
448
2292324
2014-08-12
SLTV StarSeries X
1
1:0
939
799
2292325
2014-08-12
SLTV StarSeries X
1
0:1
121
10
2292327
2014-08-12
SLTV StarSeries X
1
0:0
754
23
2292328
2014-08-12
European Championship 2014 Qualification Round 1
3
0:2
168
247
2292335
2014-08-14
ESL One Cologne 2014
1
0:1
15
944
2292336
2014-08-14
ESL One Cologne 2014
1
0:1
60
754
2292337
2014-08-14
ESL One Cologne 2014
1
0:1
766
57
2292338
2014-08-14
ESL One Cologne 2014
1
1:0
612
11
2292339
2014-08-14
ESL One Cologne 2014
1
0:1
30
748

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (969 KB) Use the API

rows 10 / 12073

id match name score
1
2298986
cache
8:16 (6:9; 2:7)
2
2298986
mirage
13:16 (8:7; 5:9)
3
2298986
cobblestone
16:11 (7:8; 9:3)
4
2298986
inferno
6:16 (4:11; 2:5)
5
2298986
train
6
2298933
mirage
16:10 (7:8; 9:2)
7
2298933
cobblestone
7:16 (6:9; 1:7)
8
2298933
cache
16:4 (14:1; 2:3)
9
2298943
cache
16:3 (12:3; 4:0)
10
2298943
train
16:5 (12:3; 4:2)

Statistics

Average successful run time: about 6 hours

Total run time: about 6 hours

Total cpu time used: 15 minutes

Total disk space used: 1000 KB

History

  • Manually ran revision 9922e987 and completed successfully .
    28290 records added in the database
    37702 pages scraped
  • Created on morph.io

Scraper code

Python

hltv / scraper.py