atompkins / ufsg-realm-scraper-py

UFSG Realm Scraper - guide.fallensword.com


ufsg-realm-scraper-py

UFSG Realm Scraper - guide.fallensword.com

https://morph.io/atompkins/ufsg-realm-scraper-py

Contributors atompkins

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.6.2 -----> Installing pip -----> Installing requirements with pip  Collecting aiohttp  Downloading aiohttp-3.8.1-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)  Collecting beautifulsoup4  Downloading beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)  Collecting async-timeout<5.0,>=4.0.0a3  Downloading async_timeout-4.0.1-py3-none-any.whl (5.7 kB)  Collecting asynctest==0.13.0  Downloading asynctest-0.13.0-py3-none-any.whl (26 kB)  Collecting attrs>=17.3.0  Downloading attrs-21.2.0-py2.py3-none-any.whl (53 kB)  Collecting aiosignal>=1.1.2  Downloading aiosignal-1.2.0-py3-none-any.whl (8.2 kB)  Collecting idna-ssl>=1.0  Downloading idna-ssl-1.1.0.tar.gz (3.4 kB)  Preparing metadata (setup.py): started  Preparing metadata (setup.py): finished with status 'done'  Collecting frozenlist>=1.1.1  Downloading frozenlist-1.2.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (191 kB)  Collecting yarl<2.0,>=1.0  Downloading yarl-1.7.2-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (270 kB)  Collecting multidict<7.0,>=4.5  Downloading multidict-5.2.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (159 kB)  Collecting typing-extensions>=3.7.4  Downloading typing_extensions-4.0.0-py3-none-any.whl (22 kB)  Collecting charset-normalizer<3.0,>=2.0  Downloading charset_normalizer-2.0.8-py3-none-any.whl (39 kB)  Collecting soupsieve>1.2  Downloading soupsieve-2.3.1-py3-none-any.whl (37 kB)  Collecting idna>=2.0  Downloading idna-3.3-py3-none-any.whl (61 kB)  Building wheels for collected packages: idna-ssl  Building wheel for idna-ssl (setup.py): started  Building wheel for idna-ssl (setup.py): finished with status 'done'  Created wheel for idna-ssl: filename=idna_ssl-1.1.0-py3-none-any.whl size=3178 sha256=a273747d42d12f81402d733c739cfd36a47963c703df471c959b9696e07a3aaf  Stored in directory: /tmp/pip-ephem-wheel-cache-16s6a7j5/wheels/6a/f5/9c/f8331a854f7a8739cf0e74c13854e4dd7b1af11b04fe1dde13  Successfully built idna-ssl  Installing collected packages: typing-extensions, multidict, idna, frozenlist, yarl, soupsieve, idna-ssl, charset-normalizer, attrs, asynctest, async-timeout, aiosignal, beautifulsoup4, aiohttp  Successfully installed aiohttp-3.8.1 aiosignal-1.2.0 async-timeout-4.0.1 asynctest-0.13.0 attrs-21.2.0 beautifulsoup4-4.10.0 charset-normalizer-2.0.8 frozenlist-1.2.0 idna-3.3 idna-ssl-1.1.0 multidict-5.2.0 soupsieve-2.3.1 typing-extensions-4.0.0 yarl-1.7.2   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 Finished...

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.01 MB) Use the API

rows 10 / 11977

realm_id realm_name level creature_id creature_name creature_class
461
Goblin Cave
4
547
Lesser Goblin Shaman
Greenskin
461
Goblin Cave
4
15
Goblin
Greenskin
461
Goblin Cave
4
9
Troll
Greenskin
18
Elya Plains North
4
22
Desert Snake
Vermin
18
Elya Plains North
4
2047
Skull Carver (Super Elite)
Demon
18
Elya Plains North
4
596
Blue Spine Chomper (Legendary)
Vermin
18
Elya Plains North
4
64
Frost Dragon (Legendary)
Dragon
18
Elya Plains North
4
1029
Burzzthak the Corrupter (Legendary)
Demon
18
Elya Plains North
4
9
Troll
Greenskin
18
Elya Plains North
4
10
Skeletal Mage
Undead

Statistics

Average successful run time: 13 minutes

Total run time: about 6 hours

Total cpu time used: about 4 hours

Total disk space used: 1.04 MB

History

  • Auto ran revision 5bcde758 and completed successfully .
    11977 records added, 11977 records removed in the database
  • Auto ran revision 5bcde758 and completed successfully .
    11977 records added, 11977 records removed in the database
  • Auto ran revision 5bcde758 and completed successfully .
    11977 records added, 11977 records removed in the database
  • Auto ran revision 5bcde758 and completed successfully .
    11977 records added, 11977 records removed in the database
  • Auto ran revision 5bcde758 and completed successfully .
    11977 records added, 11977 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

ufsg-realm-scraper-py / scraper.py