atompkins / ufsg-realm-scraper-py

UFSG Realm Scraper - guide.fallensword.com


ufsg-realm-scraper-py

UFSG Realm Scraper - guide.fallensword.com

https://morph.io/atompkins/ufsg-realm-scraper-py

Contributors atompkins

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.6.2 -----> Installing pip -----> Installing requirements with pip  Collecting aiohttp  Downloading aiohttp-3.8.1-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)  Collecting beautifulsoup4  Downloading beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)  Collecting aiosignal>=1.1.2  Downloading aiosignal-1.2.0-py3-none-any.whl (8.2 kB)  Collecting multidict<7.0,>=4.5  Downloading multidict-5.2.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (159 kB)  Collecting frozenlist>=1.1.1  Downloading frozenlist-1.2.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (191 kB)  Collecting typing-extensions>=3.7.4  Downloading typing_extensions-4.1.1-py3-none-any.whl (26 kB)  Collecting yarl<2.0,>=1.0  Downloading yarl-1.7.2-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (270 kB)  Collecting attrs>=17.3.0  Downloading attrs-21.4.0-py2.py3-none-any.whl (60 kB)  Collecting idna-ssl>=1.0  Downloading idna-ssl-1.1.0.tar.gz (3.4 kB)  Preparing metadata (setup.py): started  Preparing metadata (setup.py): finished with status 'done'  Collecting async-timeout<5.0,>=4.0.0a3  Downloading async_timeout-4.0.2-py3-none-any.whl (5.8 kB)  Collecting charset-normalizer<3.0,>=2.0  Downloading charset_normalizer-2.1.0-py3-none-any.whl (39 kB)  Collecting asynctest==0.13.0  Downloading asynctest-0.13.0-py3-none-any.whl (26 kB)  Collecting soupsieve>1.2  Downloading soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)  Collecting idna>=2.0  Downloading idna-3.3-py3-none-any.whl (61 kB)  Building wheels for collected packages: idna-ssl  Building wheel for idna-ssl (setup.py): started  Building wheel for idna-ssl (setup.py): finished with status 'done'  Created wheel for idna-ssl: filename=idna_ssl-1.1.0-py3-none-any.whl size=3178 sha256=df614797e461996cd3c9a277eb19bed64c44fae0708042e8c47d8529053a6424  Stored in directory: /tmp/pip-ephem-wheel-cache-dob0dnlw/wheels/6a/f5/9c/f8331a854f7a8739cf0e74c13854e4dd7b1af11b04fe1dde13  Successfully built idna-ssl  Installing collected packages: typing-extensions, multidict, idna, frozenlist, yarl, soupsieve, idna-ssl, charset-normalizer, attrs, asynctest, async-timeout, aiosignal, beautifulsoup4, aiohttp  Successfully installed aiohttp-3.8.1 aiosignal-1.2.0 async-timeout-4.0.2 asynctest-0.13.0 attrs-21.4.0 beautifulsoup4-4.11.1 charset-normalizer-2.1.0 frozenlist-1.2.0 idna-3.3 idna-ssl-1.1.0 multidict-5.2.0 soupsieve-2.3.2.post1 typing-extensions-4.1.1 yarl-1.7.2   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 Finished...

Data

Downloaded 7 times by atompkins

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.05 MB) Use the API

rows 10 / 12305

realm_id realm_name level creature_id creature_name creature_class
17
Varas Dungeon
5
19
Succubus
Demon
17
Varas Dungeon
5
16
Skeleton
Undead
17
Varas Dungeon
5
5
Vampire
Undead
17
Varas Dungeon
5
596
Blue Spine Chomper (Legendary)
Vermin
17
Varas Dungeon
5
13
Darmov the Great (Elite)
Vermin
17
Varas Dungeon
5
1029
Burzzthak the Corrupter (Legendary)
Demon
17
Varas Dungeon
5
8
Ogre
Vermin
17
Varas Dungeon
5
17
Skeletal Warrior (Elite)
Undead
1681
Fortress of Elya (Corridors)
7
1913
Elya Sand Sprite
Vermin
461
Goblin Cave
4
547
Lesser Goblin Shaman
Greenskin

Statistics

Average successful run time: 14 minutes

Total run time: 2 days

Total cpu time used: 1 day

Total disk space used: 1.08 MB

History

  • Auto ran revision 5bcde758 and completed successfully .
    12305 records added, 12305 records removed in the database
  • Auto ran revision 5bcde758 and failed .
    545 records added, 545 records removed in the database
  • Auto ran revision 5bcde758 and completed successfully .
    12305 records added, 12305 records removed in the database
  • Auto ran revision 5bcde758 and completed successfully .
    12305 records added, 12305 records removed in the database
  • Auto ran revision 5bcde758 and completed successfully .
    12305 records added, 12305 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

ufsg-realm-scraper-py / scraper.py