This is a scraper that runs on Morph. To get started see the documentation

Contributors rdmaloney

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.6.2 -----> Installing pip -----> Installing requirements with pip  Collecting beautifulsoup4==4.6.0 (from -r /tmp/build/requirements.txt (line 5))  Downloading https://files.pythonhosted.org/packages/9e/d4/10f46e5cfac773e22707237bfcd51bbffeaf0a576b0a847ec7ab15bd7ace/beautifulsoup4-4.6.0-py3-none-any.whl (86kB)  Collecting pandas==0.23.0 (from -r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/69/ec/8ff0800b8594691759b78a42ccd616f81e7099ee47b167eb9bbd502c02b9/pandas-0.23.0-cp36-cp36m-manylinux1_x86_64.whl (11.7MB)  Collecting numpy==1.14.3 (from -r /tmp/build/requirements.txt (line 7))  Downloading https://files.pythonhosted.org/packages/71/90/ca61e203e0080a8cef7ac21eca199829fa8d997f7c4da3e985b49d0a107d/numpy-1.14.3-cp36-cp36m-manylinux1_x86_64.whl (12.2MB)  Collecting requests==2.22.0 (from -r /tmp/build/requirements.txt (line 8))  Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB)  Collecting python-dateutil>=2.5.0 (from pandas==0.23.0->-r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB)  Collecting pytz>=2011k (from pandas==0.23.0->-r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/87/76/46d697698a143e05f77bec5a526bf4e56a0be61d63425b68f4ba553b51f2/pytz-2019.2-py2.py3-none-any.whl (508kB)  Collecting certifi>=2017.4.17 (from requests==2.22.0->-r /tmp/build/requirements.txt (line 8))  Downloading https://files.pythonhosted.org/packages/69/1b/b853c7a9d4f6a6d00749e94eb6f3a041e342a885b87340b79c1ef73e3a78/certifi-2019.6.16-py2.py3-none-any.whl (157kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests==2.22.0->-r /tmp/build/requirements.txt (line 8))  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests==2.22.0->-r /tmp/build/requirements.txt (line 8))  Downloading https://files.pythonhosted.org/packages/e6/60/247f23a7121ae632d62811ba7f273d0e58972d75e58a94d329d51550a47d/urllib3-1.25.3-py2.py3-none-any.whl (150kB)  Collecting idna<2.9,>=2.5 (from requests==2.22.0->-r /tmp/build/requirements.txt (line 8))  Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)  Collecting six>=1.5 (from python-dateutil>=2.5.0->pandas==0.23.0->-r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl  Installing collected packages: beautifulsoup4, numpy, six, python-dateutil, pytz, pandas, certifi, chardet, urllib3, idna, requests  Successfully installed beautifulsoup4-4.6.0 certifi-2019.6.16 chardet-3.0.4 idna-2.8 numpy-1.14.3 pandas-0.23.0 python-dateutil-2.8.0 pytz-2019.2 requests-2.22.0 six-1.12.0 urllib3-1.25.3   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Now currently scraping link: http://ufcstats.com/event-details/a79bfbc01b2264d6 Now currently scraping link: http://ufcstats.com/event-details/4834ff149dc9542a Now currently scraping link: http://ufcstats.com/event-details/94a5aaf573f780ad Now currently scraping link: http://ufcstats.com/event-details/1bf49bf829964144 Now currently scraping link: http://ufcstats.com/event-details/3cf68c1d17f66af7 Now currently scraping link: http://ufcstats.com/event-details/0941df56f6ac954b Now currently scraping link: http://ufcstats.com/event-details/3ae10ac4df3df05c Now currently scraping link: http://ufcstats.com/event-details/df05aa15b2d66f57 Now currently scraping link: http://ufcstats.com/event-details/fd87b1bbfcde9d5e Now currently scraping link: http://ufcstats.com/event-details/8d5daf67983b65ba Now currently scraping link: http://ufcstats.com/event-details/81ca2c245b19b3c5 Now currently scraping link: http://ufcstats.com/event-details/b09890ba7ce1d1e2 Now currently scraping link: http://ufcstats.com/event-details/4565d435005319c0 Now currently scraping link: http://ufcstats.com/event-details/74fefd43f073cd2f Scraping completed Db successfully constructed and saved

Data

Downloaded 3 times by rdmaloney

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (11 KB) Use the API

rows 10 / 92

index Event Fighter1 Fighter2
0
UFC 242: Khabib vs. Poirier
Khabib Nurmagomedov
Dustin Poirier
1
UFC 242: Khabib vs. Poirier
Edson Barboza
Paul Felder
2
UFC 242: Khabib vs. Poirier
Islam Makhachev
Davi Ramos
3
UFC 242: Khabib vs. Poirier
Curtis Blaydes
Shamil Abdurakhimov
4
UFC 242: Khabib vs. Poirier
Mairbek Taisumov
Diego Ferreira
5
UFC 242: Khabib vs. Poirier
Joanne Calderwood
Andrea Lee
6
UFC 242: Khabib vs. Poirier
Zubaira Tukhugov
Lerone Murphy
7
UFC 242: Khabib vs. Poirier
Liana Jojua
Sarah Moras
8
UFC 242: Khabib vs. Poirier
Ottman Azaitar
Teemu Packalen
9
UFC 242: Khabib vs. Poirier
Belal Muhammad
Takashi Sato

Statistics

Average successful run time: less than a minute

Total run time: 15 minutes

Total cpu time used: less than a minute

Total disk space used: 93.8 KB

History

  • Manually ran revision 42fc6861 and completed successfully .
    nothing changed in the database
  • Manually ran revision 42fc6861 and completed successfully .
    nothing changed in the database
  • Manually ran revision 42fc6861 and completed successfully .
    12 records removed, 92 records updated in the database
  • Manually ran revision 42fc6861 and completed successfully .
    4 records added, 82 records updated in the database
  • Manually ran revision 42fc6861 and completed successfully .
    16 records added, 84 records updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

fights_model / scraper.py