lowndsy / PositionAnalyser

A record of where key brands are ranked

Scrapes www.uswitch.com

Compare and switch gas and electricity suppliers, also compare broadband deals, mobile phone deals, car & home insurance, credit cards, boiler cover & more.


For educational use only, this is an example of a simple scanner that checks a site to see where specific brands are placed in a pricing table. The code is fully commented and has been designed to be easy to deconstruct.

This resource is a real world example of how to make a simple price scanner that gives data integrity through redundancy. Each piece of info is stored more than once in one form or another so everything can be verified and checked against itself.

It does the same job as a person and takes the same server load as one person visiting a few pages every morning. As soon as you start gathering info for more than one brand it probably even saves the retailer bandwidth.

The principles can be extended to any site which displays structured or tabular data, and the code demonstrates how to use the simplehtmldom.php library to work with P and SPAN tags as well as tables.

This is built in PHP for the Morph.io platform, but it could be used in almost any automation tool, or even run locally. The single line of code which needs altering to be platform independent is commented and there is only one dependency.

Contributors lowndsy

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.lock; using PHP ^5.5.17  - php (5.6.28)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - apache (2.4.20)  - nginx (1.8.1) -----> Installing dependencies...  Composer version 1.1.3 2016-06-26 15:42:08  Loading composer repositories with package information  Installing dependencies from lock file  - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0)  Cloning e996fe0253bb50330690f5d2bafb66f094dbacb8   Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Check Complete: 06-12-2016 05:37

Data

Downloaded 872 times by DataSparrow lowndsy MikeRalphson Mitch1983 IDatiD

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (30 MB) Use the API

rows 10 / 29128

id datestamp page position dealname dealdesc contractdesc monthlycost totalcost network brand buylink fullcode prikey notes
1
10-11-2016 16:04
1
Samsung Galaxy S7 32GB Gold FREE £10 cashback
Unlimited minutes Unlimited texts 4GB data
24 month contract - 4G
30.00
Three Mobile
Mobile Phones Direct
24 month contract - 4G Samsung Galaxy S7 32GB Gold FREE £10 cashback 24 month contract - 4G Unlimited minutes Unlimited texts 4GB data </p> £30.00 per month £710.00 total cost £10 cashback £30.00 per month £710.00 total cost See deal 0203 051 9835
e7dd7cabe23b1930f2914c30ad5733fd
2
10-11-2016 16:04
2
Samsung Galaxy S7 32GB Gold £29.99 upfront uSwitch exclusive Roaming Allowance
600 minutes 5000 texts 2GB data
24 month contract - 4G
33.50
iD Mobile
iD Mobile
24 month contract - 4G Samsung Galaxy S7 32GB Gold £29.99 upfront uSwitch exclusive Roaming Allowance 24 month contract - 4G 600 minutes 5000 texts 2GB data </p> £33.50 per month £833.99 total cost uSwitch exclusive Roaming Allowance £33.50 per month £833.99 total cost See deal
0a5abad8d94fe798a26d8ca8478fecce
3
10-11-2016 16:04
3
Samsung Galaxy S7 32GB Gold FREE uSwitch exclusive Double speed 4G
Unlimited minutes Unlimited texts 10GB data
24 month contract - 4G
45.99
EE
Metrofone
24 month contract - 4G Samsung Galaxy S7 32GB Gold FREE uSwitch exclusive Double speed 4G 24 month contract - 4G Unlimited minutes Unlimited texts 10GB data </p> £45.99 per month £1103.76 total cost uSwitch exclusive Double speed 4G £45.99 per month £1103.76 total cost See deal
d6a67c423489511afe53668f351cab32
4
10-11-2016 16:04
4
Samsung Galaxy S7 32GB Gold £10.00 upfront £125 iTunes or Amazon Gift Card
Unlimited minutes Unlimited texts 15GB data
24 month contract - 4G
50.00
BT Mobile
BT Mobile
24 month contract - 4G Samsung Galaxy S7 32GB Gold £10.00 upfront £125 iTunes or Amazon Gift Card 24 month contract - 4G Unlimited minutes Unlimited texts 15GB data </p> £50.00 per month £1210.00 total cost £125 iTunes or Amazon Gift Card £50.00 per month £1210.00 total cost See deal
2f9fa72f89754e93601b40b568791302
5
10-11-2016 16:04
5
Samsung Galaxy S7 32GB Gold FREE uSwitch Exclusive £20 cashback Double speed 4G
Unlimited minutes Unlimited texts 5GB data
24 month contract - 4G
35.99
EE
Metrofone
24 month contract - 4G Samsung Galaxy S7 32GB Gold FREE uSwitch Exclusive £20 cashback Double speed 4G 24 month contract - 4G Unlimited minutes Unlimited texts 5GB data </p> £35.99 per month £843.76 total cost uSwitch Exclusive £20 cashback Double speed 4G £35.99 per month £843.76 total cost See deal
dadca04f07ca2f84e8fb02b98d47c53f
6
10-11-2016 16:04
6
Samsung Galaxy S7 32GB Gold £50.00 upfront
Unlimited minutes Unlimited texts 3GB data
24 month contract - 4G
28.00
Vodafone
Mobiles.co.uk
24 month contract - 4G Samsung Galaxy S7 32GB Gold £50.00 upfront 24 month contract - 4G Unlimited minutes Unlimited texts 3GB data </p> £28.00 per month £722.00 total cost £28.00 per month £722.00 total cost See deal
4f3c89b1a1424262cdc433cb30272e90
7
10-11-2016 16:04
7
Samsung Galaxy S7 32GB Gold FREE Double speed 4G
Unlimited minutes Unlimited texts 5GB data
24 month contract - 4G
35.99
EE
Carphone Warehouse
24 month contract - 4G Samsung Galaxy S7 32GB Gold FREE Double speed 4G 24 month contract - 4G Unlimited minutes Unlimited texts 5GB data </p> £35.99 per month £863.76 total cost Double speed 4G £35.99 per month £863.76 total cost See deal
99b1a24b92e69b7ede5ab93cf2027627
8
10-11-2016 16:04
8
Samsung Galaxy S7 32GB Gold £35.00 upfront
Unlimited minutes Unlimited texts 3GB data
24 month contract - 4G
28.50
O2
Mobiles.co.uk
24 month contract - 4G Samsung Galaxy S7 32GB Gold £35.00 upfront 24 month contract - 4G Unlimited minutes Unlimited texts 3GB data </p> £28.50 per month £719.00 total cost £28.50 per month £719.00 total cost See deal
f8596fff04100e960006ee978990c2d0
9
10-11-2016 16:04
9
Samsung Galaxy S7 32GB Gold FREE Double speed 4G
Unlimited minutes Unlimited texts 5GB data
24 month contract - 4G
35.99
EE
Affordable Mobiles
24 month contract - 4G Samsung Galaxy S7 32GB Gold FREE Double speed 4G 24 month contract - 4G Unlimited minutes Unlimited texts 5GB data </p> £35.99 per month £863.76 total cost Double speed 4G £35.99 per month £863.76 total cost See deal
ca2072480bad49a971c17efabfde17ac
10
10-11-2016 16:04
10
Samsung Galaxy S7 32GB Gold £10.00 upfront
Unlimited minutes Unlimited texts 5GB data
24 month contract - 4G
35.00
O2
Mobiles.co.uk
24 month contract - 4G Samsung Galaxy S7 32GB Gold £10.00 upfront 24 month contract - 4G Unlimited minutes Unlimited texts 5GB data </p> £35.00 per month £850.00 total cost £35.00 per month £850.00 total cost See deal
4e9ff9ca41c2b3e40fb8c77417a2ea71

Statistics

Average successful run time: 14 minutes

Total run time: 3 days

Total cpu time used: about 2 hours

Total disk space used: 30.5 MB

History

  • Auto ran revision 2c5bfb5b and completed successfully .
    1101 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision 2c5bfb5b and completed successfully .
    1101 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 2c5bfb5b and completed successfully .
    1101 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision 2c5bfb5b and completed successfully .
    1111 records added, 1 record updated in the database
    344 pages scraped
  • Auto ran revision 2c5bfb5b and completed successfully .
    1111 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 2c5bfb5b and completed successfully .
    1111 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran and failed .
  • Manually ran revision 2c5bfb5b and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran and failed .
  • Manually ran and failed .
  • Manually ran revision 2c5bfb5b and completed successfully .
    nothing changed in the database
    172 pages scraped
  • Auto ran revision 2c5bfb5b and completed successfully .
    nothing changed in the database
    172 pages scraped
  • Auto ran revision 2c5bfb5b and completed successfully .
    nothing changed in the database
    172 pages scraped
  • Auto ran revision 2c5bfb5b and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 2c5bfb5b and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 2c5bfb5b and failed .
    310 records added, 1 record updated in the database
    46 pages scraped
  • Auto ran revision 2c5bfb5b and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 2c5bfb5b and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision 2c5bfb5b and completed successfully .
    1120 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision 2c5bfb5b and completed successfully .
    1120 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 2c5bfb5b and completed successfully .
    1120 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 2c5bfb5b and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision 0d548963 and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 0d548963 and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision 0d548963 and failed .
    nothing changed in the database
  • Manually ran revision 0d548963 and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 0d548963 and completed successfully .
    543 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision d1f45b32 and completed successfully .
    543 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision d1f45b32 and completed successfully .
    543 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision d1f45b32 and completed successfully .
    543 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision d1f45b32 and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision d1f45b32 and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision d1f45b32 and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision d1f45b32 and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 583d8a93 and completed successfully .
    1110 records added, 1 record updated in the database
  • Manually ran revision 583d8a93 and completed successfully .
    1111 records added in the database
    172 pages scraped
  • Manually ran revision 583d8a93 and completed successfully .
    1110 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision f5f31c2b and completed successfully .
    1031 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 4865b73a and completed successfully .
    1023 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision 4865b73a and completed successfully .
    1021 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 4865b73a and completed successfully .
    1021 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision 4865b73a and completed successfully .
    1023 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 4865b73a and completed successfully .
    1027 records added, 1 record updated in the database
    172 pages scraped
  • Auto ran revision 4865b73a and completed successfully .
    1023 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 4865b73a and completed successfully .
    1026 records added, 1 record updated in the database
    172 pages scraped
  • Manually ran revision 3eaa3f6d and completed successfully .
    1018 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision 262ca4d6 and completed successfully .
    981 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    982 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    989 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    994 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision 262ca4d6 and completed successfully .
    1001 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision 262ca4d6 and completed successfully .
    1005 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    997 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    991 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision 262ca4d6 and completed successfully .
    991 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    982 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    1001 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision 262ca4d6 and completed successfully .
    989 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision 262ca4d6 and completed successfully .
    989 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    996 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    996 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    997 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    1005 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    1005 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision 262ca4d6 and completed successfully .
    999 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    998 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    1001 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision 262ca4d6 and completed successfully .
    1008 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision 262ca4d6 and completed successfully .
    999 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision 262ca4d6 and completed successfully .
    nothing changed in the database
    171 pages scraped
  • Manually ran and failed .
  • Manually ran revision deff5292 and completed successfully .
    nothing changed in the database
    171 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    nothing changed in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    999 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    nothing changed in the database
    171 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    985 records added, 1 record updated in the database
    345 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    985 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    991 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    990 records added, 1 record updated in the database
    342 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    987 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    994 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    992 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    992 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    996 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    1007 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    994 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    994 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    997 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    1000 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    1002 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    nothing changed in the database
    171 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    nothing changed in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    996 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    1002 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    987 records added, 1 record updated in the database
    171 pages scraped
  • Auto ran revision deff5292 and completed successfully .
    984 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    983 records added, 1 record updated in the database
    171 pages scraped
  • Manually ran revision deff5292 and completed successfully .
    983 records added in the database
    171 pages scraped
  • Manually ran revision 8b37a022 and completed successfully .
    689 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision 8b37a022 and completed successfully .
    681 records added, 1 record updated in the database
    132 pages scraped
  • Manually ran revision 8b37a022 and completed successfully .
    681 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision 8b37a022 and completed successfully .
    680 records added, 1 record updated in the database
    132 pages scraped
  • Manually ran revision 8b37a022 and completed successfully .
    694 records added, 1 record updated in the database
    132 pages scraped
  • Manually ran revision 8b37a022 and completed successfully .
    nothing changed in the database
    132 pages scraped
  • Manually ran and failed .
  • Auto ran revision 8b37a022 and completed successfully .
    693 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision 8b37a022 and completed successfully .
    688 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision 8b37a022 and completed successfully .
    689 records added, 1 record updated in the database
    132 pages scraped
  • Manually ran revision 8b37a022 and completed successfully .
    702 records added, 1 record updated in the database
    132 pages scraped
  • Manually ran revision 8b37a022 and completed successfully .
    702 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision 8b37a022 and completed successfully .
    692 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision 8b37a022 and completed successfully .
    nothing changed in the database
    132 pages scraped
  • Manually ran revision 8b37a022 and completed successfully .
    nothing changed in the database
    132 pages scraped
  • Manually ran revision 8b37a022 and completed successfully .
    nothing changed in the database
    132 pages scraped
  • Auto ran revision 8b37a022 and completed successfully .
    nothing changed in the database
    132 pages scraped
  • Manually ran revision 8b37a022 and completed successfully .
    694 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision 8b37a022 and completed successfully .
    701 records added, 1 record updated in the database
    132 pages scraped
  • Manually ran revision 8b37a022 and completed successfully .
    702 records added, 1 record updated in the database
    264 pages scraped
  • Manually ran revision 8b37a022 and completed successfully .
    694 records added, 1 record updated in the database
    132 pages scraped
  • Manually ran revision ec14ee38 and completed successfully .
    679 records added, 1 record updated in the database
    132 pages scraped
  • Manually ran revision ec14ee38 and completed successfully .
    681 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    681 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    688 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    688 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    697 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    696 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    699 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    701 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    699 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    698 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    705 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    696 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    694 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    694 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    694 records added, 1 record updated in the database
    132 pages scraped
  • Manually ran revision ec14ee38 and completed successfully .
    699 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    699 records added, 1 record updated in the database
    133 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    699 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    583 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision ec14ee38 and completed successfully .
    583 records added, 1 record updated in the database
    132 pages scraped
  • Manually ran revision ec14ee38 and completed successfully .
    583 records added, 1 record updated in the database
    132 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    558 records added, 1 record updated in the database
    117 pages scraped
  • Manually ran revision 77a1e41f and completed successfully .
    578 records added in the database
    117 pages scraped
  • Manually ran revision 77a1e41f and completed successfully .
    577 records added, 1 record updated in the database
    119 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    580 records added, 1 record updated in the database
    118 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    117 pages scraped
  • Manually ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    117 pages scraped
  • Auto ran and failed .
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    576 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    583 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    581 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    577 records added, 1 record updated in the database
    116 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    578 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    581 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    597 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    591 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    603 records added, 1 record updated in the database
    117 pages scraped
  • Manually ran revision 77a1e41f and completed successfully .
    604 records added, 1 record updated in the database
    116 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    116 pages scraped
  • Manually ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    116 pages scraped
  • Auto ran revision 77a1e41f and failed .
    nothing changed in the database
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    582 records added, 1 record updated in the database
    117 pages scraped
  • Manually ran revision 77a1e41f and completed successfully .
    582 records added, 1 record updated in the database
    117 pages scraped
  • Manually ran revision 77a1e41f and completed successfully .
    580 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
  • Auto ran revision 77a1e41f and completed successfully .
    576 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    116 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
  • Auto ran revision 77a1e41f and completed successfully .
    573 records added, 1 record updated in the database
    116 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    nothing changed in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    563 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    568 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    573 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    572 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    583 records added, 1 record updated in the database
    135 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    579 records added, 1 record updated in the database
    117 pages scraped
  • Auto ran revision 77a1e41f and completed successfully .
    577 records added, 1 record updated in the database
  • Manually ran revision 77a1e41f and completed successfully .
    574 records added, 1 record updated in the database
  • Auto ran revision 77a1e41f and completed successfully .
    571 records added, 1 record updated in the database
  • Auto ran revision 77a1e41f and completed successfully .
    577 records added, 1 record updated in the database
  • Auto ran revision 77a1e41f and completed successfully .
    576 records added, 1 record updated in the database
  • Auto ran revision 77a1e41f and completed successfully .
    572 records added, 1 record updated in the database
  • Auto ran revision 77a1e41f and completed successfully .
    572 records added, 1 record updated in the database
  • Manually ran revision 77a1e41f and completed successfully .
    577 records added in the database
  • Manually ran revision 42399c7e and completed successfully .
    576 records added, 1 record updated in the database
  • Manually ran revision 035a4874 and completed successfully .
    576 records added, 1 record updated in the database
  • Auto ran revision d1c11730 and completed successfully .
    467 records added, 1 record updated in the database
  • Manually ran revision d1c11730 and completed successfully .
    467 records added, 1 record updated in the database
  • Auto ran revision d1c11730 and completed successfully .
    464 records added, 1 record updated in the database
  • Manually ran revision d1c11730 and completed successfully .
    451 records added, 1 record updated in the database
  • Auto ran and failed .
  • Auto ran revision d1c11730 and completed successfully .
    452 records added, 1 record updated in the database
  • Auto ran revision d1c11730 and completed successfully .
    440 records added, 1 record updated in the database
  • Auto ran revision d1c11730 and completed successfully .
    440 records added, 1 record updated in the database
    117 pages scraped
  • Manually ran revision 2ee332f7 and completed successfully .
    400 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    406 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    410 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    407 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    424 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    426 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    417 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    417 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    433 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    436 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    433 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    417 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    405 records added in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    411 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    416 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    423 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    418 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    431 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    433 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    420 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    435 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    438 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    436 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    442 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    414 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    406 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    420 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    420 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    416 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    421 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    428 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    454 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    446 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    456 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    454 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    454 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    449 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    445 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    442 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    445 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    455 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    439 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    441 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    445 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    443 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    437 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    452 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    452 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    464 records added in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    463 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    463 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    448 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    444 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    448 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    446 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    445 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    447 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    451 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    467 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    468 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    471 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    479 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    494 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    491 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    489 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    489 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    492 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    nothing changed in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    485 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    486 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    490 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    494 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    510 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    503 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    492 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    490 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    483 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    488 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    488 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    488 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    484 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    484 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    495 records added, 1 record updated in the database
  • Auto ran revision 2ee332f7 and completed successfully .
    479 records added, 1 record updated in the database
  • Manually ran revision 2ee332f7 and completed successfully .
    479 records added, 1 record updated in the database
  • Auto ran revision a329c6a5 and completed successfully .
    452 records added, 1 record updated in the database
  • Auto ran revision a329c6a5 and completed successfully .
    454 records added, 1 record updated in the database
  • Auto ran revision a329c6a5 and completed successfully .
    430 records added, 1 record updated in the database
  • Manually ran revision a329c6a5 and completed successfully .
    439 records added, 1 record updated in the database
  • Manually ran revision a329c6a5 and completed successfully .
    444 records added, 1 record updated in the database
  • Auto ran revision a329c6a5 and completed successfully .
    453 records added, 1 record updated in the database
  • Manually ran revision a329c6a5 and completed successfully .
    472 records added, 1 record updated in the database
  • Auto ran revision a329c6a5 and completed successfully .
    491 records added, 1 record updated in the database
  • Manually ran revision a329c6a5 and completed successfully .
    492 records added in the database
  • Auto ran revision 3d9346f2 and completed successfully .
    491 records added, 1 record updated in the database
  • Manually ran revision 3d9346f2 and completed successfully .
    513 records added, 1 record updated in the database
  • Auto ran revision 3d9346f2 and completed successfully .
    508 records added, 1 record updated in the database
  • Manually ran revision 3d9346f2 and completed successfully .
    508 records added, 1 record updated in the database
  • Manually ran revision 3d9346f2 and completed successfully .
    506 records added, 1 record updated in the database
  • Manually ran revision 3d9346f2 and completed successfully .
    505 records added, 1 record updated in the database
  • Auto ran revision 3d9346f2 and completed successfully .
    510 records added, 1 record updated in the database
  • Auto ran revision 3d9346f2 and completed successfully .
    512 records added, 1 record updated in the database
  • Auto ran revision 3d9346f2 and completed successfully .
    494 records added, 1 record updated in the database
  • Manually ran revision 640cd1e9 and completed successfully .
    484 records added, 1 record updated in the database
  • Auto ran revision 056e046b and completed successfully .
    473 records added, 1 record updated in the database
  • Auto ran revision 056e046b and completed successfully .
    492 records added, 1 record updated in the database
  • Manually ran revision 056e046b and completed successfully .
    475 records added in the database
  • Manually ran revision df32ae4b and completed successfully .
    475 records added in the database
  • Manually ran revision df32ae4b and completed successfully .
    475 records added, 1 record updated in the database
  • Manually ran revision c4da2aea and completed successfully .
    475 records added, 1 record updated in the database
  • Manually ran revision 156334f5 and completed successfully .
    444 records added, 1 record updated in the database
  • Auto ran revision 156334f5 and completed successfully .
    406 records added, 1 record updated in the database
  • Auto ran revision 156334f5 and completed successfully .
    400 records added, 1 record updated in the database
  • Auto ran revision 156334f5 and completed successfully .
    400 records added, 1 record updated in the database
  • Auto ran revision 156334f5 and completed successfully .
    390 records added, 1 record updated in the database
  • Manually ran revision 156334f5 and completed successfully .
    391 records added in the database
  • Manually ran revision 758fa137 and completed successfully .
    387 records added in the database
  • Manually ran revision 2caf2ead and completed successfully .
    383 records added in the database
  • Manually ran revision 20ef0c11 and completed successfully .
    383 records added in the database
  • Manually ran revision 59e6cb09 and completed successfully .
    nothing changed in the database
  • Manually ran revision 4b70ad1c and failed .
    nothing changed in the database
  • Manually ran revision 4f75f26e and completed successfully .
    nothing changed in the database
  • Auto ran revision db7bd3ed and completed successfully .
    399 records added, 1 record updated in the database
  • Manually ran revision db7bd3ed and completed successfully .
    398 records added, 1 record updated in the database
  • Manually ran revision ab07a759 and completed successfully .
    398 records added in the database
  • Manually ran revision ab07a759 and completed successfully .
    377 records added in the database
  • Manually ran revision ab07a759 and completed successfully .
    385 records added, 1 record updated in the database
  • Manually ran revision ab07a759 and completed successfully .
    384 records added in the database
  • Manually ran revision 306b8cd6 and completed successfully .
    381 records added in the database
  • Manually ran revision b9fe272a and completed successfully .
    375 records added, 1 record updated in the database
  • Auto ran revision a789cd6b and completed successfully .
    370 records added, 1 record updated in the database
    103 pages scraped
  • Auto ran revision a789cd6b and completed successfully .
    372 records added, 1 record updated in the database
  • Auto ran revision a789cd6b and completed successfully .
    364 records added, 1 record updated in the database
  • Auto ran revision a789cd6b and completed successfully .
    338 records added, 1 record updated in the database
  • Auto ran revision a789cd6b and completed successfully .
    331 records added, 1 record updated in the database
  • Auto ran revision 4dbed405 and completed successfully .
    334 records added, 1 record updated in the database
  • Auto ran revision 4dbed405 and completed successfully .
    334 records added, 1 record updated in the database
  • Manually ran revision 4dbed405 and completed successfully .
    328 records added, 1 record updated in the database
  • Manually ran revision 4dbed405 and completed successfully .
    333 records added in the database
  • Auto ran revision 4dbed405 and completed successfully .
    332 records added, 1 record updated in the database
  • Manually ran revision 4dbed405 and completed successfully .
    333 records added in the database
  • Manually ran revision 49560985 and completed successfully .
    189 records added in the database
  • Manually ran revision 49560985 and completed successfully .
    1705 records removed, 189 records updated in the database
  • Manually ran revision c6abfd3f and completed successfully .
    163 records added, 1 record updated in the database
  • Auto ran revision c6abfd3f and completed successfully .
    169 records added, 1 record updated in the database
  • Auto ran revision c6abfd3f and completed successfully .
    166 records added, 1 record updated in the database
  • Manually ran revision c6abfd3f and completed successfully .
    166 records added, 1 record updated in the database
  • Manually ran revision c6abfd3f and completed successfully .
    167 records added, 1 record updated in the database
  • Auto ran revision 11b79297 and completed successfully .
    173 records added, 1 record updated in the database
  • Manually ran revision 11b79297 and completed successfully .
    173 records added, 1 record updated in the database
  • Manually ran revision 11b79297 and completed successfully .
    173 records added, 1 record updated in the database
  • Auto ran revision 2704e28b and completed successfully .
    179 records added, 1 record updated in the database
  • Manually ran revision 2704e28b and completed successfully .
    179 records added, 1 record updated in the database
  • Manually ran revision 093554fa and completed successfully .
    186 records added in the database
  • Manually ran revision 33b05eb8 and completed successfully .
    186 records added in the database
  • Manually ran revision 6a9c8a60 and completed successfully .
    189 records added in the database
  • Manually ran revision d575f036 and completed successfully .
    166 records added in the database
  • Manually ran revision d08d6e5c and completed successfully .
    166 records added in the database
  • Manually ran revision f754e668 and completed successfully .
    61 records added in the database
  • Manually ran revision 9f9bc8de and completed successfully .
    61 records added in the database
  • Manually ran revision 03fba7c9 and failed .
    52 records added in the database
  • Manually ran revision 45c0d8b3 and completed successfully .
    61 records added in the database
  • Manually ran revision d8b1807e and completed successfully .
    61 records added in the database
  • Created on morph.io

Scraper code

PHP

PositionAnalyser / scraper.php