Kooben209 / OT-PP

Scrapes www.onthemarket.com

The most uncluttered, user-friendly property portal. Find hundreds of 1000s of properties for sale & to rent from leading UK estate agents | OnTheMarket


This is a scraper that runs on Morph. To get started see the documentation

Contributors Kooben209

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Requesting results for Oxford numOfResults= 21 numOfPages= 1 Requesting results for Oxford numOfResults= 21 numOfPages= 1 Requesting results for Oxford numOfResults= 21 numOfPages= 1 Requesting results for Oxford numOfResults= 21 numOfPages= 1 Found 0 Matches in this search of Oxford Requesting results for Newcastle numOfResults= 23 numOfPages= 1 Found 0 Matches in this search of Newcastle Requesting results for Liverpool numOfResults= 88 numOfPages= 4 Found 0 Matches in this search of Newcastle Requesting results for Liverpool numOfResults= 88 numOfPages= 4 Found 0 Matches in this search of Liverpool Requesting results for Surrey numOfResults= 684 numOfPages= 29 Found 0 Matches in this search of Liverpool Requesting results for Surrey numOfResults= 684 numOfPages= 29 Found 0 Matches in this search of Liverpool Requesting results for Surrey numOfResults= 684 numOfPages= 29 Found 0 Matches in this search of Liverpool Requesting results for Surrey numOfResults= 684 numOfPages= 29 Found Match 6574624 Found 1 Matches in this search of Surrey Requesting results for Bournemouth numOfResults= 40 numOfPages= 2 Found 0 Matches in this search of Bournemouth Requesting results for Hampshire numOfResults= 369 numOfPages= 16 Found Match 6574624 Found 1 Matches in this search of Surrey Requesting results for Bournemouth numOfResults= 40 numOfPages= 2 Found 0 Matches in this search of Bournemouth Requesting results for Hampshire numOfResults= 369 numOfPages= 16 Found Match 6574624 Found 1 Matches in this search of Surrey Requesting results for Bournemouth numOfResults= 40 numOfPages= 2 Found 0 Matches in this search of Bournemouth Requesting results for Hampshire numOfResults= 369 numOfPages= 16 Found Match 6574624 Found 1 Matches in this search of Surrey Requesting results for Bournemouth numOfResults= 40 numOfPages= 2 Found 0 Matches in this search of Bournemouth Requesting results for Hampshire numOfResults= 369 numOfPages= 16 Found 0 Matches in this search of Hampshire Requesting results for Harrogate numOfResults= 23 numOfPages= 1 Found 0 Matches in this search of Harrogate Requesting results for Bolton numOfResults= 39 numOfPages= 2 Found 0 Matches in this search of Bolton Requesting results for Leeds numOfResults= 156 numOfPages= 7 Found 0 Matches in this search of Leeds Requesting results for Leicestershire numOfResults= 139 numOfPages= 6 Found 0 Matches in this search of Leicestershire Requesting results for Hertfordshire numOfResults= 148 numOfPages= 7 Found 0 Matches in this search of Hampshire Requesting results for Harrogate numOfResults= 23 numOfPages= 1 Found 0 Matches in this search of Harrogate Requesting results for Bolton numOfResults= 39 numOfPages= 2 Found 0 Matches in this search of Bolton Requesting results for Leeds numOfResults= 156 numOfPages= 7 Found 0 Matches in this search of Leeds Requesting results for Leicestershire numOfResults= 139 numOfPages= 6 Found 0 Matches in this search of Leicestershire Requesting results for Hertfordshire numOfResults= 148 numOfPages= 7 Found 0 Matches in this search of Hampshire Requesting results for Harrogate numOfResults= 23 numOfPages= 1 Found 0 Matches in this search of Harrogate Requesting results for Bolton numOfResults= 39 numOfPages= 2 Found 0 Matches in this search of Bolton Requesting results for Leeds numOfResults= 156 numOfPages= 7 Found 0 Matches in this search of Leeds Requesting results for Leicestershire numOfResults= 139 numOfPages= 6 Found 0 Matches in this search of Leicestershire Requesting results for Hertfordshire numOfResults= 148 numOfPages= 7 Found 0 Matches in this search of Hampshire Requesting results for Harrogate numOfResults= 23 numOfPages= 1 Found 0 Matches in this search of Harrogate Requesting results for Bolton numOfResults= 39 numOfPages= 2 Found 0 Matches in this search of Bolton Requesting results for Leeds numOfResults= 156 numOfPages= 7 Found 0 Matches in this search of Leeds Requesting results for Leicestershire numOfResults= 139 numOfPages= 6 Found 0 Matches in this search of Leicestershire Requesting results for Hertfordshire numOfResults= 148 numOfPages= 7 Found 0 Matches in this search of Hertfordshire Requesting results for Bury St Edmunds numOfResults= 5 numOfPages= 1 Found 0 Matches in this search of Bury St Edmunds Requesting results for Suffolk numOfResults= 277 numOfPages= 12 Found 0 Matches in this search of Suffolk Requesting results for Peterborough numOfResults= 7 numOfPages= 1 Found 0 Matches in this search of Peterborough Requesting results for Kent numOfResults= 424 numOfPages= 18 Found 0 Matches in this search of Kent Requesting results for Exeter numOfResults= 27 numOfPages= 2 Found 0 Matches in this search of Exeter Requesting results for Coventry numOfResults= 33 numOfPages= 2 Found 0 Matches in this search of Coventry Requesting results for Bury numOfResults= 13 numOfPages= 1 Found 0 Matches in this search of Bury Requesting results for Bristol numOfResults= 53 numOfPages= 3 Found 0 Matches in this search of Bristol Requesting results for East Anglia numOfResults= 556 numOfPages= 24 Found 0 Matches in this search of Hertfordshire Requesting results for Bury St Edmunds numOfResults= 5 numOfPages= 1 Found 0 Matches in this search of Bury St Edmunds Requesting results for Suffolk numOfResults= 277 numOfPages= 12 Found 0 Matches in this search of Suffolk Requesting results for Peterborough numOfResults= 7 numOfPages= 1 Found 0 Matches in this search of Peterborough Requesting results for Kent numOfResults= 424 numOfPages= 18 Found 0 Matches in this search of Kent Requesting results for Exeter numOfResults= 27 numOfPages= 2 Found 0 Matches in this search of Exeter Requesting results for Coventry numOfResults= 33 numOfPages= 2 Found 0 Matches in this search of Coventry Requesting results for Bury numOfResults= 13 numOfPages= 1 Found 0 Matches in this search of Bury Requesting results for Bristol numOfResults= 53 numOfPages= 3 Found 0 Matches in this search of Bristol Requesting results for East Anglia numOfResults= 556 numOfPages= 24 Found 0 Matches in this search of Hertfordshire Requesting results for Bury St Edmunds numOfResults= 5 numOfPages= 1 Found 0 Matches in this search of Bury St Edmunds Requesting results for Suffolk numOfResults= 277 numOfPages= 12 Found 0 Matches in this search of Suffolk Requesting results for Peterborough numOfResults= 7 numOfPages= 1 Found 0 Matches in this search of Peterborough Requesting results for Kent numOfResults= 424 numOfPages= 18 Found 0 Matches in this search of Kent Requesting results for Exeter numOfResults= 27 numOfPages= 2 Found 0 Matches in this search of Exeter Requesting results for Coventry numOfResults= 33 numOfPages= 2 Found 0 Matches in this search of Coventry Requesting results for Bury numOfResults= 13 numOfPages= 1 Found 0 Matches in this search of Bury Requesting results for Bristol numOfResults= 53 numOfPages= 3 Found 0 Matches in this search of Bristol Requesting results for East Anglia numOfResults= 556 numOfPages= 24 Found 0 Matches in this search of Hertfordshire Requesting results for Bury St Edmunds numOfResults= 5 numOfPages= 1 Found 0 Matches in this search of Bury St Edmunds Requesting results for Suffolk numOfResults= 277 numOfPages= 12 Found 0 Matches in this search of Suffolk Requesting results for Peterborough numOfResults= 7 numOfPages= 1 Found 0 Matches in this search of Peterborough Requesting results for Kent numOfResults= 424 numOfPages= 18 Found 0 Matches in this search of Kent Requesting results for Exeter numOfResults= 27 numOfPages= 2 Found 0 Matches in this search of Exeter Requesting results for Coventry numOfResults= 33 numOfPages= 2 Found 0 Matches in this search of Coventry Requesting results for Bury numOfResults= 13 numOfPages= 1 Found 0 Matches in this search of Bury Requesting results for Bristol numOfResults= 53 numOfPages= 3 Found 0 Matches in this search of Bristol Requesting results for East Anglia numOfResults= 556 numOfPages= 24 Found 0 Matches in this search of East Anglia Requesting results for Cambridge numOfResults= 15 numOfPages= 1 Found 0 Matches in this search of Cambridge Requesting results for Middlesbrough numOfResults= 36 numOfPages= 2 Found 0 Matches in this search of Middlesbrough Requesting results for Northumberland numOfResults= 60 numOfPages= 3 Found 0 Matches in this search of Northumberland Requesting results for Reading numOfResults= 50 numOfPages= 3 Found 0 Matches in this search of Reading Requesting results for Nottingham numOfResults= 61 numOfPages= 3 Found 0 Matches in this search of Nottingham Requesting results for Putney London numOfResults= 49 numOfPages= 3 Found 0 Matches in this search of Putney London Requesting results for Birmingham numOfResults= 390 numOfPages= 17 Traceback (most recent call last): File "scraper.py", line 158, in <module> propId = advert["data-property-id"] TypeError: 'NoneType' object is not subscriptable

Data

Downloaded 1256 times by IYSIL123

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (37 KB) Use the API

rows 10 / 86

propId link title address price displayPrice image1 pubDate addedOrReduced reduced location
6211348
2 bedroom end of terrace house for sale
Windle Hall Drive, Windlehurst, St. Helens
67500
£67,500
2019-01-10T17:03:42+00:00
2019-01-10
false
Liverpool
6214664
2 bedroom detached house for sale
Burpham, Guildford
475000
£475,000
2019-01-10T23:16:13+00:00
2019-01-10
false
Surrey
6211060
2 bedroom semi-detached house for sale
Orson Drive, Wigston
175000
£175,000
2019-01-11T01:16:13+00:00
2019-01-11
false
Leicestershire
6211059
3 bedroom terraced house for sale
Earl Howe Street, Leicester
190000
£190,000
2019-01-11T01:16:24+00:00
2019-01-11
false
Leicestershire
6215685
4 bedroom end of terrace house for sale
Haleswood Road, Hemel Hempstead
425000
£425,000
2019-01-11T01:22:21+00:00
2019-01-11
false
Hertfordshire
5369748
2 bedroom ground floor flat for sale
Gough Way, Cambridge
440000
£440,000
2019-01-11T10:59:18+00:00
2019-01-11
false
Cambridge
6230545
3 bedroom detached bungalow for sale
Woodlinken Way, Verwood, BH31 6BT
325000
£325,000
2019-01-15T06:17:17+00:00
2019-01-15
false
Hampshire
6232455
5 bedroom detached house for sale
Arlington Way, Thetford
499950
£499,950
2019-01-15T07:24:17+00:00
2019-01-15
false
Suffolk
5476856
2 bedroom maisonette for sale
Whateleys Drive, Kenilworth
180000
£180,000
2019-01-15T08:41:57+00:00
2019-01-15
false
Birmingham
6243815
2 bedroom terraced house for sale
Camden Mews, Camden Square, Camden Town, NW1
1200000
£1,200,000
2019-01-17T03:47:15+00:00
2019-01-17
false
London

Statistics

Average successful run time: about 11 hours

Total run time: about 1 month

Total cpu time used: about 6 hours

Total disk space used: 113 KB

History

  • Auto ran revision b90d2d6d and failed .
    1 record added in the database
    3611 pages scraped
  • Auto ran revision b90d2d6d and completed successfully .
    nothing changed in the database
    4922 pages scraped
  • Auto ran revision b90d2d6d and completed successfully .
    1 record added in the database
    5204 pages scraped
  • Auto ran revision b90d2d6d and completed successfully .
    nothing changed in the database
    5205 pages scraped
  • Auto ran revision b90d2d6d and completed successfully .
    nothing changed in the database
    4196 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

OT-PP / scraper.py