This is a scraper that runs on Morph. To get started see the documentation

Contributors Kooben209

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 3 is python-3.6.2 (you are using python-3.6.4, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-3.6.2).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-3.6.4 -----> Installing pip -----> Installing requirements with pip  Obtaining scraperwiki from git+http://github.com/andylolz/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 1))  Cloning http://github.com/andylolz/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki  Running command git clone -q http://github.com/andylolz/scraperwiki-python.git /app/.heroku/src/scraperwiki  Running command git checkout -b morph_defaults --track origin/morph_defaults  Switched to a new branch 'morph_defaults'  Branch morph_defaults set up to track remote branch morph_defaults from origin.  Collecting beautifulsoup4==4.6.3  Downloading https://files.pythonhosted.org/packages/21/0a/47fdf541c97fd9b6a610cb5fd518175308a7cc60569962e776ac52420387/beautifulsoup4-4.6.3-py3-none-any.whl (90kB)  Collecting requests  Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB)  Collecting six  Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl  Collecting sqlalchemy  Downloading https://files.pythonhosted.org/packages/14/0e/487f7fc1e432cec50d2678f94e4133f2b9e9356e35bacc30d73e8cb831fc/SQLAlchemy-1.3.10.tar.gz (6.0MB)  Collecting alembic  Downloading https://files.pythonhosted.org/packages/6f/42/48447bf41287bc577e4f340e7c28578e322567f5622a915bdfa01c83dc76/alembic-1.2.1.tar.gz (1.1MB)  Collecting chardet<3.1.0,>=3.0.2  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting certifi>=2017.4.17  Downloading https://files.pythonhosted.org/packages/18/b0/8146a4f8dd402f60744fa380bc73ca47303cccf8b9190fd16a827281eac2/certifi-2019.9.11-py2.py3-none-any.whl (154kB)  Collecting idna<2.9,>=2.5  Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)  Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1  Downloading https://files.pythonhosted.org/packages/e0/da/55f51ea951e1b7c63a579c09dd7db825bb730ec1fe9c0180fc77bfb31448/urllib3-1.25.6-py2.py3-none-any.whl (125kB)  Collecting Mako  Downloading https://files.pythonhosted.org/packages/b0/3c/8dcd6883d009f7cae0f3157fb53e9afb05a0d3d33b3db1268ec2e6f4a56b/Mako-1.1.0.tar.gz (463kB)  Collecting python-editor>=0.3  Downloading https://files.pythonhosted.org/packages/c6/d3/201fc3abe391bbae6606e6f1d598c15d367033332bd54352b12f35513717/python_editor-1.0.4-py3-none-any.whl  Collecting python-dateutil  Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB)  Collecting MarkupSafe>=0.9.2  Downloading https://files.pythonhosted.org/packages/b2/5f/23e0023be6bb885d00ffbefad2942bc51a620328ee910f64abe5a8d18dd1/MarkupSafe-1.1.1-cp36-cp36m-manylinux1_x86_64.whl  Building wheels for collected packages: sqlalchemy, alembic, Mako  Building wheel for sqlalchemy (setup.py): started  Building wheel for sqlalchemy (setup.py): finished with status 'done'  Created wheel for sqlalchemy: filename=SQLAlchemy-1.3.10-cp36-cp36m-linux_x86_64.whl size=1187103 sha256=d9f57c9e85ae661e4314b7a7f09f1fc48a6ac129d37cff4755f91565dc0d2749  Stored in directory: /tmp/pip-ephem-wheel-cache-f2xjtz1t/wheels/4b/b2/89/cd2231ee623987c605f049df55f40a3e4252ef6a15b94836c2  Building wheel for alembic (setup.py): started  Building wheel for alembic (setup.py): finished with status 'done'  Created wheel for alembic: filename=alembic-1.2.1-py2.py3-none-any.whl size=144229 sha256=d6f2fdf6776f6e5c49ce8a0520be8789008225c2fab5a7c4de392ced17fb1252  Stored in directory: /tmp/pip-ephem-wheel-cache-f2xjtz1t/wheels/c6/b8/fd/1f16371156a8184172c4935cbbef6a345d57dd447e31a36633  Building wheel for Mako (setup.py): started  Building wheel for Mako (setup.py): finished with status 'done'  Created wheel for Mako: filename=Mako-1.1.0-cp36-none-any.whl size=75363 sha256=132084fb6491e8cda060c165beda881e5728b47579ea3ee1393ba2bf45776da4  Stored in directory: /tmp/pip-ephem-wheel-cache-f2xjtz1t/wheels/98/32/7b/a291926643fc1d1e02593e0d9e247c5a866a366b8343b7aa27  Successfully built sqlalchemy alembic Mako  Installing collected packages: chardet, certifi, idna, urllib3, requests, six, sqlalchemy, MarkupSafe, Mako, python-editor, python-dateutil, alembic, scraperwiki, beautifulsoup4  Running setup.py develop for scraperwiki  Successfully installed Mako-1.1.0 MarkupSafe-1.1.1 alembic-1.2.1 beautifulsoup4-4.6.3 certifi-2019.9.11 chardet-3.0.4 idna-2.8 python-dateutil-2.8.0 python-editor-1.0.4 requests-2.22.0 scraperwiki six-1.12.0 sqlalchemy-1.3.10 urllib3-1.25.6   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Found 3 Matches from 3 Items of which 0 are Featured Traceback (most recent call last): File "scraper.py", line 148, in <module> price = parseAskingPrice(advert.find("span", {"class" : "amount"}).text) AttributeError: 'NoneType' object has no attribute 'text'

Data

Downloaded 778 times by Kooben209 IYSIL123

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (536 KB) Use the API

rows 10 / 507

propId link title address price displayPrice image1 pubDate addedOrReduced reduced location hashTagLocation postContent
151W1JPm11181k
Adair Road, London, W10
375000
£375,000
//img-uk-1.trovit.com/151W1JPm11181k/151W1JPm11181k.1_10.jpg
2019-07-11T15:57:34+00:00
2019-07-11
false
UK
UK
Just added to our curated list of the latest UK distressed and repossessed property for sale is this Adair Road, London, W10 - £375,000. Follow the UK Distressed Property FB page and join the UK Distressed Property group to receive FREE distressed property listings. #UKDistressedProperty #UKDistressedProperty
1B1x1Lh1P138T
3 Bed Semi-Detached For Sale Aurania Avenue Norwich
NR1 2RD, Norwich, Norfolk, East of England
290000
£290,000
//img-uk-1.trovit.com/1B1x1Lh1P138T/1B1x1Lh1P138T.1_10.jpg
2019-07-11T15:57:34+00:00
2019-07-11
false
Norfolk
Norfolk
Just added to our curated list of the latest UK distressed and repossessed property for sale is this 3 Bed Semi-Detached For Sale Aurania Avenue Norwich - £290,000. Follow the UK Distressed Property FB page and join the UK Distressed Property group to receive FREE distressed property listings. #UKDistressedProperty #NorfolkDistressedProperty
1Sqig1H1q18W
8 bedroom property for sale
GU25, Runnymede, Surrey, South East
17000000
£17,000,000
//img-uk-1.trovit.com/1Sqig1H1q18W/1Sqig1H1q18W.1_10.jpg
2019-07-11T15:57:45+00:00
2019-07-11
false
Surrey
Surrey
Just added!!! Identified as a Distressed Property is this 8 bedroom property for sale in Surrey on the market at £17,000,000. #UKDistressedProperty #SurreyDistressedProperty
1G181Yuy1ec1n
15 bedroom house share for sale
Alexander House, 72-77 St Matthew's Street, Ipswich Ip1, Ip1 3Ew
1600000
£1,600,000
//img-uk-1.trovit.com/1G181Yuy1ec1n/1G181Yuy1ec1n.1_10.jpg
2019-07-11T15:57:45+00:00
2019-07-11
false
Ipswich Ip1
IpswichIp1
Just added to our curated list of the latest UK distressed and repossessed property for sale is this 15 bedroom house share for sale - £1,600,000. Follow the UK Distressed Property FB page and join the UK Distressed Property group to receive FREE distressed property listings. #UKDistressedProperty #IpswichIp1DistressedProperty
10SxKE1O1W1I
Morton Road, Exmouth EX8, 12 bedroom
EX8 1BA, Exmouth, East Devon, Devon, South West England
475000
£475,000
//img-uk-1.trovit.com/10SxKE1O1W1I/10SxKE1O1W1I.1_10.jpg
2019-07-11T15:57:57+00:00
2019-07-11
false
Devon
Devon
Just added to our curated list of the latest UK distressed and repossessed property for sale is this Morton Road, Exmouth EX8, 12 bedroom - £475,000. #UKDistressedProperty #DevonDistressedProperty
1j1bT1r1D1Of1e
Radipole Terrace, Lodmoor, Weymouth DT4, 3 bedroom bungalow
DT4 7LR, Dorset, South West England
225000
£225,000
//img-uk-1.trovit.com/1j1bT1r1D1Of1e/1j1bT1r1D1Of1e.1_10.jpg
2019-07-11T15:57:57+00:00
2019-07-11
false
Dorset
Dorset
#DorsetDistressedProperty, Just added to our curated list of the latest UK distressed and repossessed property for sale is this Radipole Terrace, Lodmoor, Weymouth DT4, 3 bedroom bungalow - £225,000. Follow the UK Distressed Property FB page and join the UK Distressed Property group to receive FREE distressed property listings. #UKDistressedProperty
1pZ7D1K1-1lb
2 bedroom property for sale
PL27, Wadebridge, Cornwall, South West England
135000
£135,000
//img-uk-1.trovit.com/1pZ7D1K1-1lb/1pZ7D1K1-1lb.1_10.jpg
2019-07-11T15:57:57+00:00
2019-07-11
false
Cornwall
Cornwall
Just added to our curated list of the latest UK distressed and repossessed property for sale is this 2 bedroom property for sale - £135,000. Follow the UK Distressed Property FB page and join the UK Distressed Property group to receive FREE distressed property listings. #UKDistressedProperty #CornwallDistressedProperty
1l11Ng101ie1X
2 Bed Property For Sale Stewart Street Barrow in Furness
LA14 2QB, Barrow-in-Furness, Cumbria, North West England
35000
£35,000
2019-07-11T15:57:57+00:00
2019-07-11
false
Cumbria
Cumbria
Potential #BMV!!!! UK Distressed Property has found this 2 Bed Property For Sale Stewart Street Barrow in Furness in Cumbria - £35,000. #UKDistressedProperty #CumbriaDistressedProperty
K1mG1W1y1w1v1x
2 bedroom semi-detached house for sale
Windermere Road, Seaham, Sr7, Sr7 8Jh
55000
£55,000
2019-07-11T15:57:57+00:00
2019-07-11
false
Sr7
Sr7
Just added!!! Identified as a Distressed Property is this 2 bedroom semi-detached house for sale in Sr7 on the market at £55,000. #UKDistressedProperty #Sr7DistressedProperty
1jr1mU1I1l1r9
4 Bed Land For Sale Shyshack Lane Basingstoke
RG26 5NH, Basingstoke and Deane, Hampshire, South East
185000
£185,000
2019-07-11T15:57:57+00:00
2019-07-11
false
Hampshire
Hampshire
***Distressed Property Alert*** UK Distressed Property has identified this 4 Bed Land For Sale Shyshack Lane Basingstoke at an asking price of £185,000 in Hampshire. #UKDistressedProperty #HampshireDistressedProperty

Statistics

Average successful run time: 2 minutes

Total run time: about 3 hours

Total cpu time used: 4 minutes

Total disk space used: 571 KB

History

  • Auto ran revision 256df056 and failed .
    1 record added in the database
  • Auto ran revision 256df056 and failed .
    nothing changed in the database
  • Auto ran revision 256df056 and failed .
    nothing changed in the database
  • Auto ran revision 256df056 and failed .
    2 records added in the database
  • Auto ran revision 256df056 and failed .
    1 record added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

DP-TRV / scraper.py