This is a scraper that runs on Morph. To get started see the documentation

Contributors Kooben209

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 3 is python-3.6.2 (you are using python-3.6.4, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-3.6.2).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-3.6.4 -----> Installing pip -----> Installing requirements with pip  Obtaining scraperwiki from git+http://github.com/andylolz/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 1))  Cloning http://github.com/andylolz/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki  Running command git clone -q http://github.com/andylolz/scraperwiki-python.git /app/.heroku/src/scraperwiki  Running command git checkout -b morph_defaults --track origin/morph_defaults  Switched to a new branch 'morph_defaults'  Branch morph_defaults set up to track remote branch morph_defaults from origin.  Collecting beautifulsoup4==4.6.3 (from -r /tmp/build/requirements.txt (line 3))  Downloading https://files.pythonhosted.org/packages/21/0a/47fdf541c97fd9b6a610cb5fd518175308a7cc60569962e776ac52420387/beautifulsoup4-4.6.3-py3-none-any.whl (90kB)  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB)  Collecting six (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl  Collecting sqlalchemy (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/62/3c/9dda60fd99dbdcbc6312c799a3ec9a261f95bc12f2874a35818f04db2dd9/SQLAlchemy-1.3.5.tar.gz (5.9MB)  Collecting alembic (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/7b/8b/0c98c378d93165d9809193f274c3c6e2151120d955b752419c7d43e4d857/alembic-1.0.11.tar.gz (1.0MB)  Collecting idna<2.9,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)  Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/e6/60/247f23a7121ae632d62811ba7f273d0e58972d75e58a94d329d51550a47d/urllib3-1.25.3-py2.py3-none-any.whl (150kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/69/1b/b853c7a9d4f6a6d00749e94eb6f3a041e342a885b87340b79c1ef73e3a78/certifi-2019.6.16-py2.py3-none-any.whl (157kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting Mako (from alembic->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/fa/29/8016763284d8fab844224f7cc5675cb4a388ebda0eb5a403260187e48435/Mako-1.0.13.tar.gz (460kB)  Collecting python-editor>=0.3 (from alembic->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/c6/d3/201fc3abe391bbae6606e6f1d598c15d367033332bd54352b12f35513717/python_editor-1.0.4-py3-none-any.whl  Collecting python-dateutil (from alembic->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB)  Collecting MarkupSafe>=0.9.2 (from Mako->alembic->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/b2/5f/23e0023be6bb885d00ffbefad2942bc51a620328ee910f64abe5a8d18dd1/MarkupSafe-1.1.1-cp36-cp36m-manylinux1_x86_64.whl  Building wheels for collected packages: sqlalchemy, alembic, Mako  Building wheel for sqlalchemy (setup.py): started  Building wheel for sqlalchemy (setup.py): finished with status 'done'  Stored in directory: /tmp/pip-ephem-wheel-cache-qhjjdtpy/wheels/f4/74/97/23789e1e541fb3d64dc9a921a676539695b3d184cf77f5b009  Building wheel for alembic (setup.py): started  Building wheel for alembic (setup.py): finished with status 'done'  Stored in directory: /tmp/pip-ephem-wheel-cache-qhjjdtpy/wheels/8b/65/b2/9837b4422d13e739c3324c428f1b3aa9e3c3df666bb420e4b3  Building wheel for Mako (setup.py): started  Building wheel for Mako (setup.py): finished with status 'done'  Stored in directory: /tmp/pip-ephem-wheel-cache-qhjjdtpy/wheels/cc/0e/59/0e7f24103d1ebce045037aa17b75548a8387f5e7d2d0011fdc  Successfully built sqlalchemy alembic Mako  Installing collected packages: idna, urllib3, certifi, chardet, requests, six, sqlalchemy, MarkupSafe, Mako, python-editor, python-dateutil, alembic, scraperwiki, beautifulsoup4  Running setup.py develop for scraperwiki  Successfully installed Mako-1.0.13 MarkupSafe-1.1.1 alembic-1.0.11 beautifulsoup4-4.6.3 certifi-2019.6.16 chardet-3.0.4 idna-2.8 python-dateutil-2.8.0 python-editor-1.0.4 requests-2.22.0 scraperwiki six-1.12.0 sqlalchemy-1.3.5 urllib3-1.25.3   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Found 1 Matches from 2 Items of which 0 are Featured Found 9 Matches from 25 Items of which 0 are Featured Found 9 Matches from 25 Items of which 0 are Featured Found 11 Matches from 25 Items of which 0 are Featured Found 5 Matches from 25 Items of which 0 are Featured Found 5 Matches from 25 Items of which 0 are Featured Found 1 Matches from 25 Items of which 0 are Featured Found 0 Matches from 25 Items of which 0 are Featured

Data

Downloaded 319 times by Kooben209

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (145 KB) Use the API

rows 10 / 136

propId link title address price displayPrice image1 pubDate addedOrReduced reduced location hashTagLocation postContent
151W1JPm11181k
Adair Road, London, W10
375000
£375,000
//img-uk-1.trovit.com/151W1JPm11181k/151W1JPm11181k.1_10.jpg
2019-07-11T15:57:34+00:00
2019-07-11
false
UK
UK
Just added to our curated list of the latest UK distressed and repossessed property for sale is this Adair Road, London, W10 - £375,000. Follow the UK Distressed Property FB page and join the UK Distressed Property group to receive FREE distressed property listings. #UKDistressedProperty #UKDistressedProperty
1B1x1Lh1P138T
3 Bed Semi-Detached For Sale Aurania Avenue Norwich
NR1 2RD, Norwich, Norfolk, East of England
290000
£290,000
//img-uk-1.trovit.com/1B1x1Lh1P138T/1B1x1Lh1P138T.1_10.jpg
2019-07-11T15:57:34+00:00
2019-07-11
false
Norfolk
Norfolk
Just added to our curated list of the latest UK distressed and repossessed property for sale is this 3 Bed Semi-Detached For Sale Aurania Avenue Norwich - £290,000. Follow the UK Distressed Property FB page and join the UK Distressed Property group to receive FREE distressed property listings. #UKDistressedProperty #NorfolkDistressedProperty
1Sqig1H1q18W
8 bedroom property for sale
GU25, Runnymede, Surrey, South East
17000000
£17,000,000
//img-uk-1.trovit.com/1Sqig1H1q18W/1Sqig1H1q18W.1_10.jpg
2019-07-11T15:57:45+00:00
2019-07-11
false
Surrey
Surrey
Just added!!! Identified as a Distressed Property is this 8 bedroom property for sale in Surrey on the market at £17,000,000. #UKDistressedProperty #SurreyDistressedProperty
1G181Yuy1ec1n
15 bedroom house share for sale
Alexander House, 72-77 St Matthew's Street, Ipswich Ip1, Ip1 3Ew
1600000
£1,600,000
//img-uk-1.trovit.com/1G181Yuy1ec1n/1G181Yuy1ec1n.1_10.jpg
2019-07-11T15:57:45+00:00
2019-07-11
false
Ipswich Ip1
IpswichIp1
Just added to our curated list of the latest UK distressed and repossessed property for sale is this 15 bedroom house share for sale - £1,600,000. Follow the UK Distressed Property FB page and join the UK Distressed Property group to receive FREE distressed property listings. #UKDistressedProperty #IpswichIp1DistressedProperty
10SxKE1O1W1I
Morton Road, Exmouth EX8, 12 bedroom
EX8 1BA, Exmouth, East Devon, Devon, South West England
475000
£475,000
//img-uk-1.trovit.com/10SxKE1O1W1I/10SxKE1O1W1I.1_10.jpg
2019-07-11T15:57:57+00:00
2019-07-11
false
Devon
Devon
Just added to our curated list of the latest UK distressed and repossessed property for sale is this Morton Road, Exmouth EX8, 12 bedroom - £475,000. #UKDistressedProperty #DevonDistressedProperty
1j1bT1r1D1Of1e
Radipole Terrace, Lodmoor, Weymouth DT4, 3 bedroom bungalow
DT4 7LR, Dorset, South West England
225000
£225,000
//img-uk-1.trovit.com/1j1bT1r1D1Of1e/1j1bT1r1D1Of1e.1_10.jpg
2019-07-11T15:57:57+00:00
2019-07-11
false
Dorset
Dorset
#DorsetDistressedProperty, Just added to our curated list of the latest UK distressed and repossessed property for sale is this Radipole Terrace, Lodmoor, Weymouth DT4, 3 bedroom bungalow - £225,000. Follow the UK Distressed Property FB page and join the UK Distressed Property group to receive FREE distressed property listings. #UKDistressedProperty
1pZ7D1K1-1lb
2 bedroom property for sale
PL27, Wadebridge, Cornwall, South West England
135000
£135,000
//img-uk-1.trovit.com/1pZ7D1K1-1lb/1pZ7D1K1-1lb.1_10.jpg
2019-07-11T15:57:57+00:00
2019-07-11
false
Cornwall
Cornwall
Just added to our curated list of the latest UK distressed and repossessed property for sale is this 2 bedroom property for sale - £135,000. Follow the UK Distressed Property FB page and join the UK Distressed Property group to receive FREE distressed property listings. #UKDistressedProperty #CornwallDistressedProperty
1l11Ng101ie1X
2 Bed Property For Sale Stewart Street Barrow in Furness
LA14 2QB, Barrow-in-Furness, Cumbria, North West England
35000
£35,000
2019-07-11T15:57:57+00:00
2019-07-11
false
Cumbria
Cumbria
Potential #BMV!!!! UK Distressed Property has found this 2 Bed Property For Sale Stewart Street Barrow in Furness in Cumbria - £35,000. #UKDistressedProperty #CumbriaDistressedProperty
K1mG1W1y1w1v1x
2 bedroom semi-detached house for sale
Windermere Road, Seaham, Sr7, Sr7 8Jh
55000
£55,000
2019-07-11T15:57:57+00:00
2019-07-11
false
Sr7
Sr7
Just added!!! Identified as a Distressed Property is this 2 bedroom semi-detached house for sale in Sr7 on the market at £55,000. #UKDistressedProperty #Sr7DistressedProperty
1jr1mU1I1l1r9
4 Bed Land For Sale Shyshack Lane Basingstoke
RG26 5NH, Basingstoke and Deane, Hampshire, South East
185000
£185,000
2019-07-11T15:57:57+00:00
2019-07-11
false
Hampshire
Hampshire
***Distressed Property Alert*** UK Distressed Property has identified this 4 Bed Land For Sale Shyshack Lane Basingstoke at an asking price of £185,000 in Hampshire. #UKDistressedProperty #HampshireDistressedProperty

Statistics

Average successful run time: 2 minutes

Total run time: 22 minutes

Total cpu time used: less than a minute

Total disk space used: 180 KB

History

  • Manually ran revision 256df056 and completed successfully .
    nothing changed in the database
  • Manually ran revision 256df056 and completed successfully .
    nothing changed in the database
  • Auto ran revision 256df056 and completed successfully .
    8 records added in the database
  • Auto ran revision 256df056 and completed successfully .
    10 records added in the database
  • Auto ran revision 256df056 and completed successfully .
    1 record added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

DP-TRV / scraper.py