This is a scraper that runs on Morph. To get started see the documentation

Contributors danozgriff

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.9, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.9 -----> Installing pip -----> Installing requirements with pip  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to /app/.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting mechanize==0.2.5 (from -r /tmp/build/requirements.txt (line 10))  Downloading mechanize-0.2.5.tar.gz (383kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting idna<2.7,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading idna-2.6-py2.py3-none-any.whl (56kB)  Collecting urllib3<1.23,>=1.21.1 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading certifi-2018.1.18-py2.py3-none-any.whl (151kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB)  Installing collected packages: dumptruck, idna, urllib3, certifi, chardet, requests, scraperwiki, lxml, cssselect, mechanize  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Running setup.py install for mechanize: started  Running setup.py install for mechanize: finished with status 'done'  Successfully installed certifi-2018.1.18 chardet-3.0.4 cssselect-0.9.1 dumptruck-0.1.6 idna-2.6 lxml-3.4.4 mechanize-0.2.5 requests-2.18.4 scraperwiki urllib3-1.22   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... 2018-02-06 20:59:30.415362 Sending Email Notification.. Traceback (most recent call last): File "scraper.py", line 1145, in <module> Notify(rundt) File "scraper.py", line 1052, in Notify server.login(cGFyc3vdcmF, cGFzc3dvcmQ) File "/app/.heroku/python/lib/python2.7/smtplib.py", line 622, in login raise SMTPAuthenticationError(code, resp) smtplib.SMTPAuthenticationError: (534, '5.7.14 <https://accounts.google.com/signin/continue?sarp=1&scc=1&plt=AKgnsbtO\n5.7.14 _r8yyNqqUrzOuD1bEzaDzYcRURl4doa19BPToGaMAGrZBgNeKP9gcdFy7JBcIRve2lgOgR\n5.7.14 L2HHUmw2CBc3Ua_lcvza0vJOjVrJXavl151fRIGh3khusy-yVlqSfQgbNBlDUSCAPml_9O\n5.7.14 OrLyEFRNVJjsDlE7ruVlh_e0q5CuDr8pp1kviPYUHJIHYwwaVj-iMoj-_EBFmKN6mZsN0_\n5.7.14 1agFHUxeL1803L86WLMJTo7M59N2A> Please log in via your web browser and\n5.7.14 then try again.\n5.7.14 Learn more at\n5.7.14 https://support.google.com/mail/answer/78754 x124sm20270510pfx.105 - gsmtp')

Data

Downloaded 47 times by danozgriff MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (31.4 MB) Use the API

rows 10 / 202

TIDM Company Yesterday Price FTSE Date
III.L
3iGroup
804.0
FTSE 100
2017-05-04
ADM.L
AdmiralGroup
2050.0
FTSE 100
2017-05-04
AAL.L
AngloAmerican
1079.0
FTSE 100
2017-05-04
ANTO.L
Antofagasta
808.5
FTSE 100
2017-05-04
AHT.L
AshteadGroup
1602.0
FTSE 100
2017-05-04
ABF.L
AssociatedBritishFoods
2815.0
FTSE 100
2017-05-04
AZN.L
AstraZeneca
4656.0
FTSE 100
2017-05-04
AV.L
Aviva
524.0
FTSE 100
2017-05-04
BAB.L
BabcockInternationalGroup
900.0
FTSE 100
2017-05-04
BA.L
BAESystems
638.5
FTSE 100
2017-05-04

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (31.4 MB) Use the API

rows 10 / 115

Rundate RunDateTime Proc status
2017-02-23
2017-02-23
Main
Complete
2017-02-23
2017-02-23
Main
Complete
2017-02-23
2017-02-23
Main
Complete
2017-02-23
2017-02-23
Main
Complete
2017-02-25
2017-02-25
ScrapeLivePrices
Incomplete
2017-02-25
2017-02-25
ScrapeSignalHistory_Core
Incomplete
2017-02-26
2017-02-26
SignalPerformance
Incomplete
2017-02-26
2017-02-26
SignalPerformance
Incomplete
2017-02-26
2017-02-26
SignalPerformance
Incomplete
2017-02-26
2017-02-26
SignalPerformance
Incomplete

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (31.4 MB) Use the API

rows 10 / 191839

TIDM Date Open High Low Close Volume
ZPLA.L
2017-02-22
389.5
395.2
385.3
391.1
811000
ZPLA.L
2017-02-21
376.9
384.8
374.5
383.8
390500
ZPLA.L
2017-02-20
380.0
386.2
377.2
383.7
187200
ZPLA.L
2017-02-17
391.1
392.7
377.333
377.8
624400
ZPLA.L
2017-02-16
379.1
383.8
379.1
381.4
340300
ZPLA.L
2017-02-15
375.1
383.7
374.68
382.3
376900
ZPLA.L
2017-02-14
383.2
383.2
378.1
380.7
238700
ZPLA.L
2017-02-13
384.1
384.1
369.8
381.8
407000
ZPLA.L
2017-02-10
388.6
391.71
382.6
384.4
286400
ZPLA.L
2017-02-09
389.8
392.1
383.65
385.9
718800

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (31.4 MB) Use the API

rows 10 / 99

TIDM Rank
III.L
2
ADM.L
91
AAL.L
35
ANTO.L
39
AHT.L
79
ABF.L
81
AZN.L
34
AV.L
85
BAB.L
7
BA.L
80

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (31.4 MB) Use the API

rows 10 / 7634

TIDM Date Price Signal Confirmation GBP 100 Last Updated
ADM.L
2017-04-28
2013.56
SELL
N
104.15
2017-05-04
ADM.L
2017-04-03
1994.0
BUY
Y
103.76
2017-05-04
ADM.L
2017-03-24
1981.0
SELL
N
104.39
2017-05-04
ADM.L
2017-03-09
1886.0
BUY
Y
99.98
2017-05-04
ADM.L
2017-02-28
1828.0
SELL
N
100.58
2017-05-04
ADM.L
2017-02-21
1874.0
BUY
N
103.73
2017-05-04
ADM.L
2017-02-14
1878.0
SELL
Y
104.36
2017-05-04
ADM.L
2017-02-02
1787.5
BUY
Y
99.93
2017-05-04
ADM.L
2017-01-31
1787.5
SHORT
N
101.14
2017-05-04
ADM.L
2017-01-23
1742.0
BUY
Y
99.76
2017-05-04

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (31.4 MB) Use the API

rows 10 / 99

TIDM 3D 10D 30D 90D 180D 6mthProfit 6mthProfit_Rank StdDev StdDev_Rank SignalAccuracy SignalAccuracy_Rank Overall_Score Overall_Rank Date
III.L
0.012
0.015
0.058
0.099
0.025
0.0
97
0.0
1
0.6
6
582
2
2017-05-05
ADM.L
0.017
0.013
0.016
0.048
0.027
14.4
39
18.209
68
0.0
17
45084
91
2017-05-05
AAL.L
0.03
0.092
0.009
-0.036
-0.128
23.78
23
16.249
65
0.538
10
14950
35
2017-05-05
ANTO.L
-0.033
-0.026
-0.037
-0.011
0.523
13.34
41
13.334
58
0.563
8
19024
39
2017-05-05
AHT.L
-0.001
-0.003
-0.006
-0.086
0.038
19.1
31
19.168
69
0.0
17
36363
79
2017-05-05
ABF.L
-0.003
0.012
0.112
0.181
0.086
21.17
28
24.335
80
0.0
17
38080
81
2017-05-05
AZN.L
0.0
-0.008
-0.013
0.068
-0.001
35.3
9
83.136
97
0.0
17
14841
34
2017-05-05
AV.L
0.0
-0.001
-0.004
0.064
0.152
3.95
73
4.88
33
0.0
17
40953
85
2017-05-05
BAB.L
-0.003
0.003
0.007
-0.026
-0.063
7.27
61
6.321
39
0.9
1
2379
7
2017-05-05
BA.L
-0.006
-0.029
-0.043
-0.08
-0.069
4.98
67
4.973
34
0.333
16
36448
80
2017-05-05

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (31.4 MB) Use the API

rows 6 / 6

TXID TIDM AlertDate AlertSignal AlertPrice EntryDate EntryPrice Size LastDate LastPrice LastChange LastSignal LastSignalDate Position CloseDate CloseSignal ClosePrice Earnings
1
POG.L
2017-01-27
SHORT
6.89
2017-01-27
6.89
1.0
2017-02-08
BUY
6.95
0.0
2
ENQ.L
2017-01-16
SELL
53.5561
2017-01-16
53.5561
1.0
2017-02-10
BUY
44.81
0.0
3
SFR.L
2017-02-02
BUY
81.125
2017-02-02
81.125
1.0
2017-03-16
SELL
0.0
0.0
4
RDI.L
2017-04-03
BUY
37.04
2017-04-05
37.4
1.08
0.0
0.0
5
PCTN.L
2017-04-04
BUY
84.13
2017-04-05
83.96
1.0
0.0
0.0
6
UKW.L
2017-04-03
BUY
118.58
2017-04-05
120.3
1.0
0.0
0.0

Statistics

Average successful run time: 10 minutes

Total run time: 8 days

Total cpu time used: about 4 hours

Total disk space used: 31.7 MB

History

  • Manually ran revision 0c4b2ef7 and failed .
    nothing changed in the database
  • Manually ran revision 0c4b2ef7 and completed successfully .
    nothing changed in the database
  • Manually ran revision 3c5d6371 and failed .
    121 records added, 196 records updated in the database
  • Manually ran revision 4ef51e79 and completed successfully .
    180 records added in the database
  • Manually ran revision 2e4e56c3 and completed successfully .
    1549 records added, 157 records updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

Code1 / scraper.py