This is a scraper that runs on Morph. To get started see the documentation
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Python app detected
[1G-----> Installing python-2.7.9
[1G $ pip install -r requirements.txt
[1G Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 1))
[1G Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki
[1G Collecting lxml==3.4.4 (from -r requirements.txt (line 2))
[1G Downloading lxml-3.4.4.tar.gz (3.5MB)
[1G Collecting cssselect==0.9.1 (from -r requirements.txt (line 3))
[1G Downloading cssselect-0.9.1.tar.gz
[1G Collecting beautifulsoup4 (from -r requirements.txt (line 4))
[1G Downloading beautifulsoup4-4.5.1-py2-none-any.whl (83kB)
[1G Collecting python-dateutil (from -r requirements.txt (line 5))
[1G Downloading python_dateutil-2.6.0-py2.py3-none-any.whl (194kB)
[1G Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 1))
[1G Downloading dumptruck-0.1.6.tar.gz
[1G Collecting requests (from scraperwiki->-r requirements.txt (line 1))
[1G Downloading requests-2.12.1-py2.py3-none-any.whl (574kB)
[1G Collecting six>=1.5 (from python-dateutil->-r requirements.txt (line 5))
[1G Downloading six-1.10.0-py2.py3-none-any.whl
[1G Installing collected packages: dumptruck, requests, scraperwiki, lxml, cssselect, beautifulsoup4, six, python-dateutil
[1G Running setup.py install for dumptruck: started
[1G Running setup.py install for dumptruck: finished with status 'done'
[1G Running setup.py develop for scraperwiki
[1G Running setup.py install for lxml: started
[1G Running setup.py install for lxml: still running...
[1G Running setup.py install for lxml: finished with status 'done'
[1G Running setup.py install for cssselect: started
[1G Running setup.py install for cssselect: finished with status 'done'
[1G Successfully installed beautifulsoup4-4.5.1 cssselect-0.9.1 dumptruck-0.1.6 lxml-3.4.4 python-dateutil-2.6.0 requests-2.12.1 scraperwiki six-1.10.0
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
E0104_NSC_gov_2016_Q0
Data
Downloaded
3 times
by
To download data sign in with GitHub
rows 10 / 17
| d | l | f |
|---|---|---|
|
2016-04-12 07:49:48.133353
|
E0104_NSC_gov_2016_03
|
|
|
2016-04-12 07:49:49.708472
|
E0104_NSC_gov_2015_08
|
|
|
2016-04-12 07:49:51.262491
|
E0104_NSC_gov_2016_01
|
|
|
2016-04-12 07:49:52.813813
|
E0104_NSC_gov_2015_12
|
|
|
2016-04-12 07:49:54.415955
|
E0104_NSC_gov_2015_11
|
|
|
2016-04-12 07:49:55.988081
|
E0104_NSC_gov_2015_10
|
|
|
2016-04-12 07:49:57.516706
|
E0104_NSC_gov_2015_09
|
|
|
2016-04-12 07:49:59.074018
|
E0104_NSC_gov_2015_07
|
|
|
2016-04-12 07:50:00.638793
|
E0104_NSC_gov_2015_06
|
|
|
2016-04-12 07:50:02.173779
|
E0104_NSC_gov_2015_05
|
Statistics
Average successful run time: 2 minutes
Total run time: 13 minutes
Total cpu time used: less than 5 seconds
Total disk space used: 35.6 KB
History
-
Manually
ran
revision
34fa60d8
and
completed successfully
.
1 record added in the database3 pages scraped
-
Manually
ran
revision
fd37850e
and
completed successfully
.
16 records added in the database
-
Manually
ran
revision
956427b9
and
failed
.
nothing changed in the database
-
Manually
ran
revision
b692d8fc
and
failed
.
nothing changed in the database
-
Manually
ran
revision
047b8690
and
failed
.
nothing changed in the database
- ...
- Created on morph.io