radiocontrolled / bobs_your_uncle

test

Scrapes foo.com and www.foo.com

Foo.com

Contributors radiocontrolled

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Traceback (most recent call last): {<Element a at 0x7fd907a132b8>: 'http://foo.com/'} File "scraper.py", line 21, in <module> scraperwiki.sqlite.save(unique_keys=['i'], data=record) {<Element a at 0x7fd907a13310>: 'http://foo.com/digimedia_privacy_policy.html', <Element a at 0x7fd907a132b8>: 'http://foo.com/'} File "/app/.heroku/src/scraperwiki/scraperwiki/sqlite.py", line 31, in save dt.create_table(data, table_name = table_name, error_if_exists = False) File "/app/.heroku/python/lib/python2.7/site-packages/dumptruck/dumptruck.py", line 202, in create_table converted_data = convert(data) File "/app/.heroku/python/lib/python2.7/site-packages/dumptruck/convert.py", line 56, in convert checkdata(row) File "/app/.heroku/python/lib/python2.7/site-packages/dumptruck/convert.py", line 98, in checkdata raise ValueError(u'The column name must be of unicode or str type. The column name ("%s") is of type %s. If this error doesn\'t make sense, try "unicode(\'%s\')".' % (key, type(key), key)) ValueError: The column name must be of unicode or str type. The column name ("<Element a at 0x7fd907a13310>") is of type <class 'lxml.html.HtmlElement'>. If this error doesn't make sense, try "unicode('<Element a at 0x7fd907a13310>')".

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (4 KB) Use the API

rows 2 / 2

name occupation a Privacy Policy Foo.com
susan
software developer
http://foo.com/digimedia_privacy_policy.html

Statistics

Average successful run time: half a minute

Total run time: 8 minutes

Total cpu time used: less than 10 seconds

Total disk space used: 65 KB

History

  • Manually ran revision 1917a3ca and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision c0bb1675 and failed .
    nothing changed in the database
    3 pages scraped
  • Manually ran revision 009e70a4 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 112ed57d and completed successfully .
    1 record added in the database
    2 pages scraped
  • Manually ran revision 4caedef3 and failed .
    nothing changed in the database
    2 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

bobs_your_uncle