alewin / tripadvisor

St.Petersburg


To change the city:

  1. go to www.tripadvisor.com
  2. search for the respective city
  3. copy geoID; e.g. http://www.tripadvisor.de/RestaurantSearch?geo= 294265
  4. paste the id into the scraper link in line 88

NOTE: only change the geoID

Forked from ScraperWiki

Last run failed with status code 1.

Console output of last run

Starting On page http://www.tripadvisor.com/RestaurantSearch?geo=298450&o=a0&sortOrder=popularity Url: http://www.tripadvisor.com/Restaurant_Review-g298450-d1055753-Reviews-Dining_at_Makati_Shangri_La_Manila-Makati_Metro_Manila_Luzon.html [ ] Traceback (most recent call last): File "/repo/scraper.py", line 90, in <module> parse_listing_pages(start_url) File "/repo/scraper.py", line 85, in parse_listing_pages parse_list(root) File "/repo/scraper.py", line 68, in parse_list scraperwiki.sqlite.save(unique_keys=['source_url'], data=data, table_name="tripadvisor_SOT") File "/usr/local/lib/python2.7/dist-packages/scraperwiki-0.3.7-py2.7.egg/scraperwiki/sqlite.py", line 34, in save return dt.upsert(data, table_name = table_name) File "/usr/local/lib/python2.7/dist-packages/dumptruck-0.1.5-py2.7.egg/dumptruck/dumptruck.py", line 301, in upsert self.insert(upsert=True, *args, **kwargs) File "/usr/local/lib/python2.7/dist-packages/dumptruck-0.1.5-py2.7.egg/dumptruck/dumptruck.py", line 284, in insert self.execute(sql, values, commit=False) File "/usr/local/lib/python2.7/dist-packages/dumptruck-0.1.5-py2.7.egg/dumptruck/dumptruck.py", line 138, in execute raise self.sqlite3.InterfaceError(unicode(msg) + '\nTry converting types or pickling.') sqlite3 . InterfaceError : Error binding parameter 6 - probably unsupported type. Try converting types or pickling.

Data

Downloaded 1 time by GeorgiKalchevG

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3 KB) Use the API

rows 0 / 0

Statistics

Average successful run time: less than 5 seconds

Total run time: half a minute

Total cpu time used: less than 5 seconds

Total disk space used: 37.1 KB

History

  • Manually ran revision 6afcba18 and failed .
    nothing changed in the database
  • Manually ran revision 6afcba18 and failed .
    nothing changed in the database
  • Manually ran revision 6afcba18 and failed .
    nothing changed in the database
  • Manually ran revision e0465aac and completed successfully .
    nothing changed in the database
  • Manually ran revision e0465aac and failed .
    nothing changed in the database
  • Manually ran revision c4598924 and failed .
    nothing changed in the database
  • Manually ran revision 84e06730 and failed .
    nothing changed in the database
  • Manually ran revision 2bdfaf89 and failed .
    nothing changed in the database
  • Manually ran revision 2bdfaf89 and completed successfully .
    nothing changed in the database
  • Manually ran revision c7cea645 and failed .
    nothing changed in the database
  • Manually ran revision 8508c271 and completed successfully .
    nothing changed in the database
  • Forked from ScraperWiki

Scraper code

Python

tripadvisor / scraper.py