This is a scraper that runs on Morph. To get started see the documentation

Contributors minois

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Data

Downloaded 12 times by minois qiun

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (852 MB) Use the API

rows 10 / 51770

date category count
2017-09-13
supermarket
267
2017-09-13
liquor_convenience
172
2017-09-13
drug
74
2017-09-13
furniture
201
2017-09-13
electronics
25
2017-09-13
department
166
2017-09-13
fashon
122
2017-09-13
kids
32
2017-09-13
grasses
31
2017-09-13
car
300

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (852 MB) Use the API

rows 10 / 9126986

date category id name
2017-09-13
supermarket
218800
青森県民生協
2017-09-13
supermarket
284801
赤札堂
2017-09-13
supermarket
275139
アタック
2017-09-13
supermarket
40407
アピタ
2017-09-13
supermarket
118376
アルゾ
2017-09-13
supermarket
195099
アローズ
2017-09-13
supermarket
236597
アロス尾張旭店
2017-09-13
supermarket
226377
e-ショップオークワ
2017-09-13
supermarket
283787
イオン×ネスレ日本
2017-09-13
supermarket
212015
イオングループ キャンペーン

Statistics

Average successful run time: 14 minutes

Total run time: 16 days

Total cpu time used: about 2 hours

Total disk space used: 852 MB

History

  • Auto ran revision 88ba59ad and completed successfully .
    6227 records added in the database
  • Auto ran revision 88ba59ad and completed successfully .
    6226 records added in the database
  • Auto ran revision 88ba59ad and completed successfully .
    6226 records added in the database
  • Auto ran revision 88ba59ad and completed successfully .
    6226 records added in the database
  • Auto ran revision 88ba59ad and completed successfully .
    6226 records added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

published_shop_count / scraper.rb