Contributors SelectSoft

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 3 is python-3.6.2 (you are using python-3.5.2, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-3.6.2).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-3.5.2 -----> Installing pip -----> Installing requirements with pip  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki  Collecting pandas==0.24.2  Downloading pandas-0.24.2-cp35-cp35m-manylinux1_x86_64.whl (10.0 MB)  Collecting dumptruck>=0.1.2  Downloading dumptruck-0.1.6.tar.gz (15 kB)  Collecting requests  Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB)  Collecting numpy>=1.12.0  Downloading numpy-1.18.5-cp35-cp35m-manylinux1_x86_64.whl (19.9 MB)  Collecting python-dateutil>=2.5.0  Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)  Collecting pytz>=2011k  Downloading pytz-2020.1-py2.py3-none-any.whl (510 kB)  Collecting certifi>=2017.4.17  Downloading certifi-2020.6.20-py2.py3-none-any.whl (156 kB)  Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1  Downloading urllib3-1.25.10-py2.py3-none-any.whl (127 kB)  Collecting idna<3,>=2.5  Downloading idna-2.10-py2.py3-none-any.whl (58 kB)  Collecting chardet<4,>=3.0.2  Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB)  Collecting six>=1.5  Downloading six-1.15.0-py2.py3-none-any.whl (10 kB)  Building wheels for collected packages: dumptruck  Building wheel for dumptruck (setup.py): started  Building wheel for dumptruck (setup.py): finished with status 'done'  Created wheel for dumptruck: filename=dumptruck-0.1.6-py3-none-any.whl size=11843 sha256=5ee570ef8426f370dfb5cc257ad8e8cb23ceaa53b55687ffcfc11b7a96b4ee27  Stored in directory: /tmp/pip-ephem-wheel-cache-q0qiplei/wheels/6f/67/25/1524c316abf578c37cde7ffe2eb8c31e188a8e0ccf2cde88de  Successfully built dumptruck  Installing collected packages: dumptruck, certifi, urllib3, idna, chardet, requests, scraperwiki, numpy, six, python-dateutil, pytz, pandas  Running setup.py develop for scraperwiki  Successfully installed certifi-2020.6.20 chardet-3.0.4 dumptruck-0.1.6 idna-2.10 numpy-1.18.5 pandas-0.24.2 python-dateutil-2.8.1 pytz-2020.1 requests-2.24.0 scraperwiki six-1.15.0 urllib3-1.25.10   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 21152 times by SelectSoft

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.57 MB) Use the API

rows 10 / 198

ImageID ImageURL ProductID Display SKU
40284
1
GM119900-999-020-M
40285
0
GM119900-999-020-M
40292
1
GM120462-999-CBB-M
40293
0
GM120462-999-CBB-M
40296
1
GM119905-999-CRM-M
40297
0
GM119905-999-CRM-M
40298
1
GM119900-999-018-M
40299
0
GM119900-999-018-M
40300
1
J-GM117404
40301
0
J-GM117404

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.57 MB) Use the API

rows 10 / 78

ProductID Title Description Brand_Name ProductURL Color Fabric Design Price InStock ProductCount SKU ProductCatgory ProductType Display OnSale IsImport Quantity SalePer ProductDate SubType
19235
JJMK-CLASSY-1666/JJ7040 - Brown
J. | JunaidJamshed
1592
1
0
GM119900-999-020-M
Men
Kurta
1
1
0
0
84
2020-08-17
19239
JJMS-ELITE-1672/JJ6957 - Coffee Brown
J. | JunaidJamshed
2552
1
0
GM120462-999-CBB-M
Men
Kurta
1
1
0
0
74
2020-08-17
19241
JJMS-SUPERIOR-1691/JJ6887 - Cream
J. | JunaidJamshed
3790
1
0
GM119905-999-CRM-M
Men
Kurta
1
1
0
0
62
2020-08-17
19242
JJMK-CLASSY-1666/JJ7040 - Purple
J. | JunaidJamshed
1592
1
0
GM119900-999-018-M
Men
Kurta
1
1
0
0
84
2020-08-17
19243
JJVC-27348/S20/JJ6981
J. | JunaidJamshed
5592
1
0
J-GM117404
Men
Kurta
1
1
0
0
19
2020-08-17
19244
JJVC-27349/S20/JJ6409
J. | JunaidJamshed
6632
1
0
J-GM117405
Men
Kurta
1
1
0
0
19
2020-08-17
19251
JJFW-JPC-11302/S20/HA-TXT
J. | JunaidJamshed
2018
1
0
J-FM117253
Men
Kurta
1
1
0
0
24
2020-08-17
19252
JJFW-JPC-174/S20-PLN-JJ6916
J. | JunaidJamshed
1943
1
0
J-FM117304
Men
Kurta
1
1
0
0
24
2020-08-17
19254
JJK-S-31092/S20/JJ6837
J. | JunaidJamshed
1992
1
0
J-GM116163
Men
Kurta
1
1
0
0
19
2020-08-17
19255
JJK-S-36662/S20/JJ6837
J. | JunaidJamshed
1992
1
0
J-GM117770
Men
Kurta
1
1
0
0
19
2020-08-17

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.57 MB) Use the API

rows 1 / 1

JigarKey
118am08222020

Statistics

Average successful run time: less than a minute

Total run time: 19 minutes

Total cpu time used: half a minute

Total disk space used: 23.7 MB

History

  • Manually ran revision 5bc7809b and completed successfully .
    5595 records removed, 277 records updated in the database
  • Manually ran revision 24a87fb6 and completed successfully .
    2798 records removed, 5872 records updated in the database
  • Manually ran revision 784cf2b0 and completed successfully .
    nothing changed in the database
  • Manually ran revision 784cf2b0 and completed successfully .
    1 record updated in the database
  • Manually ran revision e465d3d1 and completed successfully .
    1044 records added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

select_jigar