SelectSoft / select_jigar

selecta

Contributors SelectSoft

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Python app detected [1G ! The latest version of Python 3 is python-3.6.2 (you are using python-3.5.2, which is unsupported). [1G ! We recommend upgrading by specifying the latest version (python-3.6.2). [1G Learn More: https://devcenter.heroku.com/articles/python-runtimes [1G-----> Installing python-3.5.2 [1G-----> Installing pip [1G-----> Installing requirements with pip [1G Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6)) [1G Cloning http://github.com/openaustralia/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki [1G Collecting pandas==0.24.2 [1G Downloading pandas-0.24.2-cp35-cp35m-manylinux1_x86_64.whl (10.0 MB) [1G Collecting dumptruck>=0.1.2 [1G Downloading dumptruck-0.1.6.tar.gz (15 kB) [1G Collecting requests [1G Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB) [1G Collecting numpy>=1.12.0 [1G Downloading numpy-1.18.5-cp35-cp35m-manylinux1_x86_64.whl (19.9 MB) [1G Collecting python-dateutil>=2.5.0 [1G Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB) [1G Collecting pytz>=2011k [1G Downloading pytz-2020.1-py2.py3-none-any.whl (510 kB) [1G Collecting certifi>=2017.4.17 [1G Downloading certifi-2020.6.20-py2.py3-none-any.whl (156 kB) [1G Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 [1G Downloading urllib3-1.25.10-py2.py3-none-any.whl (127 kB) [1G Collecting idna<3,>=2.5 [1G Downloading idna-2.10-py2.py3-none-any.whl (58 kB) [1G Collecting chardet<4,>=3.0.2 [1G Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB) [1G Collecting six>=1.5 [1G Downloading six-1.15.0-py2.py3-none-any.whl (10 kB) [1G Building wheels for collected packages: dumptruck [1G Building wheel for dumptruck (setup.py): started [1G Building wheel for dumptruck (setup.py): finished with status 'done' [1G Created wheel for dumptruck: filename=dumptruck-0.1.6-py3-none-any.whl size=11843 sha256=5ee570ef8426f370dfb5cc257ad8e8cb23ceaa53b55687ffcfc11b7a96b4ee27 [1G Stored in directory: /tmp/pip-ephem-wheel-cache-q0qiplei/wheels/6f/67/25/1524c316abf578c37cde7ffe2eb8c31e188a8e0ccf2cde88de [1G Successfully built dumptruck [1G Installing collected packages: dumptruck, certifi, urllib3, idna, chardet, requests, scraperwiki, numpy, six, python-dateutil, pytz, pandas [1G Running setup.py develop for scraperwiki [1G Successfully installed certifi-2020.6.20 chardet-3.0.4 dumptruck-0.1.6 idna-2.10 numpy-1.18.5 pandas-0.24.2 python-dateutil-2.8.1 pytz-2020.1 requests-2.24.0 scraperwiki six-1.15.0 urllib3-1.25.10 [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 21152 times by SelectSoft

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.57 MB) Use the API

rows 10 / 198

ImageID ImageURL ProductID Display SKU
40284
https://www.junaidjamshed.com/media/catalog/product/1/6/1666_brown.jpg?quality=80&bg-color=255,255,255&fit=bounds&height=&width=
1
GM119900-999-020-M
40285
https://www.junaidjamshed.com/media/catalog/product/g/i/gift_box_3__12.jpg?quality=80&bg-color=255,255,255&fit=bounds&height=&width=
0
GM119900-999-020-M
40292
https://www.junaidjamshed.com/media/catalog/product/1/6/1672_coffee_brown.jpg?quality=80&bg-color=255,255,255&fit=bounds&height=&width=
1
GM120462-999-CBB-M
40293
https://www.junaidjamshed.com/media/catalog/product/g/i/gift_box_3__12.jpg?quality=80&bg-color=255,255,255&fit=bounds&height=&width=
0
GM120462-999-CBB-M
40296
https://www.junaidjamshed.com/media/catalog/product/1/6/1691_cream.jpg?quality=80&bg-color=255,255,255&fit=bounds&height=&width=
1
GM119905-999-CRM-M
40297
https://www.junaidjamshed.com/media/catalog/product/g/i/gift_box_3__12.jpg?quality=80&bg-color=255,255,255&fit=bounds&height=&width=
0
GM119905-999-CRM-M
40298
https://www.junaidjamshed.com/media/catalog/product/1/6/1666_purple.jpg?quality=80&bg-color=255,255,255&fit=bounds&height=&width=
1
GM119900-999-018-M
40299
https://www.junaidjamshed.com/media/catalog/product/g/i/gift_box_3__12.jpg?quality=80&bg-color=255,255,255&fit=bounds&height=&width=
0
GM119900-999-018-M
40300
https://www.junaidjamshed.com/media/catalog/product/2/7/27348_1_.jpg?quality=80&bg-color=255,255,255&fit=bounds&height=&width=
1
J-GM117404
40301
https://www.junaidjamshed.com/media/catalog/product/2/7/27348_4_.jpg?quality=80&bg-color=255,255,255&fit=bounds&height=&width=
0
J-GM117404

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.57 MB) Use the API

rows 10 / 78

ProductID Title Description Brand_Name ProductURL Color Fabric Design Price InStock ProductCount SKU ProductCatgory ProductType Display OnSale IsImport Quantity SalePer ProductDate SubType
19235
JJMK-CLASSY-1666/JJ7040 - Brown
J. | JunaidJamshed
https://www.junaidjamshed.com/jjmk-classy-1666-jj7040-brown.html
1592
1
0
GM119900-999-020-M
Men
Kurta
1
1
0
0
84
2020-08-17
19239
JJMS-ELITE-1672/JJ6957 - Coffee Brown
J. | JunaidJamshed
https://www.junaidjamshed.com/jjms-elite-1672-jj6957-coffee-brown.html
2552
1
0
GM120462-999-CBB-M
Men
Kurta
1
1
0
0
74
2020-08-17
19241
JJMS-SUPERIOR-1691/JJ6887 - Cream
J. | JunaidJamshed
https://www.junaidjamshed.com/jjms-superior-1691-jj6887-cream.html
3790
1
0
GM119905-999-CRM-M
Men
Kurta
1
1
0
0
62
2020-08-17
19242
JJMK-CLASSY-1666/JJ7040 - Purple
J. | JunaidJamshed
https://www.junaidjamshed.com/jjmk-classy-1666-jj7040-purple.html
1592
1
0
GM119900-999-018-M
Men
Kurta
1
1
0
0
84
2020-08-17
19243
JJVC-27348/S20/JJ6981
J. | JunaidJamshed
https://www.junaidjamshed.com/jjvc-27348-s20-jj6981.html
5592
1
0
J-GM117404
Men
Kurta
1
1
0
0
19
2020-08-17
19244
JJVC-27349/S20/JJ6409
J. | JunaidJamshed
https://www.junaidjamshed.com/jjvc-27349-s20-jj6409.html
6632
1
0
J-GM117405
Men
Kurta
1
1
0
0
19
2020-08-17
19251
JJFW-JPC-11302/S20/HA-TXT
J. | JunaidJamshed
https://www.junaidjamshed.com/jjfw-jpc-11302-s20-ha-txt.html
2018
1
0
J-FM117253
Men
Kurta
1
1
0
0
24
2020-08-17
19252
JJFW-JPC-174/S20-PLN-JJ6916
J. | JunaidJamshed
https://www.junaidjamshed.com/jjfw-jpc-174-s20-pln-jj6916.html
1943
1
0
J-FM117304
Men
Kurta
1
1
0
0
24
2020-08-17
19254
JJK-S-31092/S20/JJ6837
J. | JunaidJamshed
https://www.junaidjamshed.com/jjk-s-31092-s20-jj6837.html
1992
1
0
J-GM116163
Men
Kurta
1
1
0
0
19
2020-08-17
19255
JJK-S-36662/S20/JJ6837
J. | JunaidJamshed
https://www.junaidjamshed.com/jjk-s-36662-s20-jj6837.html
1992
1
0
J-GM117770
Men
Kurta
1
1
0
0
19
2020-08-17

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.57 MB) Use the API

rows 1 / 1

JigarKey
118am08222020

Statistics

Average successful run time: less than a minute

Total run time: 19 minutes

Total cpu time used: half a minute

Total disk space used: 23.7 MB

History

  • Manually ran revision 5bc7809b and completed successfully .
    5595 records removed, 277 records updated in the database
  • Manually ran revision 24a87fb6 and completed successfully .
    2798 records removed, 5872 records updated in the database
  • Manually ran revision 784cf2b0 and completed successfully .
    nothing changed in the database
  • Manually ran revision 784cf2b0 and completed successfully .
    1 record updated in the database
  • Manually ran revision e465d3d1 and completed successfully .
    1044 records added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

select_jigar