This is a scraper that runs on Morph. To get started see the documentation

Contributors jaseclamp

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.lock; using PHP ^5.5.17  - php (5.6.28)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - apache (2.4.20)  - nginx (1.8.1) -----> Installing dependencies...  Composer version 1.1.3 2016-06-26 15:42:08  Loading composer repositories with package information  Installing dependencies from lock file  - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0)  Cloning e996fe0253bb50330690f5d2bafb66f094dbacb8   Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... got up to page 15008 last time PHP Warning: file_get_contents(https://api.stackexchange.com/2.2/users?page=15012&pagesize=100&order=asc&sort=creation&site=stackoverflow): failed to open stream: HTTP request failed! HTTP/1.1 400 Bad Request 15009, 15010, 15011, 15012, in /app/scraper.php on line 25 got up to page 15008 last time PHP Warning: file_get_contents(https://api.stackexchange.com/2.2/users?page=15012&pagesize=100&order=asc&sort=creation&site=stackoverflow): failed to open stream: HTTP request failed! HTTP/1.1 400 Bad Request 15009, 15010, 15011, 15012, in /app/scraper.php on line 25 problem getting page

Data

Downloaded 12 times by jaseclamp MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (398 MB) Use the API

rows 10 / 1501200

id page account_id is_employee last_modified_date last_access_date reputation_change_year reputation_change_quarter reputation_change_month reputation_change_week reputation_change_day reputation creation_date user_type user_id location website_url link profile_image display_name age accept_rate timed_penalty_date
1
1
-1
0
1457313415
1219709813
0
0
0
0
0
1
1217462400
moderator
-1
on the server farm
Community
2
1
1
1
1457808005
1459454875
953
30
30
0
0
37204
1217514151
moderator
1
El Cerrito, CA
Jeff Atwood
45
100
3
1
2
1
1456976792
1459548185
50
0
0
0
0
2504
1217514151
moderator
2
Corvallis, OR, United States
Geoff Dalgas
38
100
4
1
3
1
1432137194
1459455605
298
10
10
0
0
11604
1217514151
moderator
3
New York, NY
Jarrod Dixon
37
83
5
1
4
1
1452105101
1459534225
486
-2
-2
0
0
25544
1217514151
moderator
4
New York, NY
Joel Spolsky
90
6
1
5
0
1444706609
1459585269
837
5
5
0
0
33130
1217514151
registered
5
San Diego, CA
Jon Galloway
45
88
7
1
6
0
1457313551
1350338445
0
0
0
0
0
947
1217540004
registered
8
Eggs McLaren
8
1
7
0
1442034852
1459481958
265
0
0
0
0
10397
1217540126
registered
9
Oakland, CA
Kevin Dente
45
37
9
1
8
0
1332302464
1340134543
0
0
0
0
0
101
1217541426
registered
10
Lakehead, CA
Sneakers O'Toole
37
10
1
561854
0
1442034852
1217552351
45
0
0
0
0
1252
1217552351
unregistered
11
Anonymous User

Statistics

Average successful run time: 12 minutes

Total run time: 1 day

Total cpu time used: about 2 hours

Total disk space used: 398 MB

History

  • Auto ran revision f39994ea and completed successfully .
    300 records added, 1 record updated in the database
    4 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1300 records added, 1 record updated in the database
    14 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    3300 records added, 1 record updated in the database
    34 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    3200 records added, 1 record updated in the database
    33 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    2000 records added, 1 record updated in the database
    21 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    2400 records added, 1 record updated in the database
    25 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1000 records added, 1 record updated in the database
    11 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    8600 records added, 1 record updated in the database
    87 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    7500 records added, 1 record updated in the database
    76 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    16 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    25 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    4600 records added, 1 record updated in the database
    47 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    8600 records added, 1 record updated in the database
    87 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    100 records added, 1 record updated in the database
    40 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    3200 records added, 1 record updated in the database
    33 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    15600 records added, 1 record updated in the database
    157 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    10800 records added, 1 record updated in the database
    109 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    7700 records added, 1 record updated in the database
    78 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    400 records added, 1 record updated in the database
    5 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    60 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    2200 records added, 1 record updated in the database
    22 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    61 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    900 records added, 1 record updated in the database
    11 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    9100 records added, 1 record updated in the database
    92 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    4500 records added, 1 record updated in the database
    46 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    8500 records added, 1 record updated in the database
    86 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    600 records added, 1 record updated in the database
    7 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1900 records added, 1 record updated in the database
    20 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    4700 records added, 1 record updated in the database
    48 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1900 records added, 1 record updated in the database
    20 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1600 records added, 1 record updated in the database
    17 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    9300 records added, 1 record updated in the database
    94 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    13200 records added, 1 record updated in the database
    133 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1600 records added, 1 record updated in the database
    17 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1700 records added, 1 record updated in the database
    18 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    7400 records added, 1 record updated in the database
    75 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    9800 records added, 1 record updated in the database
    99 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1600 records added, 1 record updated in the database
    17 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    300 records added, 1 record updated in the database
    11 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    200 records added, 1 record updated in the database
    3 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1100 records added, 1 record updated in the database
    19 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    2900 records added, 1 record updated in the database
    30 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    80 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    8000 records added, 1 record updated in the database
    81 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    38 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    9000 records added, 1 record updated in the database
    91 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    2200 records added, 1 record updated in the database
    23 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    6100 records added, 1 record updated in the database
    62 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    9800 records added, 1 record updated in the database
    99 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    3300 records added, 1 record updated in the database
    34 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    5100 records added, 1 record updated in the database
    52 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    8800 records added, 1 record updated in the database
    89 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1100 records added, 1 record updated in the database
    12 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    79 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    300 records added, 1 record updated in the database
    4 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    10600 records added, 1 record updated in the database
    107 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    8000 records added, 1 record updated in the database
    81 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    10700 records added, 1 record updated in the database
    108 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    3900 records added, 1 record updated in the database
    39 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    13500 records added, 1 record updated in the database
    136 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    19400 records added, 1 record updated in the database
    195 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    10600 records added, 1 record updated in the database
    107 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    6500 records added, 1 record updated in the database
    66 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    7000 records added, 1 record updated in the database
    71 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    70 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    121 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    7100 records added, 1 record updated in the database
    72 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1800 records added, 1 record updated in the database
    19 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    2300 records added, 1 record updated in the database
    24 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    2000 records added, 1 record updated in the database
    21 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1400 records added, 1 record updated in the database
    15 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1700 records added, 1 record updated in the database
    19 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1900 records added, 1 record updated in the database
    20 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1900 records added, 1 record updated in the database
    20 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    200 records added, 1 record updated in the database
    3 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    63 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    2800 records added, 1 record updated in the database
    29 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1800 records added, 1 record updated in the database
    19 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    4500 records added, 1 record updated in the database
    46 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    300 records added, 1 record updated in the database
    4 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    4400 records added, 1 record updated in the database
    45 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1900 records added, 1 record updated in the database
    22 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    8500 records added, 1 record updated in the database
    86 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    4400 records added, 1 record updated in the database
    45 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    8300 records added, 1 record updated in the database
    84 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    5700 records added, 1 record updated in the database
    58 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    3500 records added, 1 record updated in the database
    36 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    9600 records added, 1 record updated in the database
    97 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    85 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    7 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    4300 records added, 1 record updated in the database
    44 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    3900 records added, 1 record updated in the database
    40 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    15900 records added, 1 record updated in the database
    160 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    17900 records added, 1 record updated in the database
    180 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    800 records added, 1 record updated in the database
    9 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    2000 records added, 1 record updated in the database
    21 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    14800 records added, 1 record updated in the database
    149 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    9600 records added, 1 record updated in the database
    97 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    10 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    77 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    154 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    25 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    119 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    16900 records added, 1 record updated in the database
    170 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    1600 records added, 1 record updated in the database
    61 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    6400 records added, 1 record updated in the database
    66 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    900 records added, 1 record updated in the database
    10 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    248 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    8400 records added, 1 record updated in the database
    96 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    3700 records added, 1 record updated in the database
    38 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    27100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    2900 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    18500 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    30200 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
    302 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
    302 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
    302 pages scraped
  • Auto ran revision f39994ea and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision f39994ea and completed successfully .
    30100 records added, 1 record updated in the database
    302 pages scraped
  • Manually ran revision f39994ea and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 3707f8b9 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 6db21527 and failed .
    19900 records added, 7001 records updated in the database
    520 pages scraped
  • Manually ran revision 6db21527 and failed .
    7001 records added in the database
    70 pages scraped
  • Manually ran revision 486f0b25 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision ad669e3f and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 96aafc34 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 1c00a059 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 3ad791ab and failed .
    nothing changed in the database
    28 pages scraped
  • Created on morph.io