okfn / opentrials-clinicaltrailsgov-data

Clinical trial data from clinicaltrials.gov


opentrials-clinicaltrailsgov-data

This is a scraper that runs on Morph. To get started see the documentation.

Documents

Configuration

Environment variables to configure the scraper:

  • DATE_FROM

Get trials with last updated mark => this date.

  • DATE_TO

Get trials with last updated mark <= this date.

  • DOWNLOAD_DELAY

Requests we're making to clinicaltrials.gov interval.

Workflow

We need to download around 200 000 pages and we want to be polite to the source webserver:

  • 1s delay -> 60 hours
  • 0.5s delay -> 30 hours (more than morph.io can do for us)
  • etc

So we can scrape manually by years then pull updates for the last year automatically:

  • 1 year (60 000 pages) + 1s delay -> 32 hours
  • 1 year (60 000 pages) + 0.5s delay -> 16 hours
  • 1 year (60 000 pages) + 0.25s delay -> 8 hours
  • etc

Proposed settings for the scraping some year:

DATE_FROM='2010-01-01' DATE_TO='2010-12-31' DOWNLOAD_DELAY='0.25'

Proposed settings for the database updating:

DATE_FROM='2015-10-01' DATE_TO='2015-12-31' DOWNLOAD_DELAY='0.5'

Legal notes

Source of all data scraped by this scraper: clinicaltrials.gov.

ClinicalTrials.gov data are available to all requesters, both within and outside the United States, at no charge.

Terms and conditions

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling...

Statistics

Average successful run time: about 5 hours

Total run time: 2 months

Total cpu time used: about 20 hours

Total disk space used: 121 KB

History

  • Auto ran revision 111c5256 and failed .
    nothing changed in the database
  • Auto ran revision 111c5256 and failed .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and failed .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
    22 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    3752 records added, 3752 records removed in the database
  • Auto ran revision 111c5256 and completed successfully .
    1228 records added, 1228 records removed in the database
  • Auto ran revision 111c5256 and completed successfully .
    260 records added, 260 records removed in the database
  • Auto ran revision 111c5256 and completed successfully .
    1278 records added, 1278 records removed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
    nothing changed in the database
  • Auto ran revision 111c5256 and completed successfully .
  • Auto ran revision 111c5256 and completed successfully .
  • Auto ran revision 111c5256 and completed successfully .
  • Auto ran revision 111c5256 and completed successfully .
    496 records added, 496 records removed in the database
  • Auto ran revision 111c5256 and completed successfully .
    3891 records added, 3891 records removed in the database
  • Auto ran revision 111c5256 and completed successfully .
    4554 records added, 4554 records removed in the database
  • Auto ran revision 111c5256 and completed successfully .
    325 records added, 325 records removed in the database
  • Auto ran revision 111c5256 and completed successfully .
    881 records added, 881 records removed in the database
  • Auto ran revision 111c5256 and completed successfully .
    1588 records added, 1588 records removed in the database
  • Auto ran revision 111c5256 and completed successfully .
    911 records added, 911 records removed in the database
  • Auto ran revision 111c5256 and failed .
  • Auto ran revision 111c5256 and completed successfully .
  • Auto ran revision 111c5256 and completed successfully .
    832 records added, 832 records removed in the database
    939 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    2087 records added, 2087 records removed in the database
  • Auto ran revision 111c5256 and completed successfully .
    23342 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    3121 records added, 3121 records removed in the database
    3346 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    376 records added, 376 records removed in the database
    24183 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    2382 records added, 2382 records removed in the database
    62332 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    205747 records added in the database
    9752 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    31937 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    6632 records added, 6632 records removed, 16381 records updated in the database
    17299 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    45956 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    23098 records added, 23098 records removed in the database
    24255 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    23468 records added, 23468 records removed in the database
    24651 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    17707 records added, 17707 records removed in the database
    18626 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    870 records added, 870 records removed in the database
    944 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    8175 records added, 8175 records removed in the database
    33621 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    2874 records added, 2874 records removed in the database
    3049 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    24340 records added, 24340 records removed in the database
    51118 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    13953 records added, 13953 records removed in the database
    14699 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    7334 records added, 7334 records removed in the database
    7727 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    1772 records added, 1772 records removed in the database
    1892 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    24638 records added, 24638 records removed in the database
    25872 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    3048 records added, 3048 records removed in the database
    29108 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    24962 records added, 24962 records removed in the database
    26214 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    1485 records added, 1485 records removed in the database
    1579 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    4015 records added, 4015 records removed in the database
    4254 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    26693 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    25485 records added, 25485 records removed in the database
    26795 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    1306 records added, 1306 records removed in the database
    1406 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    651 records added, 651 records removed in the database
    746 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    25686 records added, 25686 records removed in the database
    26973 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    2252 records added, 2252 records removed in the database
    2401 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    26088 records added, 26088 records removed in the database
    27399 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    1808 records added, 1808 records removed in the database
    1975 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    3287 records added, 3287 records removed in the database
    3643 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    28027 records added, 28027 records removed in the database
    29431 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    8280 records added, 8280 records removed in the database
    8715 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    28113 records added, 28113 records removed in the database
    29524 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    28116 records added, 28116 records removed in the database
    29625 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    28208 records added, 28208 records removed in the database
    29621 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    14355 records added, 14355 records removed in the database
    15100 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    2831 records added, 2831 records removed in the database
    2995 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    61315 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    16994 records added, 16994 records removed in the database
    17867 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    30037 records added, 30037 records removed in the database
    31541 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    30444 records added, 30444 records removed in the database
    31969 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    3715 records added, 3715 records removed in the database
    3934 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    7125 records added, 7125 records removed in the database
    7546 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    30960 records added, 30946 records removed in the database
    32510 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    14508 records added, 14424 records removed in the database
    15270 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    4080 records added, 3721 records removed in the database
    4318 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    244 records added, 244 records removed in the database
    290 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    30080 records added, 30016 records removed in the database
    31621 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    1440 records added, 1374 records removed in the database
    1582 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    29503 records added, 29381 records removed in the database
    31307 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    31022 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    668 records added, 446 records removed in the database
    738 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    27943 records added, 27827 records removed in the database
    29345 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    877 records added, 722 records removed in the database
    967 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    11116 records added, 11116 records removed in the database
    13163 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    585 records added, 585 records removed in the database
    1647 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    26590 records added, 26461 records removed in the database
    27922 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    2670 records added, 2670 records removed in the database
    2851 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    1551 records added, 1353 records removed in the database
    1654 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    3229 records added, 3135 records removed in the database
    3442 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    491 records added, 491 records removed in the database
    964 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    289 records added, 289 records removed in the database
    377 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    10011 records added, 9870 records removed in the database
    10559 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    7281 records added, 7281 records removed in the database
    7680 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    461 records added, 454 records removed in the database
    498 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    755 records added, 536 records removed in the database
    939 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    1107 records added, 993 records removed in the database
    1229 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    2306 records added, 2235 records removed in the database
    2465 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    7094 records added, 6718 records removed in the database
    7453 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    19159 records added, 18932 records removed in the database
    20119 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    13538 records added, 13433 records removed in the database
    14262 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    14814 records added, 14714 records removed in the database
    15597 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    1587 records added, 1587 records removed in the database
    1684 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    2693 records added, 2611 records removed in the database
    8338 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    2010 records added, 1998 records removed in the database
    2324 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    122 records added, 33 records removed in the database
    144 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    1323 records added, 1323 records removed in the database
    1428 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    15380 records added, 15252 records removed in the database
    16191 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    9523 records added, 9523 records removed in the database
    10020 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    1493 records added, 1325 records removed in the database
    1578 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    168 records added, 168 records removed in the database
    201 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    4618 records added, 4618 records removed in the database
    4884 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    14927 records added, 14925 records removed in the database
    15676 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    3450 records added, 2839 records removed in the database
    3666 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    2146 records added, 2146 records removed, 613 records updated in the database
    2993 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    17920 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    11906 records added, 11792 records removed in the database
    12493 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    510 records added, 436 records removed in the database
    578 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    4837 records added, 4837 records removed in the database
    5112 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    10044 records added, 10044 records removed in the database
    10549 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    753 records added, 753 records removed in the database
    828 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    10044 records added, 9951 records removed in the database
    10549 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    9601 records added, 9481 records removed in the database
    10084 pages scraped
  • Auto ran revision 111c5256 and completed successfully .
    9090 records added, 9090 records removed in the database
    89779 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    7772 records added, 7772 records removed in the database
    66034 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    26521 records added in the database
    55559 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    23645 records added in the database
    24830 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    15139 records added in the database
    15898 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    34160 records added in the database
    35871 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    24443 records added in the database
    25668 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    20179 records added, 49180 records updated in the database
    21201 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    14215 records added in the database
    14939 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    9844 records added in the database
    10344 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    8502 records added in the database
    8932 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    7355 records added, 9264 records updated in the database
    7727 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    4164 records added, 5100 records updated in the database
    4375 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    2331 records added in the database
    2450 pages scraped
  • Manually ran revision 111c5256 and completed successfully .
    2769 records added in the database
    2912 pages scraped
  • Manually ran revision 1c2744ef and completed successfully .
    2769 records added in the database
    2910 pages scraped
  • Manually ran revision 08d58973 and completed successfully .
    68 records added, 68 records removed in the database
    74 pages scraped
  • Manually ran revision 0f14f8e4 and completed successfully .
    68 records added in the database
    74 pages scraped
  • Manually ran revision 0f14f8e4 and completed successfully .
    68 records added, 68 records removed in the database
    74 pages scraped
  • Manually ran revision 2fe6089b and completed successfully .
    68 records added, 68 records removed in the database
    74 pages scraped
  • Manually ran revision 1bcb403f and completed successfully .
    68 records added, 68 records removed in the database
    74 pages scraped
  • Manually ran revision c9d9cae3 and completed successfully .
    68 records added, 68 records removed in the database
    74 pages scraped
  • Auto ran revision 3fe50041 and completed successfully .
    68 records added, 68 records removed in the database
    74 pages scraped
  • Auto ran revision 3fe50041 and completed successfully .
    68 records added in the database
    74 pages scraped
  • Auto ran revision c1e6297b and completed successfully .
    nothing changed in the database
  • Auto ran revision c1e6297b and completed successfully .
    nothing changed in the database
  • Auto ran revision c1e6297b and completed successfully .
    nothing changed in the database
  • Auto ran revision c1e6297b and completed successfully .
    nothing changed in the database
  • Manually ran revision df6249b5 and completed successfully .
    nothing changed in the database
  • Auto ran revision dc539795 and completed successfully .
    nothing changed in the database
  • Auto ran revision e10fd2bd and completed successfully .
    nothing changed in the database
  • Auto ran revision e10fd2bd and completed successfully .
    nothing changed in the database
  • Auto ran revision e10fd2bd and completed successfully .
    nothing changed in the database
  • Auto ran revision e10fd2bd and completed successfully .
    nothing changed in the database
  • Auto ran revision e10fd2bd and completed successfully .
    nothing changed in the database
  • Auto ran revision e10fd2bd and completed successfully .
    nothing changed in the database
  • Auto ran revision e10fd2bd and completed successfully .
    nothing changed in the database
  • Auto ran revision e10fd2bd and completed successfully .
    nothing changed in the database
    19 pages scraped
  • Auto ran revision e10fd2bd and completed successfully .
    nothing changed in the database
  • Created on morph.io