loren / fbopen_data

FBO (Federal Business Opportunity) data from FBOpen

Scrapes api.data.gov

api.data.gov


This is a scraper of FBOpen data that runs on Morph.

Contributors loren

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.2.5 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/............  Fetching version metadata from https://rubygems.org/..  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Installing htmlentities 4.3.4  Installing crass 1.0.2  Installing json 1.8.3 with native extensions  Installing multi_xml 0.5.5  Installing httpclient 2.8.0  Installing pkg-config 1.1.7  Installing mini_portile2 2.1.0  Using bundler 1.11.2  Installing sqlite3 1.3.11 with native extensions  Installing nokogiri 1.6.8 with native extensions  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing nokogumbo 1.4.7 with native extensions  Installing httparty 0.13.7  Installing sanitize 4.0.1  Bundle complete! 4 Gemfile dependencies, 15 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from httparty:  When you HTTParty, you must party hard!  Bundle completed (30.30s)  Cleaning up the bundler cache.  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Fetching results 0..499 at 2017-02-26 07:51:11 +0000 Fetching results 0..499 at 2017-02-26 07:51:11 +0000 Fetching results 0..499 at 2017-02-26 07:51:11 +0000 /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/protocol.rb:158:in `rescue in rbuf_fill': Net::ReadTimeout (Net::ReadTimeout) from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/protocol.rb:152:in `rbuf_fill' from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/protocol.rb:134:in `readuntil' from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/protocol.rb:144:in `readline' from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/http/response.rb:39:in `read_status_line' from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/http/response.rb:28:in `read_new' from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/http.rb:1414:in `block in transport_request' from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/http.rb:1411:in `catch' from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/http.rb:1411:in `transport_request' from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/http.rb:1384:in `request' from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/http.rb:1377:in `block in request' from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/http.rb:853:in `start' from /app/vendor/ruby-2.2.5/lib/ruby/2.2.0/net/http.rb:1375:in `request' from /app/vendor/bundle/ruby/2.2.0/gems/httparty-0.13.7/lib/httparty/request.rb:117:in `perform' from /app/vendor/bundle/ruby/2.2.0/gems/httparty-0.13.7/lib/httparty.rb:545:in `perform_request' from /app/vendor/bundle/ruby/2.2.0/gems/httparty-0.13.7/lib/httparty.rb:476:in `get' from /app/vendor/bundle/ruby/2.2.0/gems/httparty-0.13.7/lib/httparty.rb:583:in `get' from scraper.rb:60:in `fetch_results' from scraper.rb:71:in `<main>'

Data

Downloaded 391 times by loren davidpranata

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (29 MB) Use the API

rows 0 / 0

Statistics

Average successful run time: about 1 hour

Total run time: 7 days

Total cpu time used: about 2 hours

Total disk space used: 29.1 MB

History

  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    17 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and failed .
    3701 records removed in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    211 records removed, 3467 records updated in the database
    3615 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    3595 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    32 records removed, 3558 records updated in the database
    3813 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    1 record removed, 2252 records updated in the database
    3845 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    131 records added, 2981 records updated in the database
    3846 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    349 records removed, 3573 records updated in the database
    3721 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    123 records added, 4005 records updated in the database
    4067 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    3718 records updated in the database
    3914 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    211 records removed, 4005 records updated in the database
    3914 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    374 records removed, 4135 records updated in the database
    4098 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    179 records added, 4343 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    16 records removed, 4343 records updated in the database
    4257 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    156 records added, 3694 records updated in the database
    4273 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    1360 records added, 2843 records updated in the database
    4136 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    1704 records removed, 2839 records updated in the database
    2778 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    880 records added, 3764 records updated in the database
    4406 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    743 records added, 1527 records updated in the database
    3554 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    639 records removed, 2762 records updated in the database
    2838 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    10 records removed, 3541 records updated in the database
    3431 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    9 records removed, 2942 records updated in the database
    3441 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    218 records removed, 3484 records updated in the database
    3450 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    122 records added, 3741 records updated in the database
    3590 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    351 records removed, 3540 records updated in the database
    3484 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    3883 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    203 records removed, 4005 records updated in the database
    3851 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    3860 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    177 records added, 3893 records updated in the database
    4069 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    167 records removed, 3859 records updated in the database
    3913 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    353 records added, 532 records updated in the database
    4064 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    485 records removed, 3892 records updated in the database
    3745 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    216 records added, 3412 records updated in the database
    4259 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    9 records removed, 3315 records updated in the database
    4043 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    184 records removed, 4040 records updated in the database
    4052 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    1494 records added, 2657 records updated in the database
    4244 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    324 records removed, 2730 records updated in the database
    2833 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    1014 records removed, 3208 records updated in the database
    3149 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    3643 records added, 578 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    3886 records removed, 509 records updated in the database
    629 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    932 records added, 3300 records updated in the database
    4404 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    191 records removed, 3485 records updated in the database
    3541 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    33 records removed, 3528 records updated in the database
    3725 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    2 records removed, 2992 records updated in the database
    3764 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    150 records added, 3001 records updated in the database
    3766 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    252 records added, 3287 records updated in the database
    3624 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    304 records removed, 3310 records updated in the database
    3368 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    483 records added, 3125 records updated in the database
    3664 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    104 records removed, 3136 records updated in the database
    3191 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    168 records removed, 3253 records updated in the database
    3286 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    10 records removed, 2846 records updated in the database
    3465 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    3134 records updated in the database
    3475 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    954 records added, 2453 records updated in the database
    3475 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    906 records removed, 2160 records updated in the database
    2542 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    151 records added, 3060 records updated in the database
    3425 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    421 records added, 2779 records updated in the database
    3279 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    92 records removed, 2844 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    1864 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    3051 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    261 records added, 2623 records updated in the database
    2956 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    833 records removed, 2188 records updated in the database
    2711 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    3 records removed, 3393 records updated in the database
    3525 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    193 records added, 3363 records updated in the database
    3528 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    192 records removed, 2370 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    3158 records added, 240 records updated in the database
    3534 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    3200 records removed, 299 records updated in the database
    397 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    122 records added, 3289 records updated in the database
    3577 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    1133 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    111 records added, 3194 records updated in the database
    3455 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    108 records added, 3161 records updated in the database
    3346 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    232 records removed, 3178 records updated in the database
    3234 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    463 records added, 2943 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    342 records removed, 2943 records updated in the database
    3001 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    286 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    91 records added, 2667 records updated in the database
    3342 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    3 records removed, 2378 records updated in the database
    3251 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    386 records added, 2886 records updated in the database
    3254 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    125 records removed, 2788 records updated in the database
    2874 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    3180 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2018 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    802 records removed, 2929 records updated in the database
    2972 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    103 records added, 3454 records updated in the database
    3719 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    7 records removed, 3538 records updated in the database
    3613 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    2531 records added, 1200 records updated in the database
    3616 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    3261 records removed, 1072 records updated in the database
    1186 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    62 records removed, 4303 records updated in the database
    4273 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    1 record removed, 4366 records updated in the database
    4316 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    819 records removed, 4432 records updated in the database
    4279 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    20 records removed, 4514 records updated in the database
    5072 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    3 records added, 5210 records updated in the database
    5090 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    684 records removed, 5245 records updated in the database
    5099 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    5499 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    80 records added, 5812 records updated in the database
    5714 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    767 records added, 5108 records updated in the database
    5643 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    842 records removed, 5107 records updated in the database
    4880 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    60 records added, 5689 records updated in the database
    5603 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    30 records removed, 5786 records updated in the database
    5571 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    202 records added, 5717 records updated in the database
    5602 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    605 records removed, 5644 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    794 records added, 5530 records updated in the database
    5913 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    613 records removed, 5456 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    2493 records added, 3657 records updated in the database
    5640 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    3234 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    607 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    5710 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    2322 pages scraped
  • Manually ran revision bcaa76e9 and failed .
    2686 records added, 968 records updated in the database
    3401 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    218 records added, 718 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    5820 records removed, 717 records updated in the database
    767 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    349 records removed, 6562 records updated in the database
    6044 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    660 records added, 5891 records updated in the database
    6351 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    6230 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    753 records removed, 6093 records updated in the database
    5793 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    118 records added, 6682 records updated in the database
    6473 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    406 records added, 6330 records updated in the database
    6432 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    678 records added, 5855 records updated in the database
    6101 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    6383 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    6197 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    6219 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    6331 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    316 records added, 5488 records updated in the database
    5533 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    772 records removed, 5573 records updated in the database
    5276 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    2885 records added, 2030 records updated in the database
    5995 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    952 records removed, 3262 records updated in the database
    3365 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
    6135 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    3977 records added, 353 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    nothing changed in the database
    3241 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    3657 records removed, 339 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    17 records removed, 3455 records updated in the database
    3966 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    356 records removed, 3898 records updated in the database
    4058 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    304 records removed, 4176 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    248 records removed, 4491 records updated in the database
    4585 pages scraped
  • Auto ran revision bcaa76e9 and failed .
    744 records added, 4180 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    21 records removed, 4034 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    21 records removed, 3652 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    123 records removed, 4235 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    415 records removed, 4228 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    132 records removed, 4606 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    158 records added, 4741 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    332 records removed, 4578 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    nothing changed in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    120 records added, 4631 records updated in the database
    77 pages scraped
  • Auto ran revision bcaa76e9 and completed successfully .
    144 records removed, 4812 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    99 records removed, 4945 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    337 records removed, 5048 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    259 records added, 5131 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    387 records removed, 5190 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    164 records added, 5081 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    6 records added, 4685 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    295 records removed, 5355 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    813 records added, 4954 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    219 records added, 4688 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    84 records added, 4529 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    831 records removed, 4455 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    404 records added, 4701 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    2 records removed, 5150 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    3068 records added, 1921 records updated in the database
  • Auto ran revision bcaa76e9 and failed .
    2716 records removed, 1796 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    46 records added, 4545 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    415 records removed, 4545 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    17 records removed, 4866 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    1 record removed, 4768 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    231 records added, 4902 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    391 records removed, 4897 records updated in the database
  • Auto ran revision bcaa76e9 and completed successfully .
    97 records added, 5260 records updated in the database
  • Manually ran revision bcaa76e9 and completed successfully .
    288 records added in the database
  • Manually ran revision bcaa76e9 and failed .
    5000 records added in the database
  • Manually ran revision 4af84c72 and failed .
    5288 records removed in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    254 records added, 5006 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    469 records added, 4332 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    332 records removed, 4305 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    533 records removed, 4638 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    490 records added, 4685 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    339 records removed, 4685 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    143 records added, 4930 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    531 records removed, 4904 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    166 records added, 5017 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    279 records added, 4881 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    520 records removed, 5186 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    106 records added, 5342 records updated in the database
  • Auto ran revision c9a86fe6 and completed successfully .
    nothing changed in the database
  • Manually ran revision c9a86fe6 and completed successfully .
    90 records removed, 5626 records updated in the database
  • Auto ran revision 01fe8b7d and completed successfully .
    560 records added, 4898 records updated in the database
  • Auto ran revision 421bfe02 and completed successfully .
    843 records removed, 5019 records updated in the database
  • Auto ran revision 421bfe02 and completed successfully .
    214 records added, 5353 records updated in the database
  • Auto ran revision 421bfe02 and completed successfully .
    1 record removed, 5397 records updated in the database
  • Auto ran revision 421bfe02 and completed successfully .
    285 records removed, 5519 records updated in the database
  • Manually ran revision 421bfe02 and completed successfully .
    6023 records added, 58 records updated in the database
  • Manually ran revision 65538fcf and failed .
    58 records added in the database
  • Manually ran revision 65538fcf and failed .
    nothing changed in the database
  • Manually ran revision d562ebdf and failed .
    nothing changed in the database
  • Manually ran revision 793d50e1 and failed .
    nothing changed in the database
  • Manually ran revision 8088d118 and failed .
    nothing changed in the database
  • Manually ran revision 6034cd3e and failed .
    nothing changed in the database
  • Manually ran revision e81b59af and failed .
    nothing changed in the database
  • Manually ran revision a6030871 and failed .
    nothing changed in the database
  • Manually ran revision 030cc230 and failed .
    5840 records removed in the database
  • Manually ran revision 1a2b04fd and completed successfully .
    5840 records added in the database
  • Manually ran revision 2cb615b6 and failed .
    nothing changed in the database
  • Manually ran revision 43309bff and failed .
    nothing changed in the database
  • Manually ran revision ddc191f6 and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Ruby

fbopen_data / scraper.rb