nloveladyallen / github_trending

Github Trending Repositories

Scrapes github.com and api.github.com

Build software better, together.


GitHub Trending Scraper

It scrapes the GitHub trending page!

This script uses Nokogiri to scrape https://github.com/trending, then gets info on each repo using the GitHub API. It is a morph.io-compatible scraper, meaning you can use it as an API as well as locally.

Setup

$ git clone https://github.com/nloveladyallen/github_trending
$ cd github_trending
$ bundle install

Usage

Locally

$ export MORPH_UNAME='yourgithubusername'
$ export MORPH_PWD='yourgithubpassword'
$ ./scraper.rb

Creates data.sqlite, containing one table, data, with one column for every part of the GitHub API and one row for every trending item (there are 25 at any given time).

API

Data from this scraper is available from morph.io. You must have a morph.io API key. Signing up is free, and only requires a GitHub account. A morph.io request looks like this:

GET https://api.morph.io/nloveladyallen/github_trending/data.[format]?key=[api_key]&query=[sql]

See the morph.io API documentation for more details.

Contributors nloveladyallen

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.1). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Using json 1.8.3  Fetching mini_portile2 2.3.0  Using bundler 1.15.2  Fetching sqlite3 1.3.11  Installing mini_portile2 2.3.0  Installing sqlite3 1.3.11 with native extensions  Fetching nokogiri 1.8.1  Installing nokogiri 1.8.1 with native extensions  Bundle complete! 3 Gemfile dependencies, 5 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (18.21s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.1). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Inserting trekhleb/javascript-algorithms Inserting wiredjs/wired-elements Inserting ambv/black Inserting danistefanovic/build-your-own-x Inserting guardicore/monkey Inserting duckythescientist/SmoothLife Inserting NervanaSystems/nlp-architect Inserting mimecorg/vuido Inserting openai/retro Inserting xingshaocheng/architect-awesome Inserting GetStream/Winds Inserting golangci/golangci-lint Inserting tensorflow/tensorflow Inserting davideuler/architecture.of.internet-product Inserting hybridsjs/hybrids Inserting facebook/react Inserting klauscfhq/signale Inserting awesomedata/awesome-public-datasets Inserting naturaln0va/VisualActivityViewController Inserting vuejs/vue Inserting nim-lang/nimforum Inserting easy-tensorflow/easy-tensorflow Inserting phan/phan Inserting ElemeFE/v-charts Inserting ddnexus/pagy

Data

Downloaded 2 times by nloveladyallen MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (113 KB) Use the API

rows 10 / 25

archive_url archived assignees_url blobs_url branches_url clone_url collaborators_url comments_url commits_url compare_url contents_url contributors_url created_at default_branch deployments_url description downloads_url events_url fork forks forks_count forks_url full_name git_commits_url git_refs_url git_tags_url git_url has_downloads has_issues has_pages has_projects has_wiki homepage hooks_url html_url id issue_comment_url issue_events_url issues_url keys_url labels_url language languages_url license_key license_name license_spdx_id license_url merges_url milestones_url mirror_url name network_count notifications_url open_issues open_issues_count organization_login organization_id organization_avatar_url organization_gravatar_id organization_url organization_html_url organization_followers_url organization_following_url organization_gists_url organization_starred_url organization_subscriptions_url organization_organizations_url organization_repos_url organization_events_url organization_received_events_url organization_type organization_site_admin owner_login owner_id owner_avatar_url owner_gravatar_id owner_url owner_html_url owner_followers_url owner_following_url owner_gists_url owner_starred_url owner_subscriptions_url owner_organizations_url owner_repos_url owner_events_url owner_received_events_url owner_type owner_site_admin parent permissions_admin permissions_push permissions_pull private pulls_url pushed_at releases_url size source ssh_url stargazers_count stargazers_url statuses_url subscribers_count subscribers_url subscription_url svn_url tags_url teams_url trees_url updated_at url watchers watchers_count
https://api.github.com/repos/trekhleb/javascript-algorithms/{archive_format}{/ref}
false
https://api.github.com/repos/trekhleb/javascript-algorithms/assignees{/user}
https://api.github.com/repos/trekhleb/javascript-algorithms/git/blobs{/sha}
https://api.github.com/repos/trekhleb/javascript-algorithms/branches{/branch}
https://api.github.com/repos/trekhleb/javascript-algorithms/collaborators{/collaborator}
https://api.github.com/repos/trekhleb/javascript-algorithms/comments{/number}
https://api.github.com/repos/trekhleb/javascript-algorithms/commits{/sha}
https://api.github.com/repos/trekhleb/javascript-algorithms/compare/{base}...{head}
https://api.github.com/repos/trekhleb/javascript-algorithms/contents/{+path}
2018-03-24T07:47:04Z
master
Algorithms and data structures implemented in JavaScript with explanations and links to further readings
false
971
971
trekhleb/javascript-algorithms
https://api.github.com/repos/trekhleb/javascript-algorithms/git/commits{/sha}
https://api.github.com/repos/trekhleb/javascript-algorithms/git/refs{/sha}
https://api.github.com/repos/trekhleb/javascript-algorithms/git/tags{/sha}
git://github.com/trekhleb/javascript-algorithms.git
true
true
false
false
false
126577260
https://api.github.com/repos/trekhleb/javascript-algorithms/issues/comments{/number}
https://api.github.com/repos/trekhleb/javascript-algorithms/issues/events{/number}
https://api.github.com/repos/trekhleb/javascript-algorithms/issues{/number}
https://api.github.com/repos/trekhleb/javascript-algorithms/keys{/key_id}
https://api.github.com/repos/trekhleb/javascript-algorithms/labels{/name}
JavaScript
mit
MIT License
MIT
https://api.github.com/repos/trekhleb/javascript-algorithms/milestones{/number}
javascript-algorithms
971
https://api.github.com/repos/trekhleb/javascript-algorithms/notifications{?since,all,participating}
9
9
trekhleb
3000285
https://api.github.com/users/trekhleb/following{/other_user}
https://api.github.com/users/trekhleb/gists{/gist_id}
https://api.github.com/users/trekhleb/starred{/owner}{/repo}
https://api.github.com/users/trekhleb/events{/privacy}
User
false
trekhleb
3000285
https://api.github.com/users/trekhleb/following{/other_user}
https://api.github.com/users/trekhleb/gists{/gist_id}
https://api.github.com/users/trekhleb/starred{/owner}{/repo}
https://api.github.com/users/trekhleb/events{/privacy}
User
false
false
false
true
false
https://api.github.com/repos/trekhleb/javascript-algorithms/pulls{/number}
2018-05-26T10:42:29Z
https://api.github.com/repos/trekhleb/javascript-algorithms/releases{/id}
1603
git@github.com:trekhleb/javascript-algorithms.git
11196
https://api.github.com/repos/trekhleb/javascript-algorithms/statuses/{sha}
485
https://api.github.com/repos/trekhleb/javascript-algorithms/git/trees{/sha}
2018-05-26T23:59:55Z
11196
11196
https://api.github.com/repos/wiredjs/wired-elements/{archive_format}{/ref}
false
https://api.github.com/repos/wiredjs/wired-elements/assignees{/user}
https://api.github.com/repos/wiredjs/wired-elements/git/blobs{/sha}
https://api.github.com/repos/wiredjs/wired-elements/branches{/branch}
https://api.github.com/repos/wiredjs/wired-elements/collaborators{/collaborator}
https://api.github.com/repos/wiredjs/wired-elements/comments{/number}
https://api.github.com/repos/wiredjs/wired-elements/commits{/sha}
https://api.github.com/repos/wiredjs/wired-elements/compare/{base}...{head}
https://api.github.com/repos/wiredjs/wired-elements/contents/{+path}
2017-08-28T06:12:03Z
master
Collection of elements that appear hand drawn. Great for wireframes.
false
45
45
wiredjs/wired-elements
https://api.github.com/repos/wiredjs/wired-elements/git/commits{/sha}
https://api.github.com/repos/wiredjs/wired-elements/git/refs{/sha}
https://api.github.com/repos/wiredjs/wired-elements/git/tags{/sha}
git://github.com/wiredjs/wired-elements.git
true
true
true
true
true
101609772
https://api.github.com/repos/wiredjs/wired-elements/issues/comments{/number}
https://api.github.com/repos/wiredjs/wired-elements/issues/events{/number}
https://api.github.com/repos/wiredjs/wired-elements/issues{/number}
https://api.github.com/repos/wiredjs/wired-elements/keys{/key_id}
https://api.github.com/repos/wiredjs/wired-elements/labels{/name}
JavaScript
mit
MIT License
MIT
https://api.github.com/repos/wiredjs/wired-elements/milestones{/number}
wired-elements
45
https://api.github.com/repos/wiredjs/wired-elements/notifications{?since,all,participating}
5
5
wiredjs
29725493
https://api.github.com/users/wiredjs/following{/other_user}
https://api.github.com/users/wiredjs/gists{/gist_id}
https://api.github.com/users/wiredjs/starred{/owner}{/repo}
https://api.github.com/users/wiredjs/events{/privacy}
Organization
false
wiredjs
29725493
https://api.github.com/users/wiredjs/following{/other_user}
https://api.github.com/users/wiredjs/gists{/gist_id}
https://api.github.com/users/wiredjs/starred{/owner}{/repo}
https://api.github.com/users/wiredjs/events{/privacy}
Organization
false
false
false
true
false
https://api.github.com/repos/wiredjs/wired-elements/pulls{/number}
2018-05-26T21:16:58Z
https://api.github.com/repos/wiredjs/wired-elements/releases{/id}
213
git@github.com:wiredjs/wired-elements.git
2299
https://api.github.com/repos/wiredjs/wired-elements/statuses/{sha}
47
https://api.github.com/repos/wiredjs/wired-elements/git/trees{/sha}
2018-05-26T23:57:20Z
2299
2299
https://api.github.com/repos/ambv/black/{archive_format}{/ref}
false
https://api.github.com/repos/ambv/black/assignees{/user}
https://api.github.com/repos/ambv/black/git/blobs{/sha}
https://api.github.com/repos/ambv/black/branches{/branch}
https://api.github.com/repos/ambv/black/collaborators{/collaborator}
https://api.github.com/repos/ambv/black/comments{/number}
https://api.github.com/repos/ambv/black/commits{/sha}
https://api.github.com/repos/ambv/black/compare/{base}...{head}
https://api.github.com/repos/ambv/black/contents/{+path}
2018-03-14T19:54:45Z
master
The uncompromising Python code formatter
false
113
113
ambv/black
https://api.github.com/repos/ambv/black/git/commits{/sha}
https://api.github.com/repos/ambv/black/git/refs{/sha}
https://api.github.com/repos/ambv/black/git/tags{/sha}
git://github.com/ambv/black.git
true
true
false
true
true
125266328
https://api.github.com/repos/ambv/black/issues/comments{/number}
https://api.github.com/repos/ambv/black/issues/events{/number}
https://api.github.com/repos/ambv/black/issues{/number}
https://api.github.com/repos/ambv/black/keys{/key_id}
https://api.github.com/repos/ambv/black/labels{/name}
Python
mit
MIT License
MIT
https://api.github.com/repos/ambv/black/milestones{/number}
black
113
https://api.github.com/repos/ambv/black/notifications{?since,all,participating}
33
33
ambv
55281
https://api.github.com/users/ambv/following{/other_user}
https://api.github.com/users/ambv/gists{/gist_id}
https://api.github.com/users/ambv/starred{/owner}{/repo}
https://api.github.com/users/ambv/events{/privacy}
User
false
ambv
55281
https://api.github.com/users/ambv/following{/other_user}
https://api.github.com/users/ambv/gists{/gist_id}
https://api.github.com/users/ambv/starred{/owner}{/repo}
https://api.github.com/users/ambv/events{/privacy}
User
false
false
false
true
false
https://api.github.com/repos/ambv/black/pulls{/number}
2018-05-26T20:01:18Z
https://api.github.com/repos/ambv/black/releases{/id}
1743
git@github.com:ambv/black.git
3196
https://api.github.com/repos/ambv/black/statuses/{sha}
66
https://api.github.com/repos/ambv/black/git/trees{/sha}
2018-05-26T23:59:33Z
3196
3196
https://api.github.com/repos/danistefanovic/build-your-own-x/{archive_format}{/ref}
false
https://api.github.com/repos/danistefanovic/build-your-own-x/assignees{/user}
https://api.github.com/repos/danistefanovic/build-your-own-x/git/blobs{/sha}
https://api.github.com/repos/danistefanovic/build-your-own-x/branches{/branch}
https://api.github.com/repos/danistefanovic/build-your-own-x/collaborators{/collaborator}
https://api.github.com/repos/danistefanovic/build-your-own-x/comments{/number}
https://api.github.com/repos/danistefanovic/build-your-own-x/commits{/sha}
https://api.github.com/repos/danistefanovic/build-your-own-x/compare/{base}...{head}
https://api.github.com/repos/danistefanovic/build-your-own-x/contents/{+path}
2018-05-09T12:03:18Z
master
🤓 Build your own (insert technology here)
false
1341
1341
danistefanovic/build-your-own-x
https://api.github.com/repos/danistefanovic/build-your-own-x/git/commits{/sha}
https://api.github.com/repos/danistefanovic/build-your-own-x/git/refs{/sha}
https://api.github.com/repos/danistefanovic/build-your-own-x/git/tags{/sha}
git://github.com/danistefanovic/build-your-own-x.git
true
true
false
false
false
132750724
https://api.github.com/repos/danistefanovic/build-your-own-x/issues/comments{/number}
https://api.github.com/repos/danistefanovic/build-your-own-x/issues/events{/number}
https://api.github.com/repos/danistefanovic/build-your-own-x/issues{/number}
https://api.github.com/repos/danistefanovic/build-your-own-x/keys{/key_id}
https://api.github.com/repos/danistefanovic/build-your-own-x/labels{/name}
https://api.github.com/repos/danistefanovic/build-your-own-x/milestones{/number}
build-your-own-x
1341
https://api.github.com/repos/danistefanovic/build-your-own-x/notifications{?since,all,participating}
5
5
danistefanovic
1736595
https://api.github.com/users/danistefanovic/following{/other_user}
https://api.github.com/users/danistefanovic/gists{/gist_id}
https://api.github.com/users/danistefanovic/starred{/owner}{/repo}
https://api.github.com/users/danistefanovic/events{/privacy}
User
false
danistefanovic
1736595
https://api.github.com/users/danistefanovic/following{/other_user}
https://api.github.com/users/danistefanovic/gists{/gist_id}
https://api.github.com/users/danistefanovic/starred{/owner}{/repo}
https://api.github.com/users/danistefanovic/events{/privacy}
User
false
false
false
true
false
https://api.github.com/repos/danistefanovic/build-your-own-x/pulls{/number}
2018-05-26T16:12:03Z
https://api.github.com/repos/danistefanovic/build-your-own-x/releases{/id}
707
git@github.com:danistefanovic/build-your-own-x.git
25181
https://api.github.com/repos/danistefanovic/build-your-own-x/statuses/{sha}
926
https://api.github.com/repos/danistefanovic/build-your-own-x/git/trees{/sha}
2018-05-27T00:01:32Z
25181
25181
https://api.github.com/repos/guardicore/monkey/{archive_format}{/ref}
false
https://api.github.com/repos/guardicore/monkey/assignees{/user}
https://api.github.com/repos/guardicore/monkey/git/blobs{/sha}
https://api.github.com/repos/guardicore/monkey/branches{/branch}
https://api.github.com/repos/guardicore/monkey/collaborators{/collaborator}
https://api.github.com/repos/guardicore/monkey/comments{/number}
https://api.github.com/repos/guardicore/monkey/commits{/sha}
https://api.github.com/repos/guardicore/monkey/compare/{base}...{head}
https://api.github.com/repos/guardicore/monkey/contents/{+path}
2015-08-30T07:22:51Z
develop
Infection Monkey - An automated pentest tool
false
184
184
guardicore/monkey
https://api.github.com/repos/guardicore/monkey/git/commits{/sha}
https://api.github.com/repos/guardicore/monkey/git/refs{/sha}
https://api.github.com/repos/guardicore/monkey/git/tags{/sha}
git://github.com/guardicore/monkey.git
true
true
false
true
true
41620215
https://api.github.com/repos/guardicore/monkey/issues/comments{/number}
https://api.github.com/repos/guardicore/monkey/issues/events{/number}
https://api.github.com/repos/guardicore/monkey/issues{/number}
https://api.github.com/repos/guardicore/monkey/keys{/key_id}
https://api.github.com/repos/guardicore/monkey/labels{/name}
Python
gpl-3.0
GNU General Public License v3.0
GPL-3.0
https://api.github.com/repos/guardicore/monkey/milestones{/number}
monkey
184
https://api.github.com/repos/guardicore/monkey/notifications{?since,all,participating}
11
11
guardicore
5675395
https://api.github.com/users/guardicore/following{/other_user}
https://api.github.com/users/guardicore/gists{/gist_id}
https://api.github.com/users/guardicore/starred{/owner}{/repo}
https://api.github.com/users/guardicore/events{/privacy}
Organization
false
guardicore
5675395
https://api.github.com/users/guardicore/following{/other_user}
https://api.github.com/users/guardicore/gists{/gist_id}
https://api.github.com/users/guardicore/starred{/owner}{/repo}
https://api.github.com/users/guardicore/events{/privacy}
Organization
false
false
false
true
false
https://api.github.com/repos/guardicore/monkey/pulls{/number}
2018-05-24T22:34:34Z
https://api.github.com/repos/guardicore/monkey/releases{/id}
4067
git@github.com:guardicore/monkey.git
1838
https://api.github.com/repos/guardicore/monkey/statuses/{sha}
123
https://api.github.com/repos/guardicore/monkey/git/trees{/sha}
2018-05-26T23:54:22Z
1838
1838
https://api.github.com/repos/duckythescientist/SmoothLife/{archive_format}{/ref}
false
https://api.github.com/repos/duckythescientist/SmoothLife/assignees{/user}
https://api.github.com/repos/duckythescientist/SmoothLife/git/blobs{/sha}
https://api.github.com/repos/duckythescientist/SmoothLife/branches{/branch}
https://api.github.com/repos/duckythescientist/SmoothLife/collaborators{/collaborator}
https://api.github.com/repos/duckythescientist/SmoothLife/comments{/number}
https://api.github.com/repos/duckythescientist/SmoothLife/commits{/sha}
https://api.github.com/repos/duckythescientist/SmoothLife/compare/{base}...{head}
https://api.github.com/repos/duckythescientist/SmoothLife/contents/{+path}
2018-05-21T16:43:21Z
master
Continuous Domain Game of Life in Python with Numpy
false
8
8
duckythescientist/SmoothLife
https://api.github.com/repos/duckythescientist/SmoothLife/git/commits{/sha}
https://api.github.com/repos/duckythescientist/SmoothLife/git/refs{/sha}
https://api.github.com/repos/duckythescientist/SmoothLife/git/tags{/sha}
git://github.com/duckythescientist/SmoothLife.git
true
true
false
true
true
134297237
https://api.github.com/repos/duckythescientist/SmoothLife/issues/comments{/number}
https://api.github.com/repos/duckythescientist/SmoothLife/issues/events{/number}
https://api.github.com/repos/duckythescientist/SmoothLife/issues{/number}
https://api.github.com/repos/duckythescientist/SmoothLife/keys{/key_id}
https://api.github.com/repos/duckythescientist/SmoothLife/labels{/name}
Python
gpl-3.0
GNU General Public License v3.0
GPL-3.0
https://api.github.com/repos/duckythescientist/SmoothLife/milestones{/number}
SmoothLife
8
https://api.github.com/repos/duckythescientist/SmoothLife/notifications{?since,all,participating}
1
1
duckythescientist
3130502
https://api.github.com/users/duckythescientist/following{/other_user}
https://api.github.com/users/duckythescientist/gists{/gist_id}
https://api.github.com/users/duckythescientist/starred{/owner}{/repo}
https://api.github.com/users/duckythescientist/events{/privacy}
User
false
duckythescientist
3130502
https://api.github.com/users/duckythescientist/following{/other_user}
https://api.github.com/users/duckythescientist/gists{/gist_id}
https://api.github.com/users/duckythescientist/starred{/owner}{/repo}
https://api.github.com/users/duckythescientist/events{/privacy}
User
false
false
false
true
false
https://api.github.com/repos/duckythescientist/SmoothLife/pulls{/number}
2018-05-26T19:58:45Z
https://api.github.com/repos/duckythescientist/SmoothLife/releases{/id}
1714
git@github.com:duckythescientist/SmoothLife.git
282
https://api.github.com/repos/duckythescientist/SmoothLife/statuses/{sha}
11
https://api.github.com/repos/duckythescientist/SmoothLife/git/trees{/sha}
2018-05-26T23:57:24Z
282
282
https://api.github.com/repos/NervanaSystems/nlp-architect/{archive_format}{/ref}
false
https://api.github.com/repos/NervanaSystems/nlp-architect/assignees{/user}
https://api.github.com/repos/NervanaSystems/nlp-architect/git/blobs{/sha}
https://api.github.com/repos/NervanaSystems/nlp-architect/branches{/branch}
https://api.github.com/repos/NervanaSystems/nlp-architect/collaborators{/collaborator}
https://api.github.com/repos/NervanaSystems/nlp-architect/comments{/number}
https://api.github.com/repos/NervanaSystems/nlp-architect/commits{/sha}
https://api.github.com/repos/NervanaSystems/nlp-architect/compare/{base}...{head}
https://api.github.com/repos/NervanaSystems/nlp-architect/contents/{+path}
2018-05-17T21:00:13Z
master
NLP Architect by Intel AI Lab: Python library for exploring the state-of-the-art deep learning topologies and techniques for natural language processing and natural language understanding
false
20
20
NervanaSystems/nlp-architect
https://api.github.com/repos/NervanaSystems/nlp-architect/git/commits{/sha}
https://api.github.com/repos/NervanaSystems/nlp-architect/git/refs{/sha}
https://api.github.com/repos/NervanaSystems/nlp-architect/git/tags{/sha}
git://github.com/NervanaSystems/nlp-architect.git
true
true
false
true
true
133867923
https://api.github.com/repos/NervanaSystems/nlp-architect/issues/comments{/number}
https://api.github.com/repos/NervanaSystems/nlp-architect/issues/events{/number}
https://api.github.com/repos/NervanaSystems/nlp-architect/issues{/number}
https://api.github.com/repos/NervanaSystems/nlp-architect/keys{/key_id}
https://api.github.com/repos/NervanaSystems/nlp-architect/labels{/name}
Python
apache-2.0
Apache License 2.0
Apache-2.0
https://api.github.com/repos/NervanaSystems/nlp-architect/milestones{/number}
nlp-architect
20
https://api.github.com/repos/NervanaSystems/nlp-architect/notifications{?since,all,participating}
1
1
NervanaSystems
9260121
https://api.github.com/users/NervanaSystems/following{/other_user}
https://api.github.com/users/NervanaSystems/gists{/gist_id}
https://api.github.com/users/NervanaSystems/starred{/owner}{/repo}
https://api.github.com/users/NervanaSystems/events{/privacy}
Organization
false
NervanaSystems
9260121
https://api.github.com/users/NervanaSystems/following{/other_user}
https://api.github.com/users/NervanaSystems/gists{/gist_id}
https://api.github.com/users/NervanaSystems/starred{/owner}{/repo}
https://api.github.com/users/NervanaSystems/events{/privacy}
Organization
false
false
false
true
false
https://api.github.com/repos/NervanaSystems/nlp-architect/pulls{/number}
2018-05-25T17:55:22Z
https://api.github.com/repos/NervanaSystems/nlp-architect/releases{/id}
39656
git@github.com:NervanaSystems/nlp-architect.git
407
https://api.github.com/repos/NervanaSystems/nlp-architect/statuses/{sha}
51
https://api.github.com/repos/NervanaSystems/nlp-architect/git/trees{/sha}
2018-05-26T23:57:28Z
407
407
https://api.github.com/repos/mimecorg/vuido/{archive_format}{/ref}
false
https://api.github.com/repos/mimecorg/vuido/assignees{/user}
https://api.github.com/repos/mimecorg/vuido/git/blobs{/sha}
https://api.github.com/repos/mimecorg/vuido/branches{/branch}
https://api.github.com/repos/mimecorg/vuido/collaborators{/collaborator}
https://api.github.com/repos/mimecorg/vuido/comments{/number}
https://api.github.com/repos/mimecorg/vuido/commits{/sha}
https://api.github.com/repos/mimecorg/vuido/compare/{base}...{head}
https://api.github.com/repos/mimecorg/vuido/contents/{+path}
2018-05-17T18:12:02Z
master
Native desktop applications using Vue.js.
false
79
79
mimecorg/vuido
https://api.github.com/repos/mimecorg/vuido/git/commits{/sha}
https://api.github.com/repos/mimecorg/vuido/git/refs{/sha}
https://api.github.com/repos/mimecorg/vuido/git/tags{/sha}
git://github.com/mimecorg/vuido.git
true
true
false
false
false
133851398
https://api.github.com/repos/mimecorg/vuido/issues/comments{/number}
https://api.github.com/repos/mimecorg/vuido/issues/events{/number}
https://api.github.com/repos/mimecorg/vuido/issues{/number}
https://api.github.com/repos/mimecorg/vuido/keys{/key_id}
https://api.github.com/repos/mimecorg/vuido/labels{/name}
JavaScript
mit
MIT License
MIT
https://api.github.com/repos/mimecorg/vuido/milestones{/number}
vuido
79
https://api.github.com/repos/mimecorg/vuido/notifications{?since,all,participating}
8
8
mimecorg
36986002
https://api.github.com/users/mimecorg/following{/other_user}
https://api.github.com/users/mimecorg/gists{/gist_id}
https://api.github.com/users/mimecorg/starred{/owner}{/repo}
https://api.github.com/users/mimecorg/events{/privacy}
User
false
mimecorg
36986002
https://api.github.com/users/mimecorg/following{/other_user}
https://api.github.com/users/mimecorg/gists{/gist_id}
https://api.github.com/users/mimecorg/starred{/owner}{/repo}
https://api.github.com/users/mimecorg/events{/privacy}
User
false
false
false
true
false
https://api.github.com/repos/mimecorg/vuido/pulls{/number}
2018-05-25T20:50:03Z
https://api.github.com/repos/mimecorg/vuido/releases{/id}
301
git@github.com:mimecorg/vuido.git
2782
https://api.github.com/repos/mimecorg/vuido/statuses/{sha}
120
https://api.github.com/repos/mimecorg/vuido/git/trees{/sha}
2018-05-26T23:52:01Z
2782
2782
https://api.github.com/repos/openai/retro/{archive_format}{/ref}
false
https://api.github.com/repos/openai/retro/assignees{/user}
https://api.github.com/repos/openai/retro/git/blobs{/sha}
https://api.github.com/repos/openai/retro/branches{/branch}
https://api.github.com/repos/openai/retro/collaborators{/collaborator}
https://api.github.com/repos/openai/retro/comments{/number}
https://api.github.com/repos/openai/retro/commits{/sha}
https://api.github.com/repos/openai/retro/compare/{base}...{head}
https://api.github.com/repos/openai/retro/contents/{+path}
2018-02-07T00:32:02Z
master
Retro Games in Gym
false
76
76
openai/retro
https://api.github.com/repos/openai/retro/git/commits{/sha}
https://api.github.com/repos/openai/retro/git/refs{/sha}
https://api.github.com/repos/openai/retro/git/tags{/sha}
git://github.com/openai/retro.git
true
true
false
true
true
120541397
https://api.github.com/repos/openai/retro/issues/comments{/number}
https://api.github.com/repos/openai/retro/issues/events{/number}
https://api.github.com/repos/openai/retro/issues{/number}
https://api.github.com/repos/openai/retro/keys{/key_id}
https://api.github.com/repos/openai/retro/labels{/name}
Python
mit
MIT License
MIT
https://api.github.com/repos/openai/retro/milestones{/number}
retro
76
https://api.github.com/repos/openai/retro/notifications{?since,all,participating}
13
13
openai
14957082
https://api.github.com/users/openai/following{/other_user}
https://api.github.com/users/openai/gists{/gist_id}
https://api.github.com/users/openai/starred{/owner}{/repo}
https://api.github.com/users/openai/events{/privacy}
Organization
false
openai
14957082
https://api.github.com/users/openai/following{/other_user}
https://api.github.com/users/openai/gists{/gist_id}
https://api.github.com/users/openai/starred{/owner}{/repo}
https://api.github.com/users/openai/events{/privacy}
Organization
false
false
false
true
false
https://api.github.com/repos/openai/retro/pulls{/number}
2018-05-25T16:03:19Z
https://api.github.com/repos/openai/retro/releases{/id}
145574
git@github.com:openai/retro.git
692
https://api.github.com/repos/openai/retro/statuses/{sha}
40
https://api.github.com/repos/openai/retro/git/trees{/sha}
2018-05-26T23:57:33Z
692
692
https://api.github.com/repos/xingshaocheng/architect-awesome/{archive_format}{/ref}
false
https://api.github.com/repos/xingshaocheng/architect-awesome/assignees{/user}
https://api.github.com/repos/xingshaocheng/architect-awesome/git/blobs{/sha}
https://api.github.com/repos/xingshaocheng/architect-awesome/branches{/branch}
https://api.github.com/repos/xingshaocheng/architect-awesome/collaborators{/collaborator}
https://api.github.com/repos/xingshaocheng/architect-awesome/comments{/number}
https://api.github.com/repos/xingshaocheng/architect-awesome/commits{/sha}
https://api.github.com/repos/xingshaocheng/architect-awesome/compare/{base}...{head}
https://api.github.com/repos/xingshaocheng/architect-awesome/contents/{+path}
2018-04-06T13:30:58Z
master
后端架构师技术图谱
false
4126
4126
xingshaocheng/architect-awesome
https://api.github.com/repos/xingshaocheng/architect-awesome/git/commits{/sha}
https://api.github.com/repos/xingshaocheng/architect-awesome/git/refs{/sha}
https://api.github.com/repos/xingshaocheng/architect-awesome/git/tags{/sha}
git://github.com/xingshaocheng/architect-awesome.git
true
true
false
true
true
128398636
https://api.github.com/repos/xingshaocheng/architect-awesome/issues/comments{/number}
https://api.github.com/repos/xingshaocheng/architect-awesome/issues/events{/number}
https://api.github.com/repos/xingshaocheng/architect-awesome/issues{/number}
https://api.github.com/repos/xingshaocheng/architect-awesome/keys{/key_id}
https://api.github.com/repos/xingshaocheng/architect-awesome/labels{/name}
https://api.github.com/repos/xingshaocheng/architect-awesome/milestones{/number}
architect-awesome
4126
https://api.github.com/repos/xingshaocheng/architect-awesome/notifications{?since,all,participating}
13
13
xingshaocheng
4962837
https://api.github.com/users/xingshaocheng/following{/other_user}
https://api.github.com/users/xingshaocheng/gists{/gist_id}
https://api.github.com/users/xingshaocheng/starred{/owner}{/repo}
https://api.github.com/users/xingshaocheng/events{/privacy}
User
false
xingshaocheng
4962837
https://api.github.com/users/xingshaocheng/following{/other_user}
https://api.github.com/users/xingshaocheng/gists{/gist_id}
https://api.github.com/users/xingshaocheng/starred{/owner}{/repo}
https://api.github.com/users/xingshaocheng/events{/privacy}
User
false
false
false
true
false
https://api.github.com/repos/xingshaocheng/architect-awesome/pulls{/number}
2018-05-24T03:04:48Z
https://api.github.com/repos/xingshaocheng/architect-awesome/releases{/id}
267
git@github.com:xingshaocheng/architect-awesome.git
17040
https://api.github.com/repos/xingshaocheng/architect-awesome/statuses/{sha}
1268
https://api.github.com/repos/xingshaocheng/architect-awesome/git/trees{/sha}
2018-05-26T19:53:27Z
17040
17040

Statistics

Average successful run time: 1 minute

Total run time: about 1 month

Total cpu time used: 30 minutes

Total disk space used: 154 KB

History

  • Auto ran revision 87afbde5 and completed successfully .
    25 records updated in the database
    51 pages scraped
  • Auto ran revision 87afbde5 and completed successfully .
    25 records updated in the database
    51 pages scraped
  • Auto ran revision 87afbde5 and completed successfully .
    25 records updated in the database
    51 pages scraped
  • Auto ran revision 87afbde5 and completed successfully .
    25 records updated in the database
    51 pages scraped
  • Auto ran revision 87afbde5 and completed successfully .
    25 records updated in the database
    51 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

github_trending / scraper.rb