davidk01 / hacker_news_front_page

Posts on the front page of HN

Scrapes news.ycombinator.com

Hacker News


Testing out morph.io with a simple scraper for front page of HN.

Contributors davidk01

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Found some comments: Show HN: Intuitive Linear Algebra and 3D Geometry, 1 Creating DB item Found some comments: Europe’s New Privacy Rules Favor Google and Facebook, 20 Creating DB item Found some comments: Fast website link checker in Go, 22 Creating DB item No comments yet for this entry: Taking a Stroll Between the Pixels Creating DB item Found some comments: The Chinese Car Invasion Is Coming, 19 Creating DB item Found some comments: MIT Researchers Have Developed a ‘System for Dream Control’, 118 Creating DB item Found some comments: Jenkins X: a CI/CD solution for cloud applications on Kubernetes, 13 Creating DB item Found some comments: Now Is the Perfect Time for an RSS Renaissance, 194 Creating DB item Found some comments: Using USB-VGA dongles as SDR transmitter, 39 Creating DB item Found some comments: Johns Hopkins surgeons perform world's first male genital transplant, 42 Creating DB item Found some comments: Planning a Morrowind all-faction speedrun with simulated annealing, part 2, 16 Creating DB item Found some comments: An Introduction to Hashing in the Era of Machine Learning, 13 Creating DB item Found some comments: Hand Made Vacuum Tubes by Claude Paillard, 2 Creating DB item No comments yet for this entry: Migrating to React’s New Context API Creating DB item Found some comments: Quantum radar will expose stealth aircraft, 2 Creating DB item Found some comments: The last day of linotype at the NYT (1978) [video], 56 Creating DB item Found some comments: Qt for WebAssembly Technology Preview, 100 Creating DB item Found some comments: Scientists plan huge European AI hub to compete with US, 2 Creating DB item Found some comments: Accelerating Deep Neuroevolution: Train Atari in Hours on a Single Computer, 29 Creating DB item Found some comments: Leonard Bernstein invented how we do modern classical music, 5 Creating DB item Found some comments: How DNA Transfer Framed Lukis Anderson for Murder, 7 Creating DB item Found some comments: IAmA Dane Jasper, CEO of Sonic, Northern California's Largest Independent ISP, 10 Creating DB item Found some comments: YouTube networks drop thousands of creators as YouTube policy shifts, 51 Creating DB item Found some comments: Tech company career ladders, 53 Creating DB item Found some comments: On Becoming an American Writer, 13 Creating DB item Found some comments: Why it took a long time to build the tiny link preview on Wikipedia, 223 Creating DB item Found some comments: The Many Ways Google Harvests Data, 164 Creating DB item No poits. Assuming job post: Gusto is hiring full-stack developers in SF and Denver Found some comments: New DNA structure inside human cells known as the “i-motif” has been identified, 6 Creating DB item Found some comments: New AI Imaging Technique Reconstructs Photos with Realistic Results, 60 Creating DB item Found some comments: The Forgotten Home of Tennis’s Open Era, 3 Creating DB item Found some comments: The “unpatchable” exploit that makes every current Nintendo Switch hackable, 42 Creating DB item Found some comments: Whether Ethereum is a security, 26 Creating DB item Found some comments: Show HN: Giving a Broken Barcode Scanner a New Life with Elixir and Nerves, 52 Creating DB item Found some comments: Show HN: A collection of recursive CSS specimens, 5 Creating DB item Found some comments: Ask HN: What are the alternatives of hosting Apache Spark?, 11 Creating DB item Found some comments: ASP.NET Core MVC vs. Razor Pages – A quick comparison, 14 Creating DB item Found some comments: Show HN: HTTP/2 Python-Asyncio Web Microframework, 37 Creating DB item Found some comments: Google is bleeding cash trying to take on Amazon in the smart home, 20 Creating DB item Found some comments: Alphabet Q1 2018 Earnings [pdf], 128 Creating DB item No comments yet for this entry: What the Archaeology of Night Reveals Creating DB item Found some comments: How I Write SQL, Part 1: Naming Conventions (2014), 71 Creating DB item Found some comments: How Many Genes Do Cells Need? Maybe Almost All of Them, 18 Creating DB item Found some comments: Show HN: Interactive WebGL visualization of all 47K buildings in Manhattan, 33 Creating DB item Found some comments: Show HN: API store, 11 Creating DB item Found some comments: Deep Probabilistic Programming Languages: A Qualitative Study, 1 Creating DB item Found some comments: China, India grapple with the consequences too many men, 126 Creating DB item Found some comments: Show HN: “Is this loss?”: A TensorFlow Lite app to detect Loss.jpg, 31 Creating DB item Found some comments: How vulture capitalists ate Toys 'R' Us, 157 Creating DB item Found some comments: Ask HN: Why don't more entrepreneurs focus on lifestyle businesses?, 15 Creating DB item Found some comments: Show HN: Create a personalized and optimized webpack configuration, 43 Creating DB item Found some comments: Why Stanislaw Lem’s futurism deserves attention (2015), 70 Creating DB item Found some comments: How Windmills as Wide as Jumbo Jets Are Making Clean Energy Mainstream, 256 Creating DB item Found some comments: You probably don't need AI/ML. You can make do with well written SQL scripts, 307 Creating DB item Found some comments: Finland Ends Universal Basic Income Experiment, 1 Creating DB item Found some comments: My account is sending spam emails, 143 Creating DB item Found some comments: Chinese Tech Companies’ Dirty Secret [video], 39 Creating DB item Found some comments: A blockchain is a specific set of choices suitable for a narrow set of use-cases, 305 Creating DB item Found some comments: Gerontopoly: Homeownership, wealth, and age, 124 Creating DB item Found some comments: The Future of Software Is No Code, 165 Creating DB item Found some comments: The Modern Mini Cooper’s Designer Is Now Working on Flying Cars, 2 Creating DB item Found some comments: 53% did not delete FB or tighten their privacy settings post Cambridge Analytica, 6 Creating DB item Found some comments: Creating a Google Docs clone with WebSockets, 2 Creating DB item Found some comments: Software Testing Anti-patterns, 150 Creating DB item Found some comments: Underestimating the mind-warping potential of fake video, 177 Creating DB item Found some comments: What’s Not Included in Facebook’s “Download Your Data”, 87 Creating DB item Found some comments: The Art of Picking Intel Registers (2003), 40 Creating DB item Found some comments: Apple open-sources FoundationDB, 424 Creating DB item Found some comments: Hyper 2, Electron based terminal, 209 Creating DB item Found some comments: Artificial intelligence accelerates discovery of metallic glass, 63 Creating DB item Found some comments: Memory, attention, sequences, 3 Creating DB item Found some comments: Surface Phone speculation spurred by new phone APIs in Windows, 1 Creating DB item Found some comments: Careem has identified an incident involving unauthorised access to customer data, 23 Creating DB item Found some comments: A journalism student who found out she won a Pulitzer in class, 98 Creating DB item Found some comments: Pasta is good for you, say scientists funded by pasta industry, 1 Creating DB item Found some comments: Interns with toasters: how I taught people about load balancers, 117 Creating DB item Found some comments: Giving away the company's secret sauce, 54 Creating DB item Found some comments: Cryptonetworks and why tokens are fundamental, 95 Creating DB item Found some comments: Massive Attack celebrate Mezzanine's 20th anniversary by preserving it in DNA, 10 Creating DB item Found some comments: Show HN: ReactCircle – Renders SVG circle and percentage, 48 Creating DB item Found some comments: Google Is Testing a New Chrome UI, 15 Creating DB item Found some comments: Displaying Weather on a 32x16 LED Matrix, 11 Creating DB item Found some comments: The limits of information (2014), 20 Creating DB item Found some comments: Tesla batteries will live longer than expected, survey finds, 57 Creating DB item Found some comments: Wells Fargo Hit with $1B in Fines, 416 Creating DB item Found some comments: Billionaire Khosla Is Asking the Supreme Court to Keep People Off His Beach, 114 Creating DB item Found some comments: Ex-Facebook Executive: “You Don’t Realize It but You Are Being Programmed”, 37 Creating DB item Found some comments: Bringing Objective-C to the Amiga, 99 Creating DB item Found some comments: Google has started the global roll-out of its new Chat messaging service, 204 Creating DB item Found some comments: “Drupalgeddon2” touches off arms race to mass-exploit powerful web servers, 102 Creating DB item Found some comments: Parsing JSON is a Minefield, 237 Creating DB item Found some comments: How China Is Buying Its Way into Europe, 41 Creating DB item Found some comments: Gwynne Shotwell: SpaceX's Plan to Fly You Across the Globe in 30 Minutes [video], 99 Creating DB item Found some comments: Gitlab 10.7 Released, 78 Creating DB item Found some comments: Union Types in Flow and Reason, 49 Creating DB item Found some comments: At the Bottom of the Ocean, a Gloomy Discovery, 28 Creating DB item Found some comments: A look at terminal emulators, part 1, 42 Creating DB item Found some comments: Eventbrite has removed filming clause from agreement, 27 Creating DB item Found some comments: Why Is the Human Brain So Efficient? Massive Parallelism, 50 Creating DB item Found some comments: Solved: A Decades-Old Ansel Adams Mystery, 5 Creating DB item Found some comments: Mermaid: Markdown-like generation of diagrams and flowcharts from text, 56 Creating DB item Found some comments: 1978 – 'Farewell, Etaoin Shrdlu', 1 Creating DB item No comments yet for this entry: Implementing YOLO v3 from scratch in PyTorch Creating DB item Found some comments: Everyone Wants to Go Home During Extra Innings, Maybe Even the Umps, 94 Creating DB item Found some comments: Amazon is said to be building home robots, 39 Creating DB item Found some comments: A guide to building a fast electric skateboard at home, 92 Creating DB item Found some comments: Ask HN: Uncommon but attainable programmer skillsets valued by employers?, 85 Creating DB item Found some comments: On incomplete HTTP reads and the requests library in Python, 31 Creating DB item Found some comments: Susan Kare designed the suite of icons that made the Macintosh revolutionary, 74 Creating DB item Found some comments: Libraries Can Be More Than Just Books (2017), 24 Creating DB item Found some comments: Designing very large JavaScript applications, 154 Creating DB item Found some comments: The Surprisingly Solid Mathematical Case of the Tin Foil Hat Gun Prepper, 124 Creating DB item Found some comments: Rethinking GPS: Engineering Next-Gen Location at Uber, 99 Creating DB item Found some comments: Bringing people back to the open web, 90 Creating DB item Found some comments: Towards Battery-Free HD Video Streaming [video], 99 Creating DB item Found some comments: The Categories Were Made for Man, Not Man for the Categories (2014), 45 Creating DB item Found some comments: Thoughts on Low Latency Interrupt Handling, 13 Creating DB item Found some comments: After Facebook scrutiny, is Google next?, 241 Creating DB item Found some comments: When There’s an Audience, People’s Performance Improves, 46 Creating DB item Found some comments: Towards Scala 3, 370 Creating DB item Adding 119 items to db

Data

Downloaded 4 times by dingdreher MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (14.5 MB) Use the API

rows 10 / 60017

title url points author comments
Sorry to burst your bubble
123
prostoalex
57
The Gluglug – GNU/Linux laptop with libreboot firmware
118
weinzierl
52
As Beijing Becomes a Supercity, the Rapid Growth Brings Pains
12
doppp
1
Code Golf at Google
30
antichaos
18
De-duplicating Hacker News
28
shishir456
16
Purism – Privacy-Respecting Laptops
140
monort
86
Show HN: FAQT – A lightweight, personal knowledge base
116
siavosh
78
Currying in JavaScript
46
kevincennis
35
A mixed-format, mixed-architecture, mixed-sided diskette (2008)
105
bane
18
VnStat – A network traffic monitor for Linux and BSD
36
merah
6

Statistics

Average successful run time: less than a minute

Total run time: about 13 hours

Total cpu time used: 17 minutes

Total disk space used: 14.6 MB

History

  • Auto ran revision 09b5bc17 and completed successfully .
    119 records added, 41 records removed in the database
    4 pages scraped
  • Auto ran revision 09b5bc17 and completed successfully .
    119 records added, 64 records removed in the database
    4 pages scraped
  • Auto ran revision 09b5bc17 and completed successfully .
    119 records added, 72 records removed in the database
    4 pages scraped
  • Auto ran revision 09b5bc17 and completed successfully .
    119 records added, 21 records removed in the database
    4 pages scraped
  • Auto ran revision 09b5bc17 and completed successfully .
    118 records added, 41 records removed in the database
    4 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

hacker_news_front_page / scraper.rb