dotScale 2015 - John Graham-Cumming - I got 10 trillion problems, but logging ain't one
Why Hacker News recommends it
Mostly cited as a source for details of Cloudflare's architecture, such as LuaJIT-based request inspection and request volumes.
What it is
John Graham-Cumming of Cloudflare talks at dotScale 2015 about handling roughly 10 trillion log lines a month. The talk touches on Cloudflare's hardware, its logging stack and its use of Lua in Nginx.
Recommended by 1 HN commenters across 1 different months, 2015 to 2018.
What Hacker News said
Recommends i336_ · 2016-01 · on “Ask HN: Whats your favorite HN thread from 2015?”
I discovered a moderately old video from CloudFlare hiding in there, and had a rather big TIL moment. It's one thing to read "LuaJIT is one of the fastest dynamic languages" etc blah blah on [LINK] ... ...it's quite another to learn that EVERY SINGLE CLOUDFLARE REQUEST - all 4 million/sec of them - goes through a LuaJIT-based attack detection system. Oh. Video: [this video] (from [LINK] ) Found in the linked thread here: [LINK]
Cites mtourne · 2015-07 · on “OpenResty – A fast web app server by extending Nginx”
Rewriting the hodge podge of C, Perl and other custom bits of Nginx almost entirely in Lua and hiring its maintainer Yichun in the process where important steps for scaling up the CloudFlare's CDN and make sure each node is running as hot as possible. More on this from dotScale 2015: [this video]
Cites i336_ · 2016-04 · on “Hello Lua”
You make incredibly fair points and I don't have the data to answer what you've raised. This could be lack of research or the fact that CF hasn't released it. I expect a 20/80 non-researched/non-available mix. My understanding is that the WAF detects trivial stuff like SQL injection and XSS, and the video also mentions it detected ShellShock and so forth (yeah, this was a while ago). "Thousands of regular expressions" is mentioned verbally in the video around ~11:25. That's where I got that from. There are some bits mentioned about the hardware around 19:30: - E5-2630v3 (16 cores, 32 w/ HT which is turned off), 128GB RAM, 10Gbps - Custom built by Quanta: 4 nodes per 2U (each node is like hal
Cites Artemis2 · 2017-03 · on “Quantifying the Impact of “Cloudbleed””
For reference, two years ago Cloudflare was serving more than three million requests per second[0]. I can only imagine this figure has gone up a lot. 0: [this video]
Cites exikyut · 2018-06 · on “Ask HN: If I Close My Data Centers, What About the People/Jobs Lost?”
> Even putting aside that the computer tech part of the business isn't their core competency, custom hardware is hard. Hmmm. Good point. (Maybe I scared OP away, heh.) > Is there an example of any large company, other than Google, who has mastered this? Well, I certainly don't know. I've heard Cloudflare gets their systems made, for some definition of "from scratch", by Quanta. Presumably there's a bit of a decision-making process in there, and presumably Quanta handles everything related to the "why is the devkit sample broken again #51383" side of things and ships a more or less finished product (maybe even with finished enclosures). My reference point for this knowledge is [this video] (2015).
Critical mdaniel · 2015-06 · on “How CloudFlare extracts a signal from 10 trillion log lines each month [video]”
What is the deal with the recent "thedotpost.com" envelope for perfectly valid YouTube URLs? I want to flag this post just for that. [this video]