Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
benwills
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
10 ms
·
61.
▲
by
benwills
6y ago
This sounds awesome. C is my preferred language and I use it whenever I can and when it makes sense. I'd love to see this code. Is there a public repo for it?
62.
▲
by
benwills
6y ago
I've taken a slightly similar approach: If the information won't affect my behavior/actions, I choose not to invest time into it. This allows for me peruse headlines to be aware of what's happening (and to consider looki
63.
▲
by
benwills
8y ago
For a lot of basic operations, this is often false. I have an application I'm working on and tested it across three different generations of CPUS going ~10 years back. The code was written in C and the fundamental steps were to: mmap()
64.
▲
by
benwills
8y ago
I've spent a fair amount of time this year with liquid cooling designs, and final parts are coming in to do something along the lines of what you're talking about. Do you have any blog posts/videos walking through this? It so
65.
▲
by
benwills
8y ago
Straight to payment for me. Sublime Text is one of the few pieces of software I've just felt was done totally right at so many levels. Entirely happy to give you more of my money.
66.
▲
by
benwills
8y ago
For electronics, GreatScott! : https://www.youtube.com/channel/UC6mIxFTvXkWQVEHPsEdflzQ Electronics had always been a big black box to me. His stuff has helped me wrap my mind around it by incrementally walking through
67.
▲
by
benwills
8y ago
From the abstract: "Our analysis leads to an algorithm that enables one to predict primes with high accuracy." From my very, very basic understanding of/curiosity with primes, predicting primes with any sort of accuracy has b
68.
▲
by
benwills
8y ago
What Every Programmer Should Know About Memory: https://people.freebsd.org/~lstewart/articles/cpumemory.pdf
69.
▲
by
benwills
8y ago
Wow. When I saw your code, I thought to myself "yeah, but does it work when the socket is for a client?" Turns out, it does. My only guess is that I was botching something else when I was digging into this a few years ago. I can&#
70.
▲
by
benwills
8y ago
I dealt with all of this in 2015, and spent three months trying to get epoll to perform similarly to kqueue; namely, to avoid returning on any and every packet received and, preferably, to abide by some sort of minimum bytes received (or co
71.
▲
by
benwills
8y ago
Do you have a link to either an announcement of this change, or C code that demonstrates it? If it has changed, I might start doing some things differently...
72.
▲
by
benwills
8y ago
Behind the scenes, Python may have another layer in there to check the socket options, etc, before returning. ie: Just because it looks like it's working on the Python level doesn't mean it's working the same way underneath.
73.
▲
by
benwills
8y ago
My experience is across several years writing high performance http clients, writing in pure C.
74.
▲
by
benwills
8y ago
It's also worth noting that kqueue() also doesn't use the socket options for this. Instead, it uses a flag called EVFILT_READ. More here: https://www.freebsd.org/cgi/man.cgi?query=kqueue&sektion=2
75.
▲
by
benwills
8y ago
Given that I wasn't asserting that it is, I'm not sure what you're getting at. I was responding to the parent comment.
76.
▲
by
benwills
8y ago
Correct. You can set those socket options and change the triggering behavior of epoll. But those socket options do not actually affect how epoll handles the data when it comes in. They are completely ignored by epoll.
77.
▲
by
benwills
8y ago
There are other major benefits of kqueue() when using sockets as a client that have essentially "forced" me to use bsd instead of Linux/epoll... The way epoll () is written triggers so many syscalls that things like socket c
78.
▲
by
benwills
8y ago
My interpretation wasn't that it was specifically that it's non-volatile. Rather, that it's the performance:price of NVME that's "changing the equation." The combination of NVME's IOPS and throughput, part
79.
▲
by
benwills
9y ago
My guess is that you don't intend to be insensitive, but the awareness you're demonstrating here shows a lack of empathy and true understanding/acceptance of the emotional sensitivities to others, particularly this author. To
80.
▲
by
benwills
10y ago
I would disagree with the reason being "because we've always done it this way." I started programming C full time about 2.5 years ago (after many more with PHP, et al). There's an aesthetic to writing C that I don't
81.
▲
by
benwills
10y ago
I think that everything I'm willing to list publicly is in that post. Understand that almost all of it is written in pure C. [Edited to add: I do not use Java in any part of ontolo.] An example is that I do use Redis for some queueing
82.
▲
by
benwills
10y ago
That makes sense. I don't know if this factors in, but I didn't post the link here. And if I ever did post a link here to ontolo, the HN post title would be very different. And I agree that few, if any, folks that talk about their
83.
▲
by
benwills
10y ago
It's my pleasure. I love talking about this sort of stuff. As for the rate of requests, I just couldn't figure out how to max out the gigabit connection on Linux with epoll. I ended up moving to FreeBSD and kqueue, and when I did,
84.
▲
by
benwills
10y ago
Hi Joe. I just saw this post here on HN. I'm the sole author of ontolo. Your comment about the ontolo domain and assuming it was a PR piece, is that because you know of ontolo as a marketing tool, or because it wasn't a more gener
85.
▲
by
benwills
10y ago
I just saw this post. I'm the sole author of ontolo. As for requirements, they're very low. The machines running the crawler+parser+indexer, which achieve those speeds, are dual Xeon 5639s with 72GB ram. When the indexer isn'
86.
▲
by
benwills
11y ago
nope. it's all in sphinx. sphinx has its own sort of data store called 'attributes', which are analyzed after a full-text match is performed. this doesn't work well for relational searches (e.g. sql), where you might loo
87.
▲
by
benwills
11y ago
the parser is all hand-written c. the only library i use outside of libc, is xxhash. documents are read and parsed byte by byte, where "sections" (e.g. side nav) and "contexts" (e.g. comment author) are maintained in a s
88.
▲
by
benwills
11y ago
ontolo.com : a fast, customizable search engine for marketing opportunities. Written entirely in C, except for the front-end. Took 18 months. Didn't know C before and was a hack programmer. Just released a major update yesterday. The c
89.
▲
by
benwills
11y ago
This is great. It's one of those totally obvious ideas that everyone else just missed. Stick with it and keep refining and improving. The line of thinking is fantastic.
90.
▲
by
benwills
11y ago
Not sure if others are having the same experience with it, but I'm finding it just beyond my comprehension, in the best way possible. So I'm not sure how I'd comment on it. And what I mean by 'just beyond my comprehensio
More ›