Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
boyter
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
22 ms
·
241.
▲
by
boyter
5y ago
True. I just never bothered with anything. I get some basic details out of cloudwatch, but that's about it. As mentioned I think I should do something with what comes out of caddy one of these days.
242.
▲
by
boyter
5y ago
The same way any other federated system does. Allow, ignore, block and such... The whole point is you get to choose. If someone happens to get a lot of requests from other peers they might be considered a reliable source. However you would
243.
▲
by
boyter
5y ago
Yes. Gigablast is run by one person. Assuming you roll your own hardware and co-lo it or such you can get by with minimal hardware. The catch being once you hit scale your servers become hammered. It’s one reason why I have been investigati
244.
▲
by
boyter
5y ago
I’m about to replace the index, and adding that is an often requested feature. So yes it’s coming soon.
245.
▲
by
boyter
5y ago
Honestly I have no idea. There is no tracking of any kind on it. I should probably hook one of those newer awstats implementations into the caddy logs for it to get some idea though.
246.
▲
by
boyter
5y ago
Agreed. So much so I started two search engines, https://bonzamate.com.au/ which is explicitly for Australian sites and https://searchcode.com/ which is about to get a large index update and make it more us
247.
▲
Aussie++ The programming language from down under
(aussieplusplus.vercel.app)
7 points
by
boyter
5y ago
|
1 comments
248.
▲
You Don't Need a Library for File Walking in Go
(engineering.kablamo.com.au)
2 points
by
boyter
5y ago
|
0 comments
249.
▲
I write code 100 hours/week, here's why I probably won't stop
(devlog.hexops.com)
58 points
by
boyter
5y ago
|
62 comments
250.
▲
Memcached vs. Redis – More Different Than You Would Expect
(engineering.kablamo.com.au)
16 points
by
boyter
5y ago
|
1 comments
251.
▲
S3 Bucket Namesquatting – Abusing predictable S3 bucket names
(onecloudplease.com)
2 points
by
boyter
5y ago
|
0 comments
252.
▲
by
boyter
5y ago
Reminds me of this great story https://thedailywtf.com/articles/The-Automated-Curse-Generat...
253.
▲
Software at Scale 34 – Faster Python with Guido van Rossum
(softwareatscale.dev)
5 points
by
boyter
5y ago
|
0 comments
254.
▲
Migrating to OpenSearch with CloudFormation
(onecloudplease.com)
1 points
by
boyter
5y ago
|
0 comments
255.
▲
Thoughts on Code Reviews
(kendallmorgan.com)
1 points
by
boyter
5y ago
|
0 comments
256.
▲
by
boyter
5y ago
Im actually looking into this myself. Adding facets isn't that hard to what's already there, and for smaller sites I imagine this could be a very inexpensive way to add search, albeit with slightly higher cost to add or remove ite
257.
▲
by
boyter
5y ago
I tried up to the maximum a few times. The code is single threaded. It is indeed also memory bandwidth bottlenecked. Which I think might be the main issue with it in lambda. My guess based on my tests is that memory access and cpu are the l
258.
▲
by
boyter
5y ago
I’ll give that one a shot.
259.
▲
by
boyter
5y ago
Thanks. I find it useful for finding things that are specific to Australia I am interested in. I think it should be picked up in your browser already as there is the open search definition in there. If you are using Chrome and visit chrome:
260.
▲
by
boyter
5y ago
I don't think based on my tests that lambda has enough CPU to deal with that. The current size I am using is pushing what they are able to process. Thats just based on my tests however. I do know that the same index on a physical machi
261.
▲
by
boyter
5y ago
It's because they don't have a HTTPS cert. I limited to just HTTPS in the interest of keeping everything easier to work with. I might break that rule for bom though. Although I wish they would just let myself add a cert for them.
262.
▲
by
boyter
5y ago
Yes, I still need to fix the highlighting for it, which I think is causing the issues for the men at work issue. Something I am aware off and when I get some time will resolve. I have seen common crawl. It's one of those things I shoul
263.
▲
by
boyter
5y ago
Yes and no. It works for the deep web, but for anything that needs more frequent crawling no. They don't do it often enough. I have mentioned this elsewhere, but id love there to be a single crawl that everyone was able use and build i
264.
▲
by
boyter
5y ago
Maybe. Based on my experiments with lambda I doubt they have enough CPU to deal with the additional space. At the current size it's bumping against the limits of lambda as is. Might be possible to switch to something like C++/Rust
265.
▲
Abusing AWS Lambda to make an Aussie search engine
(boyter.org)
129 points
by
boyter
5y ago
|
28 comments
266.
▲
by
boyter
5y ago
I have a few plugins to improve the PR's in bitbucket too, showing you the relative size of the PR compared to others you normally work with. Includes the language breakdown and such. Makes it much easier to know if you should be block
267.
▲
by
boyter
5y ago
If possible please try this https://marketplace.atlassian.com/apps/1225034/better-instan... and let me know how it goes for you. No stemming applied, no term expansion etc... The back button issue exists (not sure
268.
▲
by
boyter
5y ago
I found the search pretty iffy at times. There was an exisiting marketplace app for it that was not much better so I wrote my own. Then turned it into a full marketplace app so others could benefit. It does partial matches anywhere in a wor
269.
▲
Abusing AWS Lambda to Make an Aussie Search Engine
(boyter.org)
1 points
by
boyter
5y ago
|
0 comments
270.
▲
Abusing AWS Lambda to Make an Aussie Search Engine
(boyter.org)
3 points
by
boyter
5y ago
|
0 comments
More ›