faizshah

7 ms·

31.
by faizshah 1y ago
Can anyone recommend a good cloud for GPU instances? Was trying to find a good one for 30B quants but there’s so many now and the pricing is all over the place.
32.
by faizshah 1y ago
This is well intended but I know from experience this is gonna result in you asking “how do you find and kill the process on port 8080” and getting a lecture + “Claude has ended the chat.” I hope they implemented this in some smarter way th
33.
by faizshah 1y ago
> I've had cases where it completely misinterpreted what I was asking for, a very strange experience which I'd never had with the other frontier models (o3, Sonnet, Gemini Pro). Yes! This exactly, with o3 you could ask your qu
34.
by faizshah 1y ago
o3 was also an anomaly in terms of speed vs response quality and price vs performance. It used to be one of the fastest ways to do some basic web searches you would have done to get an answer if you used o3 pro you it would take 5x longer f
35.
by faizshah 1y ago
The best one was the 2048 era: https://hn.algolia.com/?q=2048
36.
by faizshah 1y ago
So what this POS company is doing that’s kind of interesting is they have a mobile app just like Uber Eats/Doordash but it seems to be direct through the restaurant: https://apps.apple.com/us/app/local-by-toas
37.
by faizshah 1y ago
Meanwhile I have seen a lot of local restaurants advertising how ordering through their own delivery/pickup service can be 30% less than Uber Eats or DoorDash on their takeout boxes (and consequently in your uber/doordash order).
38.
by faizshah 1y ago
Anything you can do with 1 person these large companies will figure out how to do with 10+ people + a PM + a Director/VP sponsor + 3-6 months of red tape and review and a late game “re-alignment” (rewrite) of the features right before
39.
by faizshah 1y ago
I’ve also thought about this moreso as part of a workflow for quickly prototyping stuff. At least for a lot of the modern JIT languages I believe their startup times will be dominated by your imports unless you go with a fastcgi model. This
40.
by faizshah 1y ago
From what I gather it has an embedded http control plane, yaml/json config for plugins, prometheus integration, and distributed compaction workers on separate, potentially serverless, hosts.
41.
by faizshah 1y ago
It’s RocksDB but faster because data can be searched while still compressed allowing you to load more records in less cache/ram leading to up to 10x performance of RocksDB. It adds an embedded http control plane as well as supporting o
42.
by faizshah 1y ago
I love this app for bird sounds. I found ChatGPT is pretty accurate for pictures of birds or plants as well.
43.
by faizshah 1y ago
I had the same experience, my typing speed with two hands is 90-120 but with one hand i can still get 50-70. The hard part is punctuation but with AI these days you could try just prompting and let the AI deal with syntax for you.
44.
by faizshah 1y ago
I have some thoughts on this (in the context of modern SaaS companies). The most expensive parts of fixing a bug are discovering/diagnosing/triaging the bug, cleaning up corrupted records, and customer communication. If you discov
45.
by faizshah 1y ago
I’ve been doing this as well it also works well when you hook it up to Edgar or feed in investor relations documents or earnings transcripts. You can extract a lot of data at scale for regressions using small models with few shot prompts ru
46.
by faizshah 1y ago
I liked the 2048 HN era: https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...
47.
Apple's Eddy Cue says AI will replace search engines(cnbc.com)
7 points by faizshah 1y ago|3 comments
48.
by faizshah 1y ago
I think from a business perspective, the hiring pool for Rails is small and younger engineers don’t have an interest in learning Rails (check recent university hackathons). It takes a decently long time (2-3+ months) to upskill a non-ruby e
49.
by faizshah 2y ago
Hmm that’s unfortunate. I’m actually scaling up a data journalism project this month which is why I’ve been looking at these. I’m curious if you can suggest a happy medium between curl-impersonate on VPS (dirt cheap) vs residential proxy ($
50.
by faizshah 2y ago
It’s not really that expensive, I guess it depends on your use case but it’s only like $4/GB (edit: misleading, see replies): https://oxylabs.io/products/residential-proxy-pool or https://brightdata.com
51.
by faizshah 2y ago
Everyday it is looking better and better to self host. I really don’t feel like ChatGPT $200/mo is 10x better than $20/mo and after trying QwQ 32B myself I just can’t justify paying these AI subscriptions. Gemini Flash is also dir
52.
by faizshah 2y ago
Yes, the quality of the models is increasing at a slower rate and the race will transition to performance and efficiency. This is good for self hosters and devs who will be able to run near SOTA models like QwQ locally. I’m near the point w
53.
by faizshah 2y ago
Go to r/LocalLLAMA they have the most info. There’s also lots of good YouTube channels who have done benchmarks on Mac minis for this (another good value one with student discount). Since you’re a student most of the providers/clo
54.
by faizshah 2y ago
I just started self hosting as well on my local machine, been using https://lmstudio.ai/ Locally for now. I think the 32b models are actually good enough that I might stop paying for ChatGPT plus and Claude. I get around 20
55.
by faizshah 2y ago
You should probably change the name, I thought it was associated with Manus usually projects like this will specifically have in the tag line “An Open Source alternative to X.” Other than that looks very cool, reading through the code now.
56.
by faizshah 2y ago
Same is true for remote work. All the engineers know the return to work policies are dumb but all the decision makers have decided we’re all wrong.
57.
by faizshah 2y ago
This is awesome, there’s a really nice one in python called prompt toolkit that has some a nice api as well: https://python-prompt-toolkit.readthedocs.io/en/master/
58.
by faizshah 2y ago
Anyone got a rough estimate of the cost of this setup? I’m guessing it’s under 10k. I also didn’t see tokens per second numbers.
59.
by faizshah 2y ago
There’s a good chance the reason this is public is because he was using gist to transfer ChatGPT code between his personal computer and his government computer.
60.
by faizshah 2y ago
I think ruby can get popular again with the sort of contrarian things Rails is doing like helping developers exit Cloud. There isn’t really a much more productive web dev setup than Rails + your favorite LLM tool. Will take time to earn Gen

More ›