rgbrgb

19 ms·

271.
by rgbrgb 3y ago
i would guess a lot of OpenAI employees are sitting on some pretty valuable stock/options if the company doesn't implode
272.
by rgbrgb 3y ago
> Databases should never, ever, ever, be used to perform logic You're talking about a best practice like it's a fundamental law. It's not, it's just how we've mostly been doing things. A lot of interesting innova
273.
by rgbrgb 3y ago
congrats on the product, looks great. what model formats are supported?
274.
by rgbrgb 3y ago
> I ended up renting an hourly GPU from Runpod (an RTX 4090 w/ 24GB of VRAM) for ~$0.7/hr. Sorry if I missed this, but how much did it cost total to do the fine-tune? Is that the 40 hour number (~$27)? Also, very cool writeup.
275.
by rgbrgb 3y ago
Thanks. Yeah I played with your app early on and just fired it up again to see the progress. Frankly I find the interface pretty intimidating but it is cool that you can easily stitch generations together. Unsolicited UX recs: - strongly re
276.
by rgbrgb 3y ago
This project is really cool and I like the stated philosophy on the README. I think it's making the right trade-off in terms of setting useful defaults and not showing you 100 arcane settings. However, the installation is too hard. It&
277.
by rgbrgb 3y ago
Just installed, this is very cool. Local AI is the future I want (and what I'm working on too). A few notes using it... Pros: - seems pretty self contained - built in model installer works really well and helps you download anything fr
278.
by rgbrgb 3y ago
I don’t think making it easy to install is cargo-culting. In my case it’s an accessibility thing. I wanted a private alternative that I could give to nontechnical people in my life who had started using ChatGPT. Some don’t understand local
279.
by rgbrgb 3y ago
Yes, though it does seem to be working for them. They have a special feature for lazy loading large assets but I opted for a simpler to me option (giving users a button to download a model if they don’t have one locally they want to use).
280.
by rgbrgb 3y ago
fwiw FreeChat does this now. It prompts you to download or select a model to use (and you can add as many as you want). No copying or forced downloads.
281.
by rgbrgb 3y ago
cool. this is more convenient than my workflow for doing the binaries myself. I currently use make to generate a binary of llama.cpp server on my intel iMac and my m1 MacBook then lipo them together.
282.
by rgbrgb 3y ago
In my experience, if you're on a mac it's about the file size * 150% of RAM to get it working well. I had a user report running my llama.cpp app on a 2017 iMac with 8GB at ~5 tokens/second. Not sure about other platforms.
283.
by rgbrgb 3y ago
Extremely cool and Justine Tunney / jart does incredible portability work [0], but I'm kind of struggling with the use-cases for this one. I make a small macOS app [1] which runs llama.cpp with a SwiftUI front-end. For the first v
284.
Botlib: C Telegram bot framework(github.com)
230 points by rgbrgb 3y ago|86 comments
285.
by rgbrgb 3y ago
After being an extremely data-driven dev/pm/founder I'm currently making a mostly offline app with close to no analytics (apple gives install numbers but that's about it). It's fun not to know how many people click
286.
by rgbrgb 3y ago
nice job, greg. i'm a sample mangler so this is very cool :) what's the source material, youtube vids?
287.
by rgbrgb 3y ago
perhaps they are in a war zone and must learn to make molotov cocktails without connecting to the internet
288.
by rgbrgb 3y ago
hm yeah i think I need to update llama.cpp to get this fix https://github.com/ggerganov/llama.cpp/pull/3996 Thanks for trying it!
289.
by rgbrgb 3y ago
that's the magic of llama.cpp! I include a universal binary of llama.cpp's server example to do inference. What's your machine? The lowest spec I've heard it running on is a 2017 iMac with 8GB RAM (~5.5 tokens/s). O
290.
by rgbrgb 3y ago
LMStudio is great, if a bit daunting. If you’re on Mac and want a native open source interface, try out FreeChat https://www.freechat.run
291.
by rgbrgb 3y ago
I get similar speeds on my m1, though it depends a bit on the quantization. If anyone else is on Mac and just want to have a play, FreeChat (my app) is a simple chat wrapper for llama.cpp. Clicking the little … on a message and checking the
292.
by rgbrgb 3y ago
FWIW in America you can totally ask for a refund on agent commission when looking for an agent to buy with. Not all agents will do it but it is straightforward for them to credit their commission against the closing costs. With online listi
293.
by rgbrgb 3y ago
Title companies are already pretty efficient and relatively cheap... not a lot of margin or process to improve with technology.
294.
by rgbrgb 3y ago
Congrats on the release. If I plug this into my repo, does Open AI get to train on my proprietary codebase?
295.
by rgbrgb 3y ago
> no physicality So it requires embodiment? Rodney Brooks might agree. You're saying it like it can't be done, but I'm hearing it just requires hardware. > no continuity Feels like a very tractable software problem.
296.
by rgbrgb 3y ago
I absolutely buy this but also think we should figure out what works about the human tutor and try to get it into a free piece of software so that the 99% of kids without individual tutors can get a similar benefit.
297.
by rgbrgb 3y ago
Isn’t doing Stuff on top of it what it’s for? llama.cpp is explicitly highly portable systems code with bindings in many languages.
298.
by rgbrgb 3y ago
I don't think you can reduce size without losing accuracy (though I think quantized GGUFs are great). But the 2 MB size here is a reference to the program size not including a model. It looks like it's a way to run llama.cpp with
299.
by rgbrgb 3y ago
very sick demo! if anyone wants to work on packaging this up for broader (swiftUI/macos) consumption, I just added an issue https://github.com/psugihara/FreeChat/issues/30
300.
Similarity-search-kit: on-device text embeddings and semantic search in Swift(github.com)
1 points by rgbrgb 3y ago|0 comments

More ›