tovacinni

7 ms·

1.
How fast can you load a FLUX (LoRA) model?(outerport.com)
3 points by tovacinni 2y ago|0 comments
2.
by tovacinni 2y ago
We’d just need to write a Rust client for the daemon and load the weights in a way that is compatible with candle- we can definitely look into this since parts of what we are building is already in Rust!
3.
by tovacinni 2y ago
The advantage of loading from a daemon over loading all the weights at once in Python is that it can support multiple processes or even the same process consecutively (if it dies or something, or had to switch to something else). Loading fr
4.
by tovacinni 2y ago
Awesome to hear- that sounds like an application we'd love to help with! (Please feel free to reach out to us too at towaki@outerport.com !)
5.
by tovacinni 2y ago
Yep, it'll work for multi-GPU as well!
6.
by tovacinni 2y ago
Thanks!!
7.
by tovacinni 2y ago
Maybe! Many people don't want to be vendor locked-in though and there are new GPU cloud providers gaining traction. Some still prefer on-prem. We hope to make it easier to bridge the multi-cloud landscape by being independent and &#x27
8.
by tovacinni 2y ago
That's a super neat idea- we should in fact be able to use this same system to support the orchestration of a 'system prompt caching' sort of thing (across deployments). I'll put this on my 'things to hack on'
9.
by tovacinni 2y ago
Variants do not have to be the same architecture- the demo ( https://hotswap.outerport.com/ ) runs on a couple of different open source architectures. That being said, there is some smart caching / hashing on layers such
10.
by tovacinni 2y ago
Thanks! If you mean the costs for users of Outerport, it'll be a subscription model for our hosted registry (with a limit on storage / S3 egress) and a license model for self-hosting the registry. So mainly storage, since the idea
11.
by tovacinni 2y ago
Thanks! I think both are fits- we've gotten interest from both types of companies and our first customer is a "OSS model host". Our 40% savings result is also specifically for the 5 model services case, so there could be non-
12.
Launch HN: Outerport (YC S24) – Instant hot-swapping for AI model weights
93 points by tovacinni 2y ago|24 comments
13.
A collection of mathematical art: a 3D signed distance function dataset(github.com)
1 points by tovacinni 4y ago|0 comments
14.
by tovacinni 6y ago
Render times are listed on table 3 of the paper- interactive, but perhaps not high-performance!
15.
by tovacinni 6y ago
Here's a Twitter thread that explains what this paper is about: https://twitter.com/yongyuanxi/status/1354478763065528320 ?
16.
by tovacinni 6y ago
It sort of can; something I observed while I was still a student at a "top CS university" is that there were certain individuals (superstars) in the school that a lot of people looked up to, and whichever companies they chose to d
17.
Myths about Grad School in CS (In Canada)(medium.com)
1 points by tovacinni 6y ago|0 comments
18.
Daimler, Bosch Select Nvidia DRIVE for Robotaxi Fleets(blogs.nvidia.com)
15 points by tovacinni 8y ago|0 comments
19.
by tovacinni 9y ago
Sorry if this is a stupid question, but can't you do this without converting the image into an RGB 3D space? (i.e. iterate through the pixels and count the ones within a certain range of what you want)
20.
by tovacinni 9y ago
It's hackernews clickbait for sure :p
21.
by tovacinni 9y ago
Worked for me - just searched "retail jobs" and came up with results from around my area
22.
by tovacinni 9y ago
Does anyone actually think that HR is on their side? :p
23.
by tovacinni 9y ago
On the other hand, Kiva Systems which is now Amazon Robotics is apparently now a terrible place to work. :(
24.
by tovacinni 9y ago
Your argument sounds vaguely similar to the one that Jonathan Hurst (the founder of OSU's DRL/Agility Robotics) likes to make- he insists that Japanese robots focus on looking good while American robots focus on being practical. I
25.
by tovacinni 9y ago
I think it really depends on the atomicity of the said "tasks" and how often branches get merged back into the master branch. It's very easy for branches to get abused and merging long-standing branches in with the master br
26.
by tovacinni 9y ago
Correct me if I'm wrong, but for VCS, isn't it generally bad practice to unnecessarily branch off and introduce complex structures? In my experience, branches generally lead to people feeling like they have free reign and introduc
27.
by tovacinni 9y ago
Really curious how the sound quality optimizations based on room acoustics work. I'd imagine it's a lot of signal processing and such, but I'm curious how they quantified optimizations and tested to see that it actually enhan
28.
by tovacinni 10y ago
I don't know why this makes you so mad, but the title definitely helped me be interested in the article and I ended up learning a few things about myself through the article.