binsquare

4 ms·

31.
Smol Machines: Kubernetes-in-a-Microvm(smolmachines.com)
3 points by binsquare 3mo ago|2 comments
32.
by binsquare 3mo ago
Yep, there are inference stacks where it just does not work without cuda in any meaningful performance
33.
by binsquare 3mo ago
I don't think it's rust
34.
by binsquare 3mo ago
I agree with this, virtual machines are invented to solve the sandboxing/multi-tenant issues. This is why ec2 and the likes all sell you access to virtual machines (dividing up their underlying hardware).
35.
by binsquare 3mo ago
If you back it through smolvm, I can take care of the isolation story for you across windows, macOS https://github.com/smol-machines/smolvm SDKs available https://github.com/smol-machines/smol
36.
by binsquare 3mo ago
smol machines: just in time cloud infrastructure https://www.smolmachines.com I am building it on top of a new primitive called smolvm: a hybrid that combines isolation of VM with speed and flexibility of containers. https:&#x2
37.
by binsquare 3mo ago
I use a tool called linzumi for this
38.
by binsquare 3mo ago
yes to both, here's the example for running docker(indirectly, devcontainers) inside smolvm: https://github.com/smol-machines/smolvm/blob/main/examples/d...
39.
by binsquare 3mo ago
the underlying vmm is libkrun: https://github.com/libkrun/libkrun is battle tested and used for podman. It provides kernel isolation for running untrusted code which is a security boundary that traditional containers c
40.
by binsquare 3mo ago
smol machines is a virtual machine, akin to firecracker but designed to run locally as well It also has container-inages support built-in with crun so you can create a VM with a container running by default. You can also just... run docker
41.
by binsquare 3mo ago
author of smol machines here, it has no relation to firecracker. It runs ontop of the libkrun vmm forked with optimizations, which is the underlying lib powering podman as well. open source, will contribute upstream when possible: https:&#
42.
by binsquare 3mo ago
Sony also used to mock digital only approaches. https://www.youtube.com/watch?v=kWSIFh8ICaA Now at a time when memory and storage prices are at an all time high - they pull a move that directly hurts the customer.
43.
by binsquare 3mo ago
Yep, I needed to go deeper down the stack in order to get to the lightweight optimizations I needed.
44.
by binsquare 3mo ago
I build a local, cross platform virtual machine for this purpose: https://github.com/smol-machines/smolvm
45.
by binsquare 4mo ago
Fixed and released in v1.3.1: https://github.com/smol-machines/smolvm/pull/497
46.
by binsquare 4mo ago
smolpi looks great! and smolvm does clean up ephemeral runs if the machine run exits gracefully. I'll take a deeper look into this edge case and fix it today.
47.
by binsquare 4mo ago
I made a lightweight vm specifically for this use case: https://github.com/smol-machines/smolvm
48.
by binsquare 4mo ago
Would like to see this! Wonder how you got GUI support working because with vulkan support - you effectively enable running games cross platform
49.
by binsquare 4mo ago
Confirming, I worked directly on fargate. Fargate does not use firecracker. It was used for some internal workloads but was being migrated off at the end of 2025.
50.
by binsquare 4mo ago
I designed my take to basically eliminate the concept of vm being a rigid box of cpu/memory with CPU oversubscription and virtio-ballooning on memory + sparse ext4. That way it can be elastic in CPU, memory and somewhat disk. How far a
51.
by binsquare 4mo ago
check this out https://github.com/smol-machines/smolvm will have a hosted platform soon with GPU support (vulkan)
52.
by binsquare 4mo ago
author of smolmachines here, CUDA support is possible based on a cursory dive. I'll keep you posted on it ref: https://thevirtualhorizon.com/2024/05/31/how-to-configure-th...
53.
by binsquare 4mo ago
Author of a free open source alternative to slicer, based on a fork of libkrun (not firecracker based) that runs locally across wsl, macOS, and Linux natively. https://github.com/smol-machines/smolvm
54.
by binsquare 4mo ago
Would highly recommend running any repo in an isolated environment like a vm
55.
by binsquare 4mo ago
this sentence hurts to read
56.
by binsquare 4mo ago
I agree with this - queues may not be the end all solution but it is a valuable tool in our kit. And in the right situations, it can be enough.
57.
by binsquare 4mo ago
It actually supports wsl(windows) and has the ability to persist binaries.
58.
by binsquare 4mo ago
Thanks, appreciate your contributions and bug reports
59.
by binsquare 4mo ago
I built this tool to solve that exact problem: https://github.com/smol-machines/smolvm
60.
by binsquare 4mo ago
Linux VMs on doesn't have to be expensive!

More ›