kwazar90

5 ms·

1.
MichiAI 530M parameters full-duplex speech LLM with ~80ms latency(ketsuilabs.io)
4 points by kwazar90 1mo ago|0 comments
2.
MichiAI: A 530M Full-Duplex Speech LLM with ~75ms Latency Using Flow Matching(ketsuilabs.io)
1 points by kwazar90 8mo ago|0 comments
3.
by kwazar90 8mo ago
IMHO, short text - not really. Longer - depends on the model quality but basically longer it gets it's easier to see the LLM patterns.
4.
Hot Profiling for Python(reloadium.io)
1 points by kwazar90 4y ago|0 comments
5.
by kwazar90 4y ago
From the original function call. It basically restarts the current frame.
6.
by kwazar90 4y ago
It's just me working on this project, and yeah I'm not super strong with marketing or business neither english is my first language. Do you have any suggestions how to describe it better? Is "Edit and continue" more desc
7.
by kwazar90 4y ago
Reloadium executes a module in a sandbox environment until it reaches the modules top most frame location (to prevent getting into a loop or other entrypoint and being stuck) and looks for changes. For code that should be executed only once
8.
by kwazar90 4y ago
It does print a message when something can't be hot reloaded. For example changing base classes dynamically is impossible to achive in Python so this is not supported and a full reload is needed. You can go a long way without fully re
9.
by kwazar90 4y ago
It does update type hints as well!
10.
by kwazar90 4y ago
Github actions does not support M1 architecture yet so I could not build wheels for it. Support for self hosted runners is coming soon so I will buy an M1 machine and set up a runner myself.
11.
by kwazar90 4y ago
When re-running current function it passes the original arguments (it does not roll them back if changed in the function body - that will be added in the future).
12.
by kwazar90 4y ago
I have tried jurigged and I like how lightweight it is. It does not seem to reload changes that relate to other parts of code though. For a given code: a = 1 b = a + 2 Changing a = 5 will not update b which will still be equal to 3. The sam
13.
by kwazar90 4y ago
True, the website needs some doing...
14.
by kwazar90 4y ago
Yes hot reloading also works when not suspended and without using debugger. Although you won't be able to reload the current function (currently executing on the call stack) until you suspend it with a breakpoint.
15.
by kwazar90 4y ago
How so? I might make this optional if it's misbehaving but so far it's been very useful.
16.
by kwazar90 4y ago
As long your code does not state that nothing will happen. About the SQL - the only thing it does is rolling back transaction if you make an error during reloading to recover the db state.
17.
by kwazar90 4y ago
As in whether it tracks IO file operations, to know to rollback a file deletion?
18.
by kwazar90 4y ago
Interesting, is it already supported?
19.
by kwazar90 4y ago
If you intruduce a circular dependency (or any Python execution error) it will rollback all already applied actions, highlight the issue and wait for you to fix it. Reloadium reloads modules across the whole project so it is possible.
20.
by kwazar90 4y ago
What limitations exactly do you have in mind? Reloadium does not cause issues with redefined objects ("is" operator issues)
21.
by kwazar90 4y ago
Yes it is very difficult, it took me one year and thousands of unit, integration, e2e tests for it to become usable. It is quite stable now although in some situations a full reload still might be needed.
22.
Reloadium – Advanced hot reloading for Python(github.com)
214 points by kwazar90 4y ago|56 comments