liuliu

56 ms·

661.
by liuliu 6y ago
Flatbuffers would be better as it doesn't need to deserialize at all (I think protobuf supports to partially deserialization nowadays?). I did something similar with https://github.com/liuliu/dflat too!
662.
by liuliu 6y ago
Isn't that the entire plot of Mr. Robot (S1)? :)
663.
by liuliu 6y ago
The said method doesn't support cross-platform executions (at least not without some qemu hackery). I can totally see how I would use this to transcode videos from my NAS using my main workstation CPU since both are connected through a
664.
by liuliu 6y ago
Soumith and I had discussions on hdf5 in the beginning of the AI renaissance (around 2014?). Torch maintainers definitely aware of better format at that time (original Torch in Lua has high-level File APIs for serialization). It becomes mud
665.
by liuliu 6y ago
They started their model with RAW format, so the model should encoded some interactions between red / blue / green light sensors and that can help generate genuine sub-pixel details. OTOH, this is machine learning, unless you spec
666.
by liuliu 6y ago
Videos can use inter-frame information to help infer sub-pixel details. This post about "Super Resolution" is interesting because it starts with RAW format (which contains information about camera sensor arrangements), hence, the
667.
by liuliu 6y ago
Thank you! This looks indeed cheap. Can you share more stories on data persistence / checkpointing? If I have a job that requires 8 V100 with 3 days, what types of reliability am I looking at?
668.
by liuliu 6y ago
sourcekit-lsp is actually pretty light-weight implementation as it shares the same sourcekit code with Xcode. VSCode's sourcekit-lsp integration is OK to me. The only issue for me is that I don't use Swift Package Manager, hence,
669.
by liuliu 6y ago
I think that you are correct. There is a paragraph on actor's reentrancy: https://github.com/apple/swift-evolution/blob/main/proposals... which points out that you can definitely get balance before
670.
by liuliu 6y ago
It is mostly applicable to transformer models, the ideas in the paper would be alien if you work on computer vision. In transformer models, big chunk of memory was parameters, and states for optimizers (because vanilla SGD not used there).
671.
by liuliu 6y ago
They offload parameters, gradients and optimizer states (such as moment, velocity and exponential avg of these in Adam) into CPU memory.
672.
by liuliu 6y ago
Yeah. I just avoid str manipulations in general in C and when I have to, fuzz it ... (but still, the perf cliff is definitely new to learn in the past few days).
673.
by liuliu 6y ago
If you can wrap SQLite as close-source and sell it for a price, great, go ahead and do that. Because it is public domain, there is no restrictions, and it could be a good thing even it doesn't contribute back to the original author. Th
674.
by liuliu 6y ago
I am confused about this comment. The parent comment gave clear call stack that pointing to the problem where the glibc's sscanf implementation would strlen the input string no matter what format string you use (because it need to masq
675.
by liuliu 6y ago
Or how much of Medallion's gains are just front-run their clients in their public-facing fund.
676.
by liuliu 6y ago
"Reinventing wheels" are represented by the machine-code outlining :) These are code. Swift is a safe language with more runtime checks than other "zero-abstraction" languages. It also support "value" semantics
677.
by liuliu 6y ago
Dear ImGui did that: https://github.com/ocornut/imgui/tree/master/backends , https://github.com/ocornut/imgui/tree/master/examples You can probably borrow some of thes
678.
by liuliu 6y ago
Yes, that is worrying. But, they already have license in place to ensure no one uses their gaming GPUs in the cloud, where the big money is already. (And it worked, I cannot find any low-cost cloud providers with gaming GPUs for GPGPU compu
679.
by liuliu 6y ago
SQLite uses file lock to coordinate with many processes. Your performance will be similar to use single writer if we ignore the repeated DB open / close due to the app boot on every request. I am not sure about real-world DB open &#x2F
680.
by liuliu 6y ago
There is support for default implementation method in protocol for a while now. Generics are supported through associated types.
681.
Swift for NNC(github.com)
1 points by liuliu 6y ago|0 comments
682.
by liuliu 6y ago
It is much easier to maintain a language binding than a full toolchain. There are a lot of activities in Swift mainline, and I can only imagine how much work it must be to maintain the S4TF fork.
683.
by liuliu 6y ago
Yeah. I think unable to merge back into Swift mainline really makes the adoption harder. I made some efforts to having PythonKit / swift-jupyter run smoother and it feels really good as a replacement for Python: https://liul
684.
by liuliu 6y ago
In case you don't control which SQLite version you use (for example, on iOS or on Android, iOS normally comes with sane defaults), SQLite's default page size only recently changed to 4KiB, and update that can help with performance
685.
by liuliu 6y ago
That doesn't sound right. SQLite's lock for writes is not the best, but it is still pthread mutex under the hood. Are you sure your compilation options for SQLite is right? One common pitfall is compiling without `-DHAVE_USLEEP`.
686.
by liuliu 6y ago
SQLite should be fine if your workload biased towards reads. But its design does prevent many-writers and these, even operates on completely different tables, has to be serialized between each other. This can be more problematic since many
687.
The Universal Training Loop of Machine Learning(liuliu.me)
2 points by liuliu 6y ago|0 comments
688.
Data Science Setup with Swift in 2021(liuliu.me)
3 points by liuliu 6y ago|0 comments
689.
by liuliu 6y ago
I heard when they started to do this, LLVM folks were freaked out because they worried changing orders may affect correctness. But it seems to work so far :)
690.
by liuliu 6y ago
I increasingly distrust it is just a collateral requirement issue from RH side. They have multiple venues to borrow if it is conventional collateral requirements for settlements, and money market barely moved yesterday (no substantial borro

More ›