burmecia

5 ms·

1.
by burmecia 2y ago
Thanks, the "Top Comments" is sourced from the "kids" field of the "items" endpoint. As the API docs ( https://github.com/HackerNews/API?tab=readme-ov-file#items ) says, it is "in ranke
2.
by burmecia 2y ago
That's a good idea, will put it on to-do list.
3.
by burmecia 2y ago
Thanks for the ideas, heat map looks great! Will also consider add custom queries, it can be quite useful.
4.
by burmecia 2y ago
yes, the keywords search is using full-text searching and it is not efficient so I hardcoded them. Will consider switch to use embedding, that will be more efficient and accurate, also can support custom keywords search. Thanks for your adv
5.
Show HN: Insights.hn – Real-time Hacker News posts and comments analytics(insights.hn)
4 points by burmecia 2y ago|9 comments
6.
by burmecia 3y ago
https://news.ycombinator.com/item?id=26385229
7.
by burmecia 4y ago
AFAIK, ChatGPT's training data is until 2021, can it answer questions based on the latest Supabase documents?
8.
by burmecia 4y ago
Next.js is more about frontend, but Supabase is more on backend. I cannot see any conflicts of the two, they can work with each other flawlessly.
9.
by burmecia 4y ago
You can create a custom function doing all the delta logic and use pg_cron to schedule it to periodically materialize data using FDW.
10.
by burmecia 4y ago
| At the end of the day, are these just FDWs that run on top of any Postgres instance? Yes, the FDWs developed by Wrappers can be used on any Postgres db. | Do I have to run Supabase to take advantage of the FDWs created through this framew
11.
by burmecia 4y ago
| How well do foreign data wrappers work with Postgres's query planner? You can provide table size estimation to Postgres's query planner in wrappers using `get_rel_size()` function, here is doc: https://docs.rs/su
12.
by burmecia 4y ago
Another interesting term not mentioned is 'qual', which basically has same meaning as 'restrictions'.
13.
by burmecia 4y ago
Our price model based on database usage which includes db egress, so we use it to monitor db egress traffic just for now. We are all db fans and we like put things into db, so all the following processes, like searching, tracking, analysis
14.
by burmecia 4y ago
I like old solid tech like Postgres, libpcap and etc. Putting them together with new tech like Rust and pgx is also fascinating.
15.
by burmecia 4y ago
That's a nice approach, thanks for sharing with us.
16.
by burmecia 4y ago
Yes, you need root to grant capture permission to Postgres, but Postgres doesn't need to run as root. The main purpose is to easily ingest network traffic data into Postgres for further process. Yes we can use tcpdump to do the same th
17.
by burmecia 4y ago
Hey HN, I have spent some time to search for a tool that can ingest realtime network traffic data to Postgres but have no luck, so I developed this extension and used it internally in our team. Thanks Rust, pgx and libpcap, the development
18.
Show HN: pg_netstat, a Postgres extension to monitor database network traffic(github.com)
158 points by burmecia 4y ago|25 comments
19.
by burmecia 7y ago
I am building an encrypted file system that runs inside application ( https://github.com/zboxfs/zbox ). It focus on security, privacy and reliability. The interesting part is it can utilize different storage, such as mem
20.
by burmecia 7y ago
Totally agree. To make file system crash-proof you really need an ACID compatible underlying storage layer or implement it inside the file system itself. In fact, file system and database are quite similar in case of atomicity and consisten
21.
by burmecia 7y ago
I am using Rust building a privacy focused in-app file system ZboxFS( https://github.com/zboxfs/zbox ). The fun part is not only joyfulness Rust bring to me, but also learned a lot about cryptography, file system, transa
22.
by burmecia 7y ago
Database and filesystem share a lot similarity, but still have their own characteristics. To use database as a back-end for filesystem has some benefits, such as reliable persistence, ACID transaction and etc. It reduces complexity to achie
23.
by burmecia 7y ago
I don't think the encrypt-then-dedup is a safe way to protect data privacy. In this case, identical blocks need to produce same cipher text, this will actually leak your data pattern even though it is encrypted. A better way I think is
24.
by burmecia 7y ago
I think any applications need store confidential files on client or remote can adopt it. Web and mobile app might be the best to use it at this moment. As there is transaction control, the conflict handling should be straightforward. That i
25.
by burmecia 7y ago
I think the best approach is never save unencrypted data on cloud. Always encrypted on client first. But by that way we lost dedup capability, so we have to do everything, such as encryption, dedup and compression on client side. I made an
26.
by burmecia 7y ago
Another approach I can think of is using rolling hash ( https://en.wikipedia.org/wiki/Rolling_hash ) to split file to different size of chunks, those chunks can be saved on different sectors which don’t need to be contin
27.
by burmecia 7y ago
Totally agree. Log based file system makes things much easier, such as atomic write, data consistency and failure recovery. Along with COW semantics, transaction isolation also becomes easier. By its append-only writing nature, file version
28.
by burmecia 7y ago
There is an userspace implementations of filesystems ZboxFS: https://github.com/zboxfs/zbox .
29.
by burmecia 8y ago
No, I didn't. And I don't think it is necessary as Zbox is much more like an 'application-level' fs, obviously can't match the system level fs.
30.
by burmecia 8y ago
Nice work!. I also made a similar file system Zbox: https://github.com/zboxfs/zbox . The difference is Zbox is a in-app file system focused on privacy, so FUSE is not supported intentionally. Although it already support

More ›