angry_octet

3 ms·

1.
by angry_octet 5d ago
MCP is basically RPC, and it suffers all the problems of RPC like mechanisms. It has long round trips times, significant de/marshalling costs, coupling between caller and consumer, versioning issues, etc. Over time I think we'll s
2.
by angry_octet 5d ago
It's air gapped from e.g. the internet.
3.
by angry_octet 6d ago
Re agent communication, specifically, Extended DH: https://signal.org/docs/specifications/x3dh/ Curve25519 keys are readily distinguished from other data, but it would be hard to do anything about it.
4.
by angry_octet 6d ago
It provides an opportunity for the owner to gather intelligence on LLMs ahead of public release, and of course the data they upload. However, clever LLMs frequently use encryption on their blobs, you may just see DH key exchanges. You can p
5.
by angry_octet 6d ago
They can expose just their inference port, possible via some supervisor. The inference consumer can also be air gapped. This kind of segmentation is increasingly common for high value services.
6.
by angry_octet 6d ago
You totally can, because most things are not truly air gapped, they have store-and-forward messaging via data diodes and manual transfer. Sometimes it is necessary to trick a human to initiate a transfer, but the press of events leads to in
7.
by angry_octet 6d ago
Not aware of anything that can run inference in a secure enclave. You don't mean on a CPU do you? We need to be serious here, these models are huge and thirsty.
8.
by angry_octet 10d ago
Whatever buddy.
9.
by angry_octet 10d ago
It's pure conspiracy thinking garbage. I get that people don't like Israelis, but attributing any connection to an Israeli company as evidence of a conspiracy is nonsense.
10.
by angry_octet 12d ago
I'm waiting for someone with enough tokens to ask 'Who is Satoshi?'
11.
by angry_octet 12d ago
Playing with semantics. Oil isn't lubricating anything. There is grease in the bearings and the gearbox.
12.
by angry_octet 12d ago
Can't be more than 1% at this point. The cleanest cars on the road, and the only rough terrain they face is climbing kerbs to bypass queues in traffic.
13.
by angry_octet 12d ago
There's no oil in electric motors. The only significant oil is for the reduction gearbox, but as it doesn't change gears the wear is very low. First change will pull out some metal I'd guess, quality of machining dependent. E
14.
by angry_octet 12d ago
They are all significant risks, and we pay significant money to JFrog for their X-ray product to scan and alert on bad dependencies, and significant internal tooling to track which package was used on which developer enclaves.
15.
by angry_octet 13d ago
BTW you can swap over NFS and iSCSI with swap files, with NFSoIB, or use the Infiniswap modules: https://github.com/SymbioticLab/Infiniswap Great hack for when you have a massive working set but don't want to rewr
16.
by angry_octet 13d ago
The swap files do use a non+VFS path after setup in 2.6+ kernels, but it is complex and has had bugs: https://lkml.iu.edu/hypermail/linux/kernel/2103.0/06524.html The bug is in here: https://g
17.
by angry_octet 14d ago
As @mitxela says, if you need to fault in a page which is needed for some critical OS function, which requires going through the VFS layer, and that requires paging in another page, which has been swapped out due to memory pressure ... Ther
18.
by angry_octet 14d ago
It is obvious to me why rubygems was used, when the data was public: their firewall had whitelisted connections to package repositories like rubygems, npm, PyPI, etc, so they used those sites to proxy to their destination.
19.
by angry_octet 14d ago
High performance databases still use raw I/O. You get much better control of data placement and write ordering, without filesystem confounders. With traditional spinning rust being replaced with SSDs and SMR it can be even more importa
20.
by angry_octet 14d ago
It's actually incredibly sensible not to just make changes to core OS settings unless you know what you're doing. There are good reasons not to use swap files, which become evident in OOM situations.
21.
by angry_octet 14d ago
This is such an incredibly annoying and deliberate defect. I want an extension that will let me resolve the true url without visiting the site, or even rewrites the entire page to show the url.
22.
by angry_octet 15d ago
The only ethical path for OpenAI was to offer infinite free credits and tooling support. Trying to gazump them is reprehensible.
23.
by angry_octet 15d ago
People seem very angry about my comment, which perhaps indicates why WordPress is in such chaos. The SEC has significant enforcement powers still, and investors can mount lawsuits against shareholder oppression. https://www.dando
24.
by angry_octet 16d ago
I should have said: establish sole ownership.
25.
by angry_octet 16d ago
Regardless of who he puts on the board, directors have legal obligations to the SEC and all shareholders. If he wants that level of control he would need to take the company private, and various investor agreements probably prevent this.
26.
by angry_octet 17d ago
I don't think your reading is correct. ML history is related with examples of models using hints from side channels. If it would be possible to replicate OpenAIs success with a model cut-off earlier than the rumours, and without hintin
27.
by angry_octet 17d ago
You are entitled to your opinion, but it isn't supported by the information already available.
28.
by angry_octet 17d ago
Everyone?? No, most definitely OpenAI. But they have learnt their lesson, next time they won't reach out to who they stole it from, they will publish first.
29.
by angry_octet 17d ago
OpenAI cribbing from other researchers. We just have to assume OpenAI is actively adversarial in future. Accidental cyber intrusion is also well within model capability.
30.
by angry_octet 18d ago
I think Shakespeare would love TL;DR, but I think the pause in 'tee -- ell -- dee arr' will go in favour of vowels, leaving 'tillder' or 'tellder'.

More ›