orf

52 ms·

751.
by orf 3y ago
I’d love to understand your thinking behind the idea that a document standard should rely on a query language and not a file format… Document standards are file formats… Or are you saying a document format should just be some DDL statemen
752.
by orf 3y ago
Ok cool: so adding SQL to that is going to magically speed it up? No. It’s the on disk format that matters. Because it would be just as slow and scary if it used a sqlite file that was embedded in a zip file or something equally as mad. It’
753.
by orf 3y ago
> Anything else would be reinventing the same wheels SQLite has spent decades refining. Which is exactly the problem. They (I.e one dude?), and they alone have spent decades refining a single implementation. Before we go and lock the ent
754.
by orf 3y ago
You’re totally right, but there are a few things missing: this isn’t a DBMS, really, and the files are not going to be huge. You need fast listing/pagination, key value get/set, and transactional updates. Basically DynamoDB, but f
755.
by orf 3y ago
The issue is incremental updates, and this is where things get complex. If you have a file embedded in the middle of a zip file that is 100 bytes, and you want to resize it to 150 bytes, how do you do that? You can’t squeeze it in without m
756.
by orf 3y ago
I mean, clearly you don’t: OpenDocument works just fine without it. You need key/value lookup, a way to list/paginate, and transaction semantics for updates. AKA: a zip file with entries as keys, and XML documents or attachment bl
757.
by orf 3y ago
> In the end, you don't need a database, but a library that gives you database API and behavior. Why do you need a single library that gives you a database API and behaviour? Wouldn't it be better to decouple those: provide a
758.
by orf 3y ago
Coupling a file format to SQLite smells wrong. SQLite is good, but it is also fairly unique in this space. Why? Because it’s hard to replicate everything it does, because it does a lot. But… for this case, do we need it do a lot? No, not re
759.
by orf 3y ago
> Any time you have to give special titles to isolate office work out as “different” you already know you are dealing with garbage. > Office work is office work. HR, admin, finance, maintenance, executive assistants whatever, higher o
760.
by orf 3y ago
… which is obvious, and not what I asked?
761.
by orf 3y ago
What outdoor cat lives 2-5 years? How is this number meaningful when it’s not compared across countries and urban environment?
762.
by orf 3y ago
Use one of the many companies in this space to verify the users ID? Or push some development in this space to find a better way? Or like, basically anything except pretending it’s not an issue and externalising the cost + issues onto everyo
763.
by orf 3y ago
At a certain scale those who are dishonest have a competitive advantage over those who are not. So they win.
764.
by orf 3y ago
> 1986, the programmer left AECL. In a lawsuit, lawyers could not identify the programmer or learn about his qualification and experience. I find this hard to believe: how? Are there no records? Edit: apparently the identity is known, bu
765.
by orf 3y ago
Rust has had an interesting and probably pretty unique story, moving from a GC’d language with a runtime + green threads[1] to what it is today. They are treading a line that is uniquely difficult to tread, and I think it’s mostly working.
766.
by orf 3y ago
> On the other hand, I don't really care to address any of your personalities at this point You’re completely unable to not reply to this thread. You need the last word because it makes you superior, and you don’t want to concede
767.
by orf 3y ago
I’ve seen it happen to a few people and it is a shame. If you’re just roleplaying a mentally ill person online then shame on you. If you’re not, best of luck.
768.
by orf 3y ago
I’d wager pretty often. Here’s what’s likely to happen: you’ve got this big grand exciting idea that you just can’t express to everyone in words. The thoughts are there, but they just don’t come out into words how you want them to. People d
769.
by orf 3y ago
Are you able to answer the question, or are we to take avoidance as answer enough?
770.
by orf 3y ago
> and yours doesn't seem particularly clear How often do you find this to be the case, either online or in the real world?
771.
by orf 3y ago
> Yes, I am ok, I am just moving on a higher plane of reasoning than pretty much anyone else currently Real talk: anyone who talks like this isn’t in a good way. Please take that seriously, and take care of yourself. I’m not sure engagin
772.
by orf 3y ago
Are you ok? If you think you’re programming on the fabric of the universe and not a chip, then the likelihood is you’re experiencing a major psychiatric issue, which given the tone of the replies is a definite possibility. If you’re not, th
773.
by orf 3y ago
It doesn’t, and it’s still a pretty unintelligible answer. > I don't like to live in somebody else's idea of allowed code. You program runs on a CPU, that is the definition of someone else’s idea of allowed code.
774.
by orf 3y ago
1.9999% of android users would form the 19th largest country in the world by population. It’s absolutely worth clarifying a difference of that scale when you’re talking about something niche.
775.
by orf 3y ago
It’s telling that you think 98% of users wouldn’t do that. It’s 99.9999% of android users my friend.
776.
by orf 3y ago
If you read an article with a terse description about the author struggling to ride a bike with 1 wheel missing, would you not assume a second wheel might help?
777.
by orf 3y ago
I can parse a 200gb TSV with NodeJS in under a minute. Could it be done in 1 millisecond with assembly? Probably. But we are talking about over a days runtime here. That is not a micro optimisation, regardless of the language you’re using.
778.
by orf 3y ago
I agree in principal, but they first put it in k8s and then split it into a job queue. They even state that it took over a day to run at one point, implying a lengthy and prolonged attempt at fixing the issue. If you’re working on something
779.
by orf 3y ago
We know a few concrete things: 1. It parses 200gb at an average rate of 700kb/s 2. The job splits strings into a format that is loaded into mongodb 3. There where OOM errors that went away with a smaller workload None of this points to
780.
by orf 3y ago
Yes, of course the unbounded array will cause you to run out of memory. That’s… not news, and it absolutely isn’t a “memory allocation issue” in the sense they are using it in the post. Try modifying it to clear the array (a DB flush, if yo

More ›