nijave

45 ms·

871.
by nijave 2y ago
Meanwhile in real life it's mostly - better error handling (you don't want your batch to fail because 1 of 1 million items had an issue, usually) - sane retry/timeouts - fixing bad db queries
872.
by nijave 2y ago
>We're building an AI grading assistant for teachers So students will be generating papers with AI and teachers grading them with AI? Maybe the real problem is education and teaching isn't innovating as fast as tech Can't
873.
by nijave 2y ago
Haven't used postgREST but similar tools and these can useful for small/internal apps where you have trusted users
874.
by nijave 2y ago
Event sourcing Also reporting/analytics work loads tend to be ad hoc queries and hard to optimize so you generally favor fast storage over indexes. Frequently for analytics and reporting it's more efficient to use a columnar DB th
875.
by nijave 3y ago
>Cloud computing charges you by the request/byte/cpu cycle. Servers do not have this issue. Sure they do. Processing requests takes bandwidth, CPU, memory, disk I/O >Also, is it simply not possible to rate limit this on
876.
by nijave 3y ago
In all fairness, systems administrators have always had to pay for unauthorized requests and systems to mitigate the risk The new thing is hyperscalers have so much capacity you can get flooded by these long before the service degrades or g
877.
by nijave 3y ago
Direct S3 is pretty common for file distribution where latency is less of a concern. e.x. build an installer and distribute it, generate a report and generate a signed url
878.
by nijave 3y ago
This is a problem with lots of services. Blocking large quantities of legitimate looking requests is a hard problem. Request cancellation is also tricky and not supported well in a lot of frameworks/programming languages.
879.
by nijave 3y ago
Why?
880.
by nijave 3y ago
I made this a while back that utilizes shell script and AWS cli to spin up and cloud init to run things https://github.com/nijave/cloud-init-golden-image For this type of use case AWS has managed services like Batch, E
881.
by nijave 3y ago
This kind of setup is a nice improvement over golden images with a lot of the benefits. Application setup, upgrades, and rollback become much easier when the whole app is packaged together and has its own copy of dependencies. You can also
882.
by nijave 3y ago
A decent Python development tool chain handles most of that. Docker, pylint, black, type hints integrated with IDE/editor Admittedly some languages like Go do a better job integrating all this into the core of the language. However, Go
883.
by nijave 3y ago
Usually when I use these types of tools I'm building immutable infrastructure where a golden image gets built and an existing app data volume gets attached to a new OS image (same workflow as Docker containers but more access to kernel
884.
by nijave 3y ago
Real Python instead of templating (Jinja in YAML) would be nice. In Ansible, it's fairly arduous to try to reshape data from command outputs into structures that can be used in loops in other tasks--especially if you want to merge outp
885.
by nijave 3y ago
1:1 NAT or floating IPs. I've only ever seen those to simplify server setups where a subset of servers need a public IP
886.
by nijave 3y ago
Microsoft would like a word with you (utf-8-bom & utf-16)
887.
by nijave 3y ago
Imo at this point you're better off just using OSS not packaged by Grafana. Grafana Agent pulled in a ton of OSS as dependencies and basically implemented a service manager and config management system. However, such a big dependency t
888.
by nijave 3y ago
It has RBAC, service accounts, and Secrets all with APIs. I guess you could automate provisioning storage accounts on nodes or have a system that creates tokens with the cluster key. Not sure that's really any better than not using it,
889.
by nijave 3y ago
Iirc this is a limitation with Prometheus, too, but they give you a switch to change the behavior It's possible Grafana Agent inherited (potentially without exposing the corresponding configuration switch to change it) Edit, it might a
890.
by nijave 3y ago
Batch jobs and (S)FTP. In a bit of a weird twist, back when I worked at Chase, they were innovating on the ancient technology but it was things like "better batch job management/orchestration" and SFTP proxy to route between
891.
by nijave 3y ago
Yeah, this seems like a common pattern. Not sure about currency with arbitrary place values though (like Bitcoin)
892.
by nijave 3y ago
Afaik disabling apps is built into Android but not directly accessible. I think there's a way to do it with ADB. SwiftBackup can also freeze & unfreeze
893.
by nijave 3y ago
Can't remember the details but isn't there also an impact to in app purchases and payment methods? I thought the restrictions/Apple's fee around those were different? e.x. You average $2 per install on in-app purchases y
894.
by nijave 3y ago
Changelog line items is probably a better measure (assuming the line items are aligned to features and bugfixes and not just a list of PRs) https://github.com/valkey-io/valkey/releases Maybe version number/re
895.
by nijave 3y ago
Makes sense to me. It seems a lot of features in Postgres optimize for managing a single instance but every setup I've worked on in the last 8 years has been HA. In that case you'd apply config changes to the replica and fail over
896.
by nijave 3y ago
Virtualizing hardware and running extra copies of the kernel has a small overhead. I'm not sure it matters for the majority of companies but it has a measurable impact for the gigantic ones. Afaik containization was rooted in the abili
897.
by nijave 3y ago
Schema changes happen inside a database on the server but usually you need the DB and user provisioned first (generally using a superuser and the existing/default DB) You can use the same tool, however it needs to connect to 1 DB, do t
898.
by nijave 3y ago
Depending on your definition of "cloud", all major PG contributors offer some sort of commercial or hosted solution. Citrus is part of Microsoft/Azure and EnterpriseDB offers hosting orchestrated on VMs and another option on
899.
by nijave 3y ago
Maybe contentious but I'd argue the ability to rewrite config files at runtime with SQL is the thing that makes more sense being an extension although it's existed for so long as a core feature, it's non trivial to change.
900.
by nijave 3y ago
My thoughts exactly, same thing with OpenTofu recently

More ›