doh

47 ms·

421.
by doh 9y ago
Pex | Multiple Positions | Downtown, Los Angeles | ONSITE & REMOTE, FULL-TIME | Salary $100k+ & Equity | https://pex.com Pex is a search engine for music and video, that uses the content as a base for its search (think
422.
by doh 9y ago
Oh really. Then please add some vectors to BigQuery and run the query on it.
423.
by doh 9y ago
Yes, those are using the technologies underneath the hood, but are not them itself. I would like to have access to them directly as I would like to build other things at top of them
424.
by doh 9y ago
I hear you. Miss most of the tools and infrastructure every day since I left. I was ecstatic when they made PubSub available to everyone. Wish they would expose more of the internal services, especially Colossus, Dremel, Borg, ...
425.
by doh 9y ago
I think this is called maturity. GCP finally knows who the target customer is, and they're building features for them. DO has really nice and simple UI, but try to spin 5,000 servers and you will see what a hot mess it is. GCP shines a
426.
by doh 9y ago
You can go to as high as the box allows you to go (GCE allows I believe up to 10TB per server), but the performance will suffer.
427.
by doh 9y ago
This is not a bad advice overall, but I think that Citus has still a huge market to conquer before they go down this path. Single PG node can handle easily 80k/s writes and reads and store up to 3TB of data safely. Wast majority of com
428.
by doh 9y ago
One approach, that is commonly mentioned in this thread is to simulate a behavior of a normal user as much as possible. For instance rendering the full page (including JS, CSS, ...) which is far more resource intensive than just downloading
429.
by doh 9y ago
> I agree. But I am thinking about making a database role for each user. The user becomes that role after signing into the front end, like Apache. I figured. If you isolate the data well enough, it could work. I'm always paranoid wh
430.
by doh 9y ago
Not sure that I would do authentication directly in PG (although it has many different methods [0]), I think it's still doable. You could move whole oAuth to PG through PL/SQL (maybe there is an extension for it?). I would also en
431.
by doh 9y ago
Unfortunately no, at least not currently
432.
by doh 9y ago
Not at the moment.
433.
by doh 9y ago
Pex | Multiple Positions | Downtown, Los Angeles | ONSITE, FULL-TIME |Salary $100k+ & Equity | https://pex.com Pex is a search engine for music and video, that uses the content as a base for its search (think of Google Image
434.
by doh 9y ago
I never said it's a deal breaker, just that it's not possible to fly supersonic over the land. I do hope that the Boom team will be able to deliver a viable service for benefit us all. Would love nothing more than to travel faster
435.
by doh 9y ago
In USA, all supersonic flight over land by civil aircraft has been prohibited by regulation introduced in March 1973. [0] Without changes in the legislation, airlines can only offer supersonic flights over the ocean. [0] https://
436.
by doh 9y ago
I'm using it for couple of months now. Great for simple queries, especially when you just quickly need to plot out data to see what's going on. Usually I did these things in matplotlib, pandas and it takes a lot of time to prepare
437.
by doh 9y ago
We built a kind of hybrid infrastructure around this idea. Any component sends its data into kafka-esque (we're using combination of NATS and PubSub) pipeline where series of workers read, process and write data into our RDBMS which is
438.
by doh 9y ago
You're correct, I misunderstood you. Column stores are great, for some tasks and have disadvantages in others. Redshift was I believe the first implementation at top of PG so it's doable, however not sure that PG itself is a good
439.
by doh 9y ago
Understood. Different use cases. We like schema, gives us an opportunity to keep data in check. We also communicate through protobuf so there is no benefit in schema-free database for us. I know that Heap Analytics is using jsonb to have sc
440.
by doh 9y ago
You mean cstore[0]? No. We've some jsonb but very little. We know what our data look like, so we don't have to. [0] https://github.com/citusdata/cstore_fdw
441.
by doh 9y ago
I think PG is already there and beyond if you consider using Citus. We've pretty large deployment in our production with 45TB of data, across 1,280 cores 4.8TB of RAM. Most of our tables have hundreds of billions of rows that are under
442.
by doh 9y ago
Spot on. Noah Smith made the comparison couple of months ago [0]. [0] https://www.bloomberg.com/view/articles/2017-09-19/want-a-be...
443.
by doh 9y ago
Pex | Multiple Positions | Downtown, Los Angeles | ONSITE, FULL-TIME |Salary $100k+ & Equity | https://pex.com Pex is a search engine for music and video, that uses the content as a base for its search (think of Google Image
444.
by doh 9y ago
Wasn't aware they added the support. Well, maybe they can figure out GPUs too.
445.
by doh 9y ago
We don't mind per-minute billing on GCP, but would love to get the minimum down to 1 minute or even less. We have some tasks that finish under 4 minutes where scaling horizontally instead of vertically makes much more sense to us.
446.
by doh 9y ago
Not sure that will happen anytime soon. It's the same with Local SSD. The virtualization of this environment is very challenging, maybe beyond a point where it makes sense for them to do so.
447.
Nikon Picked 32 Photographers to Promote a Camera. All 32 Were Men(nytimes.com)
1 points by doh 9y ago|1 comments
448.
by doh 9y ago
Congrats on the release!
449.
by doh 9y ago
Fixed
450.
by doh 9y ago
Pex | Multiple Positions | Downtown, Los Angeles | ONSITE, FULL-TIME | https://pex.com Pex is a search engine for music and video, that uses the content as a base for its search (think of Google Image Search just for video/

More ›