asharp

11 ms·

61.
by asharp 15y ago
Now that, my friend, seems to be an actual challenge.
62.
by asharp 15y ago
Warning, spoiler? My first take on it was the following: Take the average of the differences between each pixel and the pixel adjacent to it over each column and store that as, say, X[]. Find some maximum number such that the sum of every n
63.
by asharp 15y ago
The point will probably be a few years off, at least for retail prices. Cloudsmithing is still a new art, and there are very few people outside of Amazon who can produce a functional cloud.
64.
by asharp 15y ago
Wasn't the major problem with commoncrawl that most of the index data was too old to be useful? Besides, search index crawling is comparitively cheap compared to the data processing required to make it useful for actual search.
65.
by asharp 15y ago
encfs also works really well with dropbox and it similarly includes many more options. Truecrypt would also work. Does dropbox do binary diff syncs?
66.
by asharp 15y ago
Cool. How do you create the "folders" that people see? (ui wise?) And hide the encrypted counterparts?
67.
by asharp 15y ago
Interesting, but is there anything that can easily process syslog on the other end? ie. split data like this out into something useful?
68.
by asharp 15y ago
It's interesting that Netflix mentions the cost of infrustructure. At the moment, owning dedicated servers and coloing them yourself is orders of magnitude cheaper then a cloud provider. It's only "cheaper" if your cost of money is stupidly
69.
by asharp 15y ago
Interesting. What crypto functions do you use? Openssl? Also in your "how it works" s/loosing/losing. Keep in mind that you are breaking dedup, which is likely to make dropbox sad. Probably not sad enough for them to do anything useful thou
70.
by asharp 15y ago
Also, I believe a good portion of the cryptosystems around DES's time were intentionally crippled to meet export restrictions so that they were not classed as munitions. So it would not be so much to say that the cyphers were weak insomuch
71.
by asharp 15y ago
Distributed optimisation is interesting. Remember that you can take node failure, as long as you have a copy of your state stored somewhere that you can restart from when required. The overall product isn't particularly effected from that.
72.
by asharp 15y ago
If you're interested in getting in touch with the startup scene, send me an email.
73.
by asharp 15y ago
Very interesting, i'd like to see what physics hacks they end up using to patch this.
74.
by asharp 15y ago
Actually you would worry more about incorrectly implemented padding or a side channel attack or something similarly stupid destroying your cryptosystem. Sad, but true.
75.
by asharp 15y ago
Bandwidth prices here are rather stupid. Yes, it is OOM $100/mbit to get international bw. But that's nowhere near $1/gig. IMHO providers end up charging that much 1) Because they can and 2) To help offset a very high cost base due to a lac
76.
by asharp 15y ago
Shipping data offshore has real legal implications that are anything but FUD. It's actually rather complex to unravel who has juristiction over what. Telstra's cloud is rather sad. Manual day long provisions really arn't a cloud by any reas
77.
by asharp 15y ago
I'd suspect that their data temperature is very bimodal, so they'd be able to easily split out hot data from cold. What much warm data data do you normally have/node?
78.
by asharp 15y ago
But why SQlite? And why file based? Why don't you guys use a proper distributed database to handle container mappings/etc?
79.
by asharp 15y ago
Hmmmm. Downvotes without comments. Classy. This is cheap and at qty 1. A backblaze type box is ca 12K for 135TB of storage. Assume an interest rate of 5% and 36 months worth of repayments and the server itself is worth $725/month It's uses
80.
by asharp 15y ago
Latency may be able to be made low through caching, but depending on the distribution the point at which additional cache is uneconomical may be well before the edge of your performance envelope. How are you calculating your latency? Also,
81.
by asharp 15y ago
Keep in mind that S3, like all other Amazon products, are priced with stupid margins. As such providing lower prices isn't difficult.
82.
by asharp 15y ago
Pretty much, it's always faster to read from multiple disks. There are many reasons why. First is that by splitting things into small blocks spread around the cluster you have more consistent load (why is left as an exercise to the reader),
83.
by asharp 15y ago
:( You're going to shard a SQLite database into a series of objects to deal with "large" containers?
84.
by asharp 15y ago
A cloud hosting provider.
85.
by asharp 15y ago
Swift is....... woeful. Just as an example, they store object listings using SQLite databases that were file based replicated between nodes for HA. Thus when you had too many files in one container your performance would sink like a stone.
86.
by asharp 15y ago
Interesting. If they only open source their client side libraries it would be a rather sad development.
87.
by asharp 15y ago
Ceph is a very interesting project. RADOS, their distributed block store is now mainline I believe and the project is coming along in leaps and bounds. I'm unsure if anybody has a large scale RADOS based blob store though. It would be inter
88.
by asharp 15y ago
I think somebody is making unfounded assumptions about the mental state of another person. A common, albeit embarrassing mistake to make. And yes, I know full well what it means :)
89.
by asharp 15y ago
So it stores data using RS encoding on multiple pieces. I've had a quick look around the website, and the most information i could sort of squeeze out was from the blog. The arch page https://nimbus.io/architecture/ is devoid of architect
90.
by asharp 15y ago
How does it defeat the purpose of the salt? The purpose of the salt is to defeat time/space tradeoff attacks by inflating the required space to the point of impracticality. ie. 20 bits of salt will increase the size of the rainbow table req

More ›