5 ms·

Yev from Backblaze -> Where/what do you teach? We're unsure about releasing any more information at this time, but we're not opposed to it. What would it be use

by atYevP 13y ago

Yev from Backblaze -> Where/what do you teach? We're unsure about releasing any more information at this time, but we're not opposed to it. What would it be used for?

adolgert 13y ago
Maybe you looked at Schroeder and Gibson from Fast07, which looks at MTBF calculations. They have lots more data, but none released. Hard drive failures are an easy example of the use of the concept of hazard to examine probability distribution functions. I'm not teaching this now, but I sympathize with the difficulty of finding good datasets. Who knows? If you group data by pod, or even location in datacenter, there could be something interesting in exploratory analysis.
- caycep 13y ago
  In my limited knowledge, this would be a generalized linear mixed model to look at factors influencing drive failure? or more of a poisson thing?
  - Fomite 13y ago
    You could use any number of models to model the time until drive failure - accelerated failure time models, a poisson model, a Cox proportional hazards model, Kaplan-Meier curves...
Fomite 13y ago
I'm a postdoc at the moment, but I've taught survival analysis before. It just struck me as a particularly straightforward example with pretty clean data, a visible separation of the different groups, etc. Basically, lots of people use the "Iris" data set to learn either data visualization or machine learning based classification. The same could be true of the "Backblaze Hard Drive" data, but for survival analysis/time-to-event statistics courses.
- atYevP 13y ago
  Very cool! What's a good way to reach you, I see your handle doesn't have an about section. My handle is my twitter handle if you would like to ping me and we can chat a bit more!
  - Fomite 13y ago
    Email sent.
e12e 13y ago
Oh, I'd love for you to just dump this somewhere with a CC-BY (attribution required, free use/mix/share) -- wonderful way of marketing Backblaze to up-and-comming statisticians and students everywhere ;-) (Just put a "this attribution (blah, blah) include text: backblaze is a service that provides unlimited backup (link) ... etc) I can't see it harming you in any way -- your business is already wonderfully transparent -- if any mystery remains to be figured out by would-be competitors it would be in the data center/bandwidth area, not the price of hard disks. But it would be really interesting to play around with such data.

by atYevP 13y ago

Yev from Backblaze -> Where/what do you teach? We're unsure about releasing any more information at this time, but we're not opposed to it. What would it be used for?

adolgert 13y ago

Maybe you looked at Schroeder and Gibson from Fast07, which looks at MTBF calculations. They have lots more data, but none released. Hard drive failures are an easy example of the use of the concept of hazard to examine probability distribution functions. I'm not teaching this now, but I sympathize with the difficulty of finding good datasets. Who knows? If you group data by pod, or even location in datacenter, there could be something interesting in exploratory analysis.

caycep 13y ago
In my limited knowledge, this would be a generalized linear mixed model to look at factors influencing drive failure? or more of a poisson thing?
- Fomite 13y ago
  You could use any number of models to model the time until drive failure - accelerated failure time models, a poisson model, a Cox proportional hazards model, Kaplan-Meier curves...

Fomite 13y ago

I'm a postdoc at the moment, but I've taught survival analysis before. It just struck me as a particularly straightforward example with pretty clean data, a visible separation of the different groups, etc. Basically, lots of people use the "Iris" data set to learn either data visualization or machine learning based classification. The same could be true of the "Backblaze Hard Drive" data, but for survival analysis/time-to-event statistics courses.

atYevP 13y ago
Very cool! What's a good way to reach you, I see your handle doesn't have an about section. My handle is my twitter handle if you would like to ping me and we can chat a bit more!
- Fomite 13y ago
  Email sent.

e12e 13y ago

Oh, I'd love for you to just dump this somewhere with a CC-BY (attribution required, free use/mix/share) -- wonderful way of marketing Backblaze to up-and-comming statisticians and students everywhere ;-) (Just put a "this attribution (blah, blah) include text: backblaze is a service that provides unlimited backup (link) ... etc) I can't see it harming you in any way -- your business is already wonderfully transparent -- if any mystery remains to be figured out by would-be competitors it would be in the data center/bandwidth area, not the price of hard disks. But it would be really interesting to play around with such data.