3 ms·

So do you have to use python to work with this? That's probably a stupid question because clearly facebook's using all kinds of tech on the backend. I'm trying

by zekenie 13y ago

So do you have to use python to work with this? That's probably a stupid question because clearly facebook's using all kinds of tech on the backend. I'm trying to see how you'd integrate this into a rails or node project...

zekenie 13y ago
Found the answer to my question on the readme: "The implementation here mirrors many of the key components of Facebook's PHP implementation of PlanOut which is used to conduct experiments with hundreds of millions of users."
- ebakshy 13y ago
  I tried to build the python version of PlanOut with portability in mind. It took only a few minutes to port the base class that does all the hashing from PHP to Python. The the interpreter + a few core operators took about two hours. Developing the Experiment and Namespace classes to work in a way that we were happy with took a lot more time. I suspect that if you knew node / js, and just wanted to do a direct port, it shouldn't be too hard. We have a little more background on the project at: http://facebook.github.io/planout/docs/about-planout.html http://facebook.github.io/planout/docs/about-planout.html and I'd be happy to review any ports to other frameworks.
  - cmelbye 13y ago
    Does Facebook use this system to turn on new features for a certain subset of the user base to test those features out, or is this mainly for A/B testing existing features?
    - ebakshy 13y ago
      PlanOut has been used both for evaluating the effects of new product rollouts / encouragements and for more scientific experiments that look at the effects of existing features. You may want to check out Section 4 of the PlanOut paper at: http://facebook.com/publications/563103330455476/ http://facebook.com/publications/563103330455476/
  - zekenie 13y ago
    Awesome, thanks! We'd have to port it to rails to use it at work. Right now we're using much more primitive AB testing.

by zekenie 13y ago

zekenie 13y ago

Found the answer to my question on the readme: "The implementation here mirrors many of the key components of Facebook's PHP implementation of PlanOut which is used to conduct experiments with hundreds of millions of users."

ebakshy 13y ago
I tried to build the python version of PlanOut with portability in mind. It took only a few minutes to port the base class that does all the hashing from PHP to Python. The the interpreter + a few core operators took about two hours. Developing the Experiment and Namespace classes to work in a way that we were happy with took a lot more time. I suspect that if you knew node / js, and just wanted to do a direct port, it shouldn't be too hard. We have a little more background on the project at: http://facebook.github.io/planout/docs/about-planout.html http://facebook.github.io/planout/docs/about-planout.html and I'd be happy to review any ports to other frameworks.
- cmelbye 13y ago
  Does Facebook use this system to turn on new features for a certain subset of the user base to test those features out, or is this mainly for A/B testing existing features?
  - ebakshy 13y ago
    PlanOut has been used both for evaluating the effects of new product rollouts / encouragements and for more scientific experiments that look at the effects of existing features. You may want to check out Section 4 of the PlanOut paper at: http://facebook.com/publications/563103330455476/ http://facebook.com/publications/563103330455476/
- zekenie 13y ago
  Awesome, thanks! We'd have to port it to rails to use it at work. Right now we're using much more primitive AB testing.