Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
jessicaraygun
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
4 ms
·
1.
▲
by
jessicaraygun
12y ago
Yes! This is very important to us in dealing with transactional email. Our Z-Test Method in Confidence.js pinpoints when results become statistically significant by calculating the required sample size at any given time using the standard e
2.
▲
by
jessicaraygun
12y ago
Thanks for your question! I'll pass it on to Emily, our stats expert.
3.
▲
by
jessicaraygun
12y ago
Hey! I'm the author of Confidence.js. Emily Malcolm and I have been working hard on this new approach for the past few weeks and we're super excited to share it! We're both here to answer any questions :)
4.
▲
by
jessicaraygun
13y ago
Hey martian, thanks for the feedback. Your methodology is pretty sound - it looks like we use a similar technique. If you supply a small sample size here, you'll get the message, "There is not enough data to determine a conclusive
5.
▲
by
jessicaraygun
13y ago
The recommendation of 95% significance level is quite common across A/B testing resources. The main goal here is to be able to say which variant will consistently perform best (in this case, 95% of the time). I agree that it would be u
6.
▲
by
jessicaraygun
13y ago
Hey Noel, I was in charge of the math here - I really appreciate your feedback. You seem really knowledgeable in this area and I would love to improve this A/B testing library. If you have some time to chat, email me at jessica@sendwit
7.
▲
by
jessicaraygun
13y ago
This is a feature that I would love to add to Confidence.js sometime in the near future.
8.
▲
by
jessicaraygun
13y ago
Hey, I'm the author of Confidence.js which was used to power this A/B testing calculator. That sounds really interesting and worth looking into - thanks for the feedback!
9.
▲
by
jessicaraygun
13y ago
You're right about revenue being a very important metric, and I think optimizing for conversions has its place too. I would be interested to hear the results of your repurposing!
10.
▲
by
jessicaraygun
13y ago
Glad you like it, happy to have you contribute :)
11.
▲
by
jessicaraygun
13y ago
Stats class R sleepy... Real world applications like A/B testing are definitely more interesting. We did a lot of digging and there aren't a lot of resources that are easy to digest - but this one really stood out to us: http:&#x
12.
▲
by
jessicaraygun
13y ago
Hi sharnett, Thanks for bringing that to my attention - I agree that our explanation is a little more convoluted than it needs to be. I'll update that later today to be more "readable" ;)
13.
▲
by
jessicaraygun
13y ago
Thanks for the feedback! Confidence.js comes from how we operate on A/B tests at sendwithus - we think of them as variants associated with results. While the code could definitely boil down to a few simple math functions, we find objec
14.
▲
by
jessicaraygun
13y ago
Hey! I'm the author and I'd be happy to answer any questions you might have. Confidence.js is based on the A/B testing code that we use at sendwithus. A/B testing math is hard and we've worked really hard on making
15.
▲
by
jessicaraygun
13y ago
The layout generator is so cool! Yoink.