7 ms·
Google Optimize now free for everyone
- matt4077 8y ago"Published Mar 30, 2017" (I'm not complaining–it's interesting and I'll give it a try. But it's not brand new)
- na85 8y agoWhere is the requirement that we only see "brand-new" stuff on HN?
- janimo 8y agoHacker News :)
- yjftsjthsd-h 8y agoWell, it should probably be tagged (2017).
- matt4077 8y agoThere is no such requirement, and I thought I was clear that I appreciated the post, and was merely trying to add the information. Also: the headline has "now" in it. It's not the end of the world, but I've seen correction notes on NYT etc articles for far smaller matters. It's just a general principle that true information > false information.
- willio58 8y agoWhen the title includes “now free” but it’s old news, I think it should include the year in the title
- oh-kumudo 8y agoHow long will this promise be kept, I am curious.
- maxpupmax 8y agoThis is a freemium product. There's an enterprise upgrade that costs about 10k per year I believe. It's nice though, I use it on my site.
- AstralStorm 8y agoAdditionally a freemium product where Google can steal all your ideas because you just gave them the license. (not necessarily true, but it has happened before with YouTube)
- hartator 8y agoI just hope they won't kill Experiments in Google Analytics.
- dudus 8y agoWhy? This is a straight up upgrade over content experiments.
- hartator 8y agoI don't remember exactly. I've tried a couple of times without success. I like the way you can setup two pages and do your regular dev. process with the GA experiments. Like if you want to something server side, you can't as it's only JS on the client side with Google Optimize. So you can only A/B cosmetic. Or maybe I missed something.
- subpixel 8y ago"Google content experiments to be deprecated" https://github.com/dwyl/learn-google-optimize/issues/8 https://github.com/dwyl/learn-google-optimize/issues/8
- hartator 8y agoYeah, I know, we'll use it until they actually kill it. Nothing really compelling in the Google Optimize offer make me want to switch, but maybe I am wrong.
- GunlogAlm 8y ago'Optimize' has been around for quite some time, just in case anybody thinks this is new. In fact, I believe this feature has been around for over a year, now.
- rightbyte 8y ago"Optimizing" UI for session length and clicks is the same thing as finding the local maxima of bad, right?
- jakob223 8y agoNot necessarily - if I have a website that is trying to offer information to people about something, then it's better for everyone if it's more navigable/undersatandable, which session length / clicks might be a proxy for. That said, it certainly can be.
- sp332 8y agoIf your users find what they need right away, session times will go down.
- uberstuber 8y agoThe effects of this are easiest to see with online recipes; the highest ranking recipes are all thousand word ramblings with a recipe tacked on at the end. Google sees you spent more time on the site (i.e. wasted scrolling) and thinks you were more 'engaged.'
- haroldp 8y agoWow, I hadn't made that connection! I just kept wondering why all recipe sites had devolved into fiendishly consistent kind of stupid.
- indiesolver 8y agoI am wondering if it is based on their own Google HyperTune / Vizier [1, 2] which is modified to better deal with uncertainties or it is an absolutely independent in-house development. [1] https://cloud.google.com/ml-engine/docs/tensorflow/using-hyperparameter-tuning https://cloud.google.com/ml-engine/docs/tensorflow/using-hyp... [2] https://ai.google/research/pubs/pub46180 https://ai.google/research/pubs/pub46180
- curo 8y agoDoes anyone have a rule of thumb on when A/B testing becomes important for startups? We have a few thousand visitors a month and are starting to convert, but my guess is A/B testing language and buttons would be premature optimization for us. Just curious at what point that's no longer the case.
- the_bear 8y agoThere are some calculators that help you figure this out. Here's one I just found with a Google search: https://www.optimizely.com/sample-size-calculator/ https://www.optimizely.com/sample-size-calculator/ The idea is that to get results, you need some combination of a lot of data, or a big impact from the changes your testing. If you just change the color of the signup button, it probably won't have a major impact on the conversion rate, so you'll need a lot more data to reach a conclusion. But if you test a completely new landing page, it might have a better chance of being meaningfully different (better or worse, who knows until you test?) and so you wouldn't need as many visitors to get a result.
- shostack 8y agoIf you have an easy way of rolling out tests, and enough data to reach statistical significance, IMHO it's never too early to test.
- roberttod 8y agoIn order to be useful, you probably want to see AB tests reaching a conclusion in under 30 days. I'd say for a conversion rate goal, this is going to be when you have around 100k visitors a month. There are a few variables to consider - What goal would you like to AB test? Conversion rate is an end-of-funnel goal that needs a lot of traffic, you can use upper funnel goals like product views, add to bag etc to get quicker conclusions (not as accurate but often a good approximation) - The stats engine/AB testing tool you are using. More simple tools might conclude quicker but in my experience they can be so inaccurate they are counter productive. Usually a long time to conclude = reliable results. I've never used Google Optimize so I'm not sure where it stands. - How many people are being exposed to the AB test, for example is it all web traffic or just mobile? - How much of an affect the AB test has on behavior. A button color/text change will normally take long to conclude than a feature that's really helping your users. - How confident do you want to be before reaching a conclusion? I'd recommend looking for 95% confidence in uplift before concluding an AB test.
- deleted 8y ago[deleted]
- jwatte 8y agoSo Google just killed crazyegg and optimizely?