56 ms·
> Don't use analytics at all but focus on your product. Huh? Analytics is how you focus on your product. By instrumenting your product with analytics, you can
by crazygringo 6y ago
> Don't use analytics at all but focus on your product.
Huh? Analytics is how you focus on your product.
By instrumenting your product with analytics, you can find out if customers are using your new useful feature or if they can't find it. If they're performing a task quickly because it's easy, or slowly because they're struggling with the UX. And you find out that customers on a certain mobile device are suffering huge performance issues, for example.
You don't know these things until you measure them. That's analytics.
Obviously analytics are only one piece of product improvement -- there's sitting down with users for 30 minutes to watch them use the product, interviews, surveys, etc.
But analytics are a critical piece. You can't focus on the product without analytics.
Analytics isn't just about conversion. Analytics is about the entire product experience.
- crummybowley 6y agoYes, but analytics is also used to trick folks into buying a paper back full of shit. A good product, that does what it advertises, does not need analytics. But a bad product, that somebody desperately wants to make successful, or at least successful enough to sell to a PE and exit, needs analytics.
- andrewingram 6y agoThe problem is that when making a product you're often wrong, what you think is a good product is often a bad product, or it's a nearly good product with a couple of fatal flaws that can only be seen in hindsight. S While some people have an uncanny sense of vision, and seem hit on the right ingredients more often than seems fair, but most companies aren't led by this kind of person. You need things that tell you when and how to course-correct, this is what analytics gives you. Now, of course, this needs to be balanced against privacy concerns. I push back on things that track literally everything (the tools that record every click and cursor movement are fascinating, but undeniably creep), and I try to avoid sending any PII to 3rd-parties. The amount of stuff Google Analytics phones home about by default is also pretty troubling. I'm on board with basically every privacy-based criticism of tracking, but I don't buy this argument that only bad products benefit from it.
- niDistinct 6y ago> the tools that record every click and cursor movement are fascinating, but undeniably creep That may not be so for a game developer who wants to modify gameplay that is heavy or reliant on things like particular mouse cursor movement and mouse click usage. Especially if a meticulous gameplay goal is the objective.
- janpot 6y ago> you can find out if customers are using your new useful feature or if they can't find it How do you find out if your "useful" feature isn't as useful as you thought it was? Or is it really always "the user can't find it"?
- prox 6y agoCould be that, it could be design, it could be how something is worded, it could be that what you want the client to see, isn’t being seen. Analytics helps to identify this problem. For instance I noticed recently a huge drop-off in visitors from Ipads, and a redesign apparently made some parts of the site dysfunctional for some ipad users, something we didn’t catch earlier.
- sizzle 6y agoYou could talk to your users... (i.e. UX research), observe them using your website or product and ask them non leading probing questions to see what the intent is behind the behaviors affecting your bottom line. Qualitative research methods are a rich source of insight that is typically underinvested and underutilized. Analytics (quantitative data) can help you find areas of bottlenecks to explore further by doing qualitative user research and getting to the ‘why’ behind the people problems standing in the way of your metrics you are tracking (retention, adoption, etc.). This is called ‘triangulation’ using quant and qual research methods to understand your users more deeply than just looking at data can achieve.
- google234123 6y agoUsers hate being bothered and hate taking surveys. Qualitative research isn't scientific anyway.
- mattnewton 6y agoUX research participants are usually compensated, and so it's usually done to drill down deeper into problems that analytics found and test possible explainations. I don't see what's unscientific about that.
- PragmaticPulp 6y agoI worked for a tech company popular with enthusiasts when GDPR was first rolled out. We had a lot of requests from users who wanted us to provide their data per the GDPR allowance. We also had an influx of tech journalists filing GDPR requests in hopes of catching us doing something wrong or tracking too much personal data. When we sent users their "data", many of them were in disbelief at how little data they received. Many had come to believe that all tech companies are secretly building inventories of user data to sell to 3rd parties, when really most of us just want to know if our heavy users of Feature A are also heavy users of Feature B, or if Feature C is more popular with new users but not old users. The strange part is that tech companies are taking the brunt of the bad PR for things like gathering customer feedback and serving relevant ads, while traditional companies like cell phone providers and credit card companies are actually selling customer data. The latter doesn't get enough attention despite being a much more widespread issue. Facebook doesn't sell your data, but your phone provider and credit card company probably do. But ask the average person who's selling their data, and Facebook will get all the blame.
- godelski 6y agoI think Facebook gets the blame because they are at the end of the chain. They don't sell your data but they do sell the access to your data (from themselves through the website or tracking and what they bought from said other companies). Being that major player in the service it makes sense that they get the heat, but at the same time most people are still tech illiterate. I mean look at how people think Amazon is only a retail company.
- mattnewton 6y agoI have never been inside a newsroom, so I can't know for sure, but I suspect facebook also gets a fair amount of the blame from news media because of their fraught relationship as pseudo-competitors.
- reaperducer 6y agoI have been inside a newsroom (for 20 years), and your assumptions are not correct. Very very very few journalists have time to grind axes for any reason. They're too busy feeding the beast.
- stiray 6y ago> Analytics isn't just about conversion. Analytics is about the entire product experience. ... which you can entirely do by analyzing web server logs. You dont need google for this, pushing your users (with violation of GDPR consent) into google monstrosity. Dont do that, I block every freaking google domain from cdns, fonts to analytics. But I don't block 1st party analytics. I have no reason to. I have visited your site, I dont have anything against YOU following what I read. It is your site. But you will ask me for consent for giving those data to google. And I will say 'no'. And I am not the only one. Just to inform you, that the person/entity that allows Google to gain access to PII data is directly responsible for this - if google is fined due to GDPR violation, you can get fined to by providing it the way to get users data. They will survive. You might not. Have your analytics, but you will not sell my soul (which GDPR explicitly forbids you - you are handing over my PII data to 3rd party that is known for violating it and that makes you accomplice) for you having your graphs. You can get those data from web server logs. You will have all the data that you need. Actually more data, as no one will block them. Needing "google analytics" is just a huge, giant, hype driven, lie. You don't need them to analyze what you already have in YOUR logs. chaos_emergent: please do explain, what data google analytics is offering to you than what is already in your server logs? Without violating GDPR even more? Yes, you can surely track something more, again "on your side". Dont give it to google as it WILL get blocked and you will have a distorted picture of how your site is being used. If you want real data, skip 3rd party analytics. Found a way to require to be unblocked? I will skip your site, you have just lost a user. A paying user if the content is worth the money. And sites with selling my data for a graph or two are not worth it.
- chaos_emergent 6y agoI agree that people shouldn't be using Google Analytics. I disagree that people should just rely on their web server logs. Products are more than the data that is being accessed on them - copy and design make a product usable and don't show up on web servers. Am I missing something?
- throwaway3699 6y agoFWIW, there are many well known techniques for shipping data to GA regardless if you block it or not. Many integrate server-side for this reason (as you say - server logs are very rich), and client side is used supplementally. Some are using sneaky techniques to move requests through 1P domains. Adblockers make zero difference.
- enz 6y agoThis is not the same kind of analytics. You are talking about something like HotJar with heat maps to find out how customers use the product for example.
- crazygringo 6y agoNo, I'm talking about Google Analytics which is the topic of the article and parent comment. Heat maps are great too but Google Analytics is still used as the foundation for figuring out which types of users are clicking and not clicking on what, both in isolation and as part of a pathway between elements/pages/etc.
- XCSme 6y agoPlug: If you're interested I have built a tool to solve this need of having both qualitative data (heatmaps, recordings) and quantitative data (stats, segments), plus it's self-hosted for highest privacy: https://usertrack.net https://usertrack.net
- hansel_der 6y ago> Analytics is about the entire product experience i feel like there is a underapreciated difference in wether you are selling a physical product/service or a digital one. both benefit from focus on the product, but anlytics on the website is vastly more helpful if your product essentially _IS_ the web-ux.
- rsync 6y ago"If they're performing a task quickly because it's easy, or slowly because they're struggling with the UX. And you find out that customers on a certain mobile device are suffering huge performance issues, for example." ... "You don't know these things until you measure them." If you don't build big, bloated tools using ultra-high-level frameworks and if your product is a simple tool that performs a single, useful task ... then you do know these things and you don't need analytics to tell you.
- deleted 6y ago[deleted]
- bashinator 6y agoSerious question - does Google Analytics tell you if I abruptly close your page only a few seconds after it's started loading?
- nxpnsv 6y agoYou get an idea how long someone has the page open yes.
- bogus-official 6y agoBut only if the user goes on to visit another page. You don't see how much time they spent on last page they visited, even if they only visit one page, by default.
- aww_dang 6y agoDepends on the events you are tracking.
- lmkg 6y agoOut-of-the-box, no. With custom work, yes. The amount of effort is not large, and there are off-the-shelf solutions available. The name commonly used is "engagement timer." By default, GA only sends one hit on page load. If there's no second hit, there's no way to tell if someone was looking at the page for a second or a minute or an hour.
- hnick 6y agoHow do they handle it? A keep-alive style ping, or something like a beforeunload event hook?
- e_y_ 6y agoIn theory the correct way to send analytics when leaving the page is via navigator.sendBeacon, although it's not clear how reliable it is: https://volument.com/blog/sendbeacon-is-broken https://volument.com/blog/sendbeacon-is-broken (note: read the comments for some rebuttals to the article)
- boplicity 6y ago> Huh? Analytics is how you focus on your product. For the first decade of my career, I really believed this, and spent a lot of time doing split tests, and studying analytics, and trying to "make things better" by understanding the numbers as they were given to me. This was a mistake. I've since learned that these numbers will rarely help me make meaningful improvements to my product, and my business. Sure, they can be useful so that I'm not "running blind," but they simply aren't going to show me how to create an ingenious idea that takes things to the next level. Analytics will help you optimize things to a "local maximum", but they'll blind you to the real possibilities of creating something new that can completely transform a business. As soon as I understood this distinction, I've been quite a lot more effective. There's a similar problem with things like "user interviews." A common pitfall is to ask people which features they want. That has limited use. The real work you need to do is the "creative thinking" that others haven't done. Figure out what people don't know they want; learn what the numbers can't tell you. Then go and build it. Yes, understand the numbers, choose a good business model, and optimize based on those numbers, but don't let the numbers create the product. It's a dead end.
- musicale 6y agoApple famously "ignores" its users, partly because users usually can't see far beyond what is in front of them, often because they don't know about impending advances in technology or clever new designs. They'll ask for faster, cheaper versions of what they already have (faster horses, cheaper buggy whips as they say) rather than the next big thing. Faster/cheaper weren't the primary draws of the Mac, iPod, iPhone, iPad, etc. (though price/performance is a big draw of the M1, the big breakthrough is performance/watt which leads to all-day battery life and better thermals.) Instead it was a quantum improvement in design, usability, and functionality combined. As another example, consider that in 2007 Apple developers were begging for an iPhone SDK, and Steve Jobs crushed their hopes by telling them to just make web apps. A year later Apple came out not just with an iPhone SDK, but with an entire App Store. (Though I suppose some developers [Epic] and users [HN] wish they had just come out with an SDK, and that the iPhone wasn't locked down.) That being said, they do a lot of user testing of the next big thing before it is revealed publicly.
- musicale 6y ago> You can't focus on the product without analytics This is provably false. You do not need intrusive analytics to develop fantastic products. Have people somehow forgotten about good old-fashioned user testing? It is expensive, time consuming, and amazingly effective. Most importantly you can actually talk to your users because they are people instead of data points. User feedback >>> analytics.
- pcstl 6y agoAnd both > one of them.
- ThalesX 6y agoBut then surely, adding a prayer to St. Isidore of Seville [0] before every release will be better than just the both of them, so three > both > one. I've recently interacted with a startup where the amount of resources they spend on trying to get them both, is making them blind to the power of one. It's not a pretty sight when all the numbers are tracked, plotted and planned on, yet nothing seems to work. [0] https://en.wikipedia.org/wiki/Isidore_of_Seville https://en.wikipedia.org/wiki/Isidore_of_Seville
- eideuehehh 6y agoIf you could predict with certainty that the inclusion of a prayer to St. Isidore would lead to a more overall successful product why would you not do it besides obstinance?
- viraptor 6y agoYou can misuse everything. As you mentioned: "all the numbers are tracked, plotted and planned on, yet nothing seems to work." Sounds like there's a plan but no execution / follow up. That's not a problem with either analytics or user feedback.
- ignostic 6y agoOnly on HN would you find people seriously arguing that focusing on product development is a good reason to remove analytics from a site. I've worked almost exclusively at companies where the product is the website, and initially this idea struck me as laughably naive. But let me be fair and think through this. Tech startups do definitely have this problem of focusing on website analytics where the product is NOT a website or app. If we're generous we can assume many people here develop for these kinds of companies. Some waste a lot of time looking for up-and-to-the-right arrows for investors or trying to be data-focused when data about the website isn't actually all that important. Many of these companies might actually be better off with no analytics to waste time on. I'd still argue it's better to check in every once in a while to look for problems and ask yourself some questions. The idea of removing analytics where the product is an app or a website is silly. This would be like arguing a grocery store shouldn't track what people are buying from their stores, and instead just source good products. You need to do both. What are you going to do when I ask what is or is not working? Tell me your feelings? Shake an 8-ball? Aside from detecting problems, analytics can be a jumping off point for innovation if you're smart about it. What can we do that's more like what's working? How can we improve this page type? There are for sure people who over-focus on analytics (often on the wrong data points) instead of creativity, but these are not mutually exclusive. If I were to list the millions of dollars I've earned and saved via analytics this would be a very long post. Sadly, most of those millions were for other people, but it's a very valuable tool for optimizing and creating if you use it correctly.
- gjs278 6y agoor just sell something useful
- api 6y agoBefore the days of the web, we had a solution for this that was better and easier for users and didn't invade privacy: UI design guidelines and UI consistency. Apple is the only company that still occasionally does this, though even they have driven off into the realm of every application having its own entirely novel interface. Go back in time to MacOS or Windows in the 1990s and you'll find an entirely different paradigm: every application has the same interface... or at least the same interface paradigms. Learn the computer once and you've learned the computer. Features were remarkably discoverable. They were organized logically in menus. Keyboard shortcuts were always available and usually intuitive. I remember opening a new app I'd never used before on Windows 95 and just unthinkingly hitting a keyboard combo and it doing the general thing I expected, or mousing to where I expected to find a feature I imagined should be there only to find that it actually was there. I never used Mac Classic much but I heard it was similar. The web is what really broke this. Web UIs overtook desktop UIs due to the difficulty of installing local software and the power of trendiness. Web UIs were never uniform and couldn't be since the web was anarchistic and wild and often driven by designers who wanted to make their product look a specific distinct way. I remember in the days immediately before the web there being talk of algorithmic generation of UIs from data schema. If the UI is thoroughly standardized then it becomes at least thinkable to examine data structures and generate user interfaces from them, even UIs that aren't horribly ugly or hard to use. This was building on a previous generation of incredible WYSIWYG UI design tools. Then the web came and all that stuff was completely abandoned. Today's UI design tools in things like Xcode and Android Studio are horrible by comparison to what people were using in 1995. Go back and try Visual Basic on Windows 95. The VB language sucked but the UI designer was aeons ahead of anything we use today.