8 ms·
Show HN: A tool to analyze Hacker News sentiment on any term in seconds
Hi everyone, we developed a tool that can easily tell you the overall sentiment of a message based on a word. For now it’s hacker news only but we think this thing has potential.
Whether you’re a startup, solopreneur or product manager, you can track trends with it. We are also planning to add predictive tools and real time analysis. Operationally this tool is a lot cheaper than Sprout Social or other similar solutions on the market.
No sign-up required. Just type and see results.
I'd love your feedback on the tool's usefulness and any ideas for improvement.
- bbor 2y agoCute, love the idea! Would perhaps cut the examples to be substrings to avoid long comments that mention the issue in passing once, but that’s a personal preference. Either way, actually seeing the graph on mobile is wonky, and IMO the example is way less interesting than the graph — maybe make it bigger and more front n center? Thanks for sharing :) TIL sentiment for “communism” is slightly less negative than for “capitalism” on here! Tho both are, surprisingly, mostly neutral.
- lorddustingale 2y agoThank you for your feedback! We appreciate it. We’re actively working on making the tool more user-friendly and intuitive. As expected, most sentiment is neutral, but we plan to add a toggle view in future updates to enhance the experience.
- Mockapapella 2y ago1. Comments have been truncated to 100 characters 2. The graphs now go full screen when they are clicked 3. Most comments will be neutral. This is kind of a quantitative way to see "the silent majority" There's some nuance that is lost due to it classifying the comment as a whole as opposed to specific aspects of it, but it works for the most part. Thanks for trying it out!
- deleted 2y ago[deleted]
- codetrotter 2y agoI think this is actually one of the very first times I have seen neumorphic design in the wild. Prior to this I’ve mostly only seen it on dribbble. I actually like this style a lot, and I wish more apps would use it. But at this point I thought that this style was one that “came and went” before it saw any significant actual use in any apps or OSes. Maybe there is still hope after all :) Edit: oh and I had to try asking your tool for sentiment about neumorphic design after this of course. It returned my own comment lol :p and it called it “neutral”. Is it only evaluating the first paragraph that the word appears in in the comment? (Also I guess other people more commonly refer to it as “neumorphism” than as “neumorphic design” and maybe that’s why when I asked it for neumorphic design it returned my own comment.)
- Mockapapella 2y ago(the other part of the team that built this here) Honestly makes me pretty happy you called out the theme. I've always enjoyed this style of design and was sad to see that it never picked up steam. I love how it seems to combine a digital Material design with a more physical and real feeling. I'm doing my part to bring it back. The tool definitely has some kinks in it that we have plans to iron out over time; we just wanted to get it in front of people to see if anybody would even like it. Right now it's just grabbing the first 256 tokens and categorizing on that, and it grabs the first 5000 comments (split over 5 calls) over the past month.
- WantonQuantum 2y agoAn aspect of the UI I really like is the way previous results stay available while doing new ones.
- Unearned5161 2y agoyeah, looks epic. Makes me think of Superman's spaceship in Man Of Steel , mega clean
- chucksmash 2y agoTokens are characters in this context? I tried "neumorphic design" based on the comment this replies to. It is classified as neutral.
- beepbooptheory 2y ago[flagged]
- rosmax_1337 2y agoWhat were the negative comments about?
- IgorPartola 2y agoNot sure why you are being downvoted. While race isn’t the main topic of this site, I think it is important to keep our inherent biases in mind and out of our decisions when we talk about tech, startups, education, etc.
- beepbooptheory 2y agoEven if not important, its simply interesting in the anthropological sense. Can only laugh that these very downvotes will reinforce the point of the comment(s) itself.
- breck 2y agoLove the fact I didn't need to signup to get value out of this! Note: I would suggest just removing dark mode for now. Works WAY better in light mode. I almost missed the light mode, and that would have been too bad. Here's my user test: https://news.pub/?try=https://www.youtube.com/embed/2eac5XZesgA?si=NDql-yhNEJIH6ykb https://news.pub/?try=https://www.youtube.com/embed/2eac5XZe...
- Mockapapella 2y agoOh wow, was not expecting this level of feedback -- thank you for the video! Addressing some points you made in the video: 1. Yes, this is definitely a V0.1. Thank you for taking that into account :D 2. Interactive graphs (custom colors, intensity, what trends to show, etc.) were something we thought might be useful but wanted to hear what others had to say before we invest the time into a feature nobody wanted 3. That super slow "Searching..." loading message should be showing updates for when it's scraping comments, when it's classifying, etc. Not sure why it's not. Some searches like "open source" are more likely to have a ton of comments to pull so it'll take longer. 4. Default mode changed to light mode because it looks better :^)
- aliasxneo 2y agoAppears to be struggling from the hug of death.
- Mockapapella 2y agoWe're actively taking suggestions from people to improve it. The webserver was probably just restarting with the new suggestions :)
- aliasxneo 2y agoHow often is it doing that? I've tried a few times over the last ten minutes. The latest attempt ended with Cloudflare returning a 504.
- Mockapapella 2y agoIf that's the case maybe I'm seeing a caching thing on my side. I upsized the droplet some
- deleted 2y ago[deleted]
- eth0up 2y agoExit vim - Sentiment: neutral (Confidence: 98.32%) Stockholm Syndrome?
- IgorPartola 2y agoIt would be really interesting to see, in the limit of this tech, how any given comment ranks on the group-think to contrarian scale for every comment you read. There are a lot of signals on HN about comment quality, like karma, account age, reputation of certain individual names, but this could be an interesting one. Wonder what kind of emergent behavior it would drive.
- gotoeleven 2y ago>> white board interviews nothing >>hobos in san francisco nothing >>accommodating my neurodivergence error >>is everyone I don't like hitler or just some people nothing
- analog31 2y agoOut of curiosity, is the sentiment index weighted for up-voted threads and comments? Because those things are a kind of sentiment index too.
- Mockapapella 2y agoIt isn't, just straight text
- MeetingsBrowser 2y agoOn mobile when I select the text input the whole page zooms so far in that I can’t see the submit button (or anything else for that matter). Took me a minute to figure out what had happened, but I was able to submit a phrase. The response was > Randomly sampled comment from the pulled data: Sorry, there was an error processing your message.
- deleted 2y ago[deleted]
- op00to 2y agoThe sentiment of “fart” is neutral.
- poniko 2y agoNice idea, not sure it works though.. got neutral on all words I tried .. even beer
- wongarsu 2y agoIf anything, this tool tracks with my general opinion on sentiment analysis: it would be awesome if it actually worked, but most algorithms just predict everything as neutral. For example if you search for bitwarden it ranks three comments as negative, all others as neutral. If I as a human look at actual comments about bitwarden [1] there are lots of comments about people using it and recommending it. As a human I would rate the sentiment as very positive, with some "negative" comments in between (that are really about specific situations where it's the wrong tool). I've had some success using LLMs for sentiment analysis. An LLM can understand context and determine that in the given context "Bitwarden is the answer" is a glowing recommendation, not a neutral statement. But doing sentiment analysis that way eats a lot of resources, so I can't fault this tool for going with the more established approach that is incapable of making that leap. 1: https://hn.algolia.com/?dateRange=pastMonth&page=0&prefix=true&query=bitwarden&sort=byDate&type=comment https://hn.algolia.com/?dateRange=pastMonth&page=0&prefix=tr...
- Mockapapella 2y agoI think this is fair criticism for where it's at and mirrors my experience while building the tool. For generative AI at least, the smartest models + a good prompt will waffle stomp our tool in terms of quality. For example, while testing it on "Founder Mode" there were a couple comments that mentioned something like "I hate founder mode but I really really like this other thing that is the opposite of founder mode..." and then just continues for a couple paragraphs. It classified the comment as positive. While _technically_ true, that wasn't quite the intention. We think there are some ways around this that can increase the fidelity of these models that won't involve using generative AI. Like you said, doing it that way eats a ton of resources.
- drc500free 2y agoAlmost 10 years ago, I ran a media sentiment analytics product that worked on hand coding. Everything automated that we tested - and that our competitors tried to launch - output garbage. The status quo for media analysis was either averaging a lot of garbage, or paying an insane amount for a very limited scope. We used automated tools to multiply the hand coders, but there was no plausible lights-out solution if accuracy really mattered. That's completely changed in the last 18 months. All my colleagues in the industry have switched to LLMs. They're seeing accuracy as good as hand coding was getting (these were generally college educated coders), at scale. Non-LLM sentiment tools were always a bit of a parlor trick that required cherry picking to survive the demo. In almost every case drilling to the actual statements revealed it was wrong on anything involving irony, humor, or even complex grammar. That's changed almost overnight. I think the finding that hn is "neutral" about MBAs says all that's needed about accuracy here.
- stevage 2y agoA month doesn't seem like a useful time frame? Or maybe I'm misunderstanding the main use case. Also, you could drastically improve styling on mobile. Lot of wasted space.
- Mockapapella 2y agoMain case right now is to see if people like it (and so that we don't hit Algolia rate limits). You're right, a more useful case might be letting the user customize the time frame. As for mobile, I am but a humble backend dev, but I agree completely. Will put it on the roadmap. Thank you for your feedback!
- deleted 2y ago[deleted]
- celdon25 2y agoSeems pointless to go through all that effort to chart this over time, and have that time limited to..... a single month. > you can track trends with it No, no, you can't.
- nomilk 2y agoIt’s great. Simple and works in 10 seconds. Only thing is I’d prefer to know sentiment over at least a year (defaults to just 1 month) Still, great idea and execution
- Mockapapella 2y agoThank you! We plan on letting users select their own timeline later -- this was more of a defense for us to make sure we didn't get rate limited and everyone could try it out
- deleted 2y ago[deleted]
- wavemode 2y agoI searched Blockchain and it said "neutral". This is the sample comment it displayed: > Ah yes, because blockchain is the 100% true source of ultimate truth. The model can't detect sarcasm.
- philipwhiuk 2y agoTurns out Poe's Law affects machines just as much!
- bagels 2y agoAre there any terms that don't say "neutral" as the sentiment?
- WheatMillington 2y agoI can't find any.
- max-m 2y ago"dang" is liked by HN! :D
- fortran77 2y agoI tried “your mother” and it went into the positive area twice, but mostly neutral.
- solardev 2y agoFound one...! Coffee. We apparently hate "coffee" with a 79.99% confidence. Unless you ask it again, in which case we like it with a 98.67% confidence. And if you ask it again, it's 98.86% certain that we're neutral on the topic. Same with "spam". Sometimes we like it, sometimes we don't. I guess it's bad in emails and good on musubis? Shrug.
- dangitman 2y ago[dead]
- avodonosov 2y agoIdea: single number metric, something like, %-of-positive - %-of-negative avearaged over a time period. So that we could compare terms based on this result metric: google vs microsoft, rust vs go, rust vs microsoft, etc (Will not work for Go as it's a common word in addition to the programming language, but anyways)
- Mockapapella 2y agoI like it. We'll put it on the roadmap.
- grogenaut 2y agoit'd be great if I could turn off neutral, it's drowning out the positive and negative lines... for example Kubernetes... mostly neutral.
- ranger_danger 2y agoMy biggest issue when I tried to analyze sentiments was that there is no practical way to bias for sarcasm, such as "it's great if you love pulling your hair out".
- solardev 2y agoHmm, it thinks HN is neutral on crypto. Hmmmm. Is it actually doing anything?
- deleted 2y ago[deleted]
- __MatrixMan__ 2y agoApparently we prefer death over Oracle. But on a second search Oracle is then better than death... No, I don't think it is.
- philipwhiuk 2y agoI guess it's an issue when we dislike two things just as much :P
- caseyy 2y agoNFTs — neutral with 98% confidence. Hmm… Also, it seems like putting in the same phrase twice generates different graphs and results at least sometimes. So it’s difficult to use comparatively.
- WheatMillington 2y agoRTO and Elon Musk are both overwhelmingly neutral sentiment? Seems unlikely.
- brunocvcunha 2y agoCool idea. But as a red/green color blind person, I have no way to figure out what is positive/negative in the graphs.
- Mockapapella 2y agoAch, sorry 'bout that. I added a red/green colorblind toggle for generating the graphs.
- bhaney 2y agoI like the concept and the interface, but after trying one of the suggested examples, I'm not convinced this actually works? I tried "remote work" like the initial instructions recommended as an example. The graph it gave me showed large spikes of "neutral" sentiment with a few negligible bouts of negative sentiment and even smaller bouts of positive sentiment. The sample comment it gave was from a "Who Wants to be Hired" post where the poster demanded exclusively remote offers, which the tool classified as "neutral" (with 98.7% confidence!) Very slick tool, but if the sentiment analysis itself doesn't really work well then I don't see what value this could have.
- lorddustingale 2y agoIt will definitely work better with larger datasets, we have plans to improve quality.
- ryukoposting 2y agoVery cool until I downloaded the graph, went back to the main page, and Firefox Mobile crashed.
- thih9 2y agoCongrats on the launch, the idea sounds useful, the UI looks very intuitive and to the point. I like that I don’t have to log in and can try it immediately, big plus. Bug report, I saw inaccurate results, I asked about “native apps” and I got negative sentiment. This is contrary to my experience, afaik HN loves them. The example comment[1] quoted “non-native apps” and is part of the discussion where people say they don’t like non-native apps. Edit: Then I asked about non-native apps, got sentiment “neutral” and this comment (the one I’m editing now) as the example. Very unexpected! [1]: https://news.ycombinator.com/item?id=41366882 https://news.ycombinator.com/item?id=41366882
- rustdeveloper 2y agoSurprisingly, according to you tool, HN is neutral on “web scraping”. I noticed others also reported bias for neutral on other keywords.
- trampish 2y agoInstead of "linking" to a data:image URL, consider using a <map> and several <areas> to link to posts from the given time range like so: https://hn.algolia.com/?dateEnd=1726171200&dateRange=custom&dateStart=1725998400&page=0&prefix=false&query=pain&sort=byPopularity&type=story https://hn.algolia.com/?dateEnd=1726171200&dateRange=custom&...
- wslh 2y agoI searched for 'crypto' and noticed that most sentiments appear neutral, whereas I would expect negative sentiments to be higher. It might be an interesting case for you to test on your side.
- xnorswap 2y agoPlease link to the "Randomly sampled comment", there's an ellipsis but no way to actually read the comment? I searched "apache" and the "randomly sampled comment" was a mystery: > I think the author has a point with one-way doors slowing down the adoption of distributed systems. ... I had to search google with that phrase to get the actual context. ( https://news.ycombinator.com/item?id=41363836 https://news.ycombinator.com/item?id=41363836 ) Which turned out to be about "Apache Beam" not the Http server.
- t0bia_s 2y agoPlease, don't be funky with UI. Make it simple, without emboss design.
- madarco 2y agoI literally spent more time looking at the UI than playing with the tool itself, I really love this skeuomorphism! If you remove the dark-gray border from the buttons it's even better!
- velcrovan 2y agoFor something you depend on and use a lot, I agree. For what this is, the creative UI is arguably the best part.
- luke-stanley 2y ago`Sorry, there was an error processing your message.` It got neutral for stuff I wasn't expecting to be neutral, it shows a frequency graph but sentiment range / variability might be worth showing.
- nhggfu 2y ago"I'd love your feedback on the tool's usefulness" useless junk.
- avodonosov 2y agoGood tool to choose techologies. Java and Rust have mixed sentiment. For Brainfuck the positive coments clearly outweigh the negative ones.
- SuperHeavy256 2y agoWould be great if you added buttons like 'Show Positive Sentiment Example' 'Show Neutral Sentiment Example', and 'Show Negative Sentiment Example' to the chart that will show a randomly picked comment from Hacker News with one of those sentiments. It would really help in understand the source of the information and it would really prove that your info is genuine.
- okasakii 2y agoDoes not seem to work. Tried a few words including; Google, Apple, Microsoft and as final test ‘Genocide’. All seemed to return just ‘neutral’. The last one should have been definitely a negative sentiment.