5 ms·

Show HN: Bubbles – A minimalist visualization of what's new on Twitter

32 points by amtmz 12y ago

hackhackpad 12y ago
can you filter noun? most of the world is not really informative keyword, and having them as bubbles only add noise.
infinitebattery 12y ago
this is awesome. is this real-time?
- jat850 12y ago
  I'm guessing it must be close. One of the bubbles is "Stuart", and Stuart Scott of ESPN is trending on Twitter quite heavily today after passing of cancer.
iambot 12y ago
should probably remove stop words
- scrozier 12y ago
  and common words that aren't proper nouns
  - tabrischen 12y ago
    especially numbers that are contextless. right now one of the biggest bubbles are 1 and 2.
    - amtmz 12y ago
      I'm adding a lot of common words to the blacklist right now. Expect to see an update shortly!
moinnadeem 12y ago
Is this open source? I'd love to take a look around.
- amtmz 12y ago
  Yep! Feel free to star / look around on GitHub. http://github.com/amizra/bubbles http://github.com/amizra/bubbles
akhatri_aus 12y ago
Uses /GET every 60 seconds. [1] setInterval(grabWords, 60000);
- mytochar 12y ago
  Is this bad? It's a site to see what's currently trending on Twitter. I figured it'd update more often, actually
andrewliebchen 12y ago
Velocity can make it a little hard to track changing words. Intensity of bubble color might be a good parameter to change for this metric.
qpleple 12y ago
You could run a topic model [1] to display, say, the top 20 topics discussed on Twitter. LDA [2] is a good one. [1] http://en.wikipedia.org/wiki/Topic_model http://en.wikipedia.org/wiki/Topic_model [2] https://pypi.python.org/pypi/lda https://pypi.python.org/pypi/lda
- hnriot 12y ago
  It's more complicated than that, an LDA clusters documents into topics but it's non-trivial to determine what the topic is. You can use the head words of a tf.idf analysis but those still don't necessarily equate to topics. For what you're looking for I think you'd need ontology tagging so a bunch of tweets mentioning soccer players would give a topic word like 'soccer'. The problem then becomes the granularity to ascribe topic to, for example, should it be soccer or sports? Should it be more specific still. Then there's the non-obvious things like a plane goes down and the topic would likely be aviation, but that hardly gives any new information. Representing 20 topics on twitter is very difficult problem. Someone dies and the topic of "death" shows up, not very useful. I'm not disagreeing with you but rather saying that what you're suggesting is a very difficult problem to do in any useful and meaningful way.
whistlerbrk 12y ago
This is great and I bet there are a ton of directions the author can go from here, pausing bubble movement on hover, clicking on bubbles to see the tweets, etc. JSYK, I reloaded and a fast moving but small bubble became a much slower moving much bigger bubble.
gravity13 12y ago
Hm. I hope this comes across as constructive criticism, but I'm not sure the visualization type matches well with the data you are presenting. The movement of the bubbles doesn't seem to convey any useful information, it's just added flare. I'd get rid of it. (you might enjoy some classic books by Edward Tufte too) The placement of the bubbles seems to be completely random. You can use your space more wisely. You are trying to represent growing trends with this visualization, perhaps some sort of component should go into representing that. Maybe you can represent that in your x and y plane somehow? You're viz looks blurry on retina screens. You can fix this by setting the width attribute of your canvas element to twice what you want it to be, and adding a css style width at what you want the width to actually be. Edit: I just read the text describing what velocity actually does, nvm, I'm dumb.
- amtmz 12y ago
  Thanks for the criticism! This was my first time doing data visualization, so any feedback is really helpful. I'll definitely check out some books by Professor Tufte.
- hnriot 12y ago
  agreed, this is basically a tag cloud with the addition of movement that serves little purpose. visualizing textual summaries is not a solved problem, the word cloud was the web 2.0 attempt but I don't believe anyone has really solved the at-a-glance textual visualization problem yet.
- underwater 12y ago
  Even with the desc option it doesn't seem that great. How about using color instead? Recent topics could be brighter.
baronofcheese 12y ago
A friend and I did something related to this in a project, where we attempted to analyze a hash tag, by fetching the latest 100 tweets about that hash tag. It is very useful in trending topics. For instance searching for "Stuart" right now reveals a lot of other relevant tags and attempts to find out what the general mood is of the words used in the tweets doing a simple Sentiment Analysis using AFINN. Try it here: http://hashtagram.dk/?t=stuart#hashtags http://hashtagram.dk/?t=stuart#hashtags (might get unavailable due to many visits, and don't mind the broken Instagram images at the bottom, site needs updating due to API changes). If for some reason the site does not work, see a static version here: http://imgur.com/EQzMrUP http://imgur.com/EQzMrUP
- tabrischen 12y ago
  It might be interesting to do a separate one just on Instagram. I have no idea what half of the trending hashtags on Instagram means and a picture speaks a thousand words.
  - baronofcheese 12y ago
    The Instagram pictures were there to back up the understanding of a hashtag generally. For under the world cup, it was really easy to find out what #worldcup2014 was about. Interestingly refreshing the page for a specific page during some kind of event, such as the world cup one, or during 24 Hours of Le Mans, it is easy to follow what people say about it. In the Le Mans case it was also quite easy to follow that for instanced someone crashed their as the sentiment drastically went to the negative side, and you could back that up with pictures of the crash on Instagram. But I agree, a separate one analyzing the pictures could be valuable as well. However, Instagram pictures often don't contain much text apart from a wall of hash tags. So the text might not be super important to analyze. Anyways, picture analysis might be slightly more difficult and more resource intensive than text analysis, but very interesting as well.
- amtmz 12y ago
  Awesome project!
cultavix 12y ago
Looks really cool. Perhaps filtering out certain words would make it better? Most of the words don't really tell me what's going on. But I guess I could just look at the trending hashtags.
bsg75 12y ago
Color (as in a heatmap) would be a better indicator of rate than the velocity of the bubbles. Currently one is zipping around so fast I cannot read it.

32 points by amtmz 12y ago

hackhackpad 12y ago

can you filter noun? most of the world is not really informative keyword, and having them as bubbles only add noise.

infinitebattery 12y ago

this is awesome. is this real-time?

jat850 12y ago
I'm guessing it must be close. One of the bubbles is "Stuart", and Stuart Scott of ESPN is trending on Twitter quite heavily today after passing of cancer.

iambot 12y ago

should probably remove stop words

scrozier 12y ago
and common words that aren't proper nouns
- tabrischen 12y ago
  especially numbers that are contextless. right now one of the biggest bubbles are 1 and 2.
  - amtmz 12y ago
    I'm adding a lot of common words to the blacklist right now. Expect to see an update shortly!

moinnadeem 12y ago

Is this open source? I'd love to take a look around.

amtmz 12y ago
Yep! Feel free to star / look around on GitHub. http://github.com/amizra/bubbles http://github.com/amizra/bubbles

akhatri_aus 12y ago

Uses /GET every 60 seconds. [1] setInterval(grabWords, 60000);

mytochar 12y ago
Is this bad? It's a site to see what's currently trending on Twitter. I figured it'd update more often, actually

andrewliebchen 12y ago

Velocity can make it a little hard to track changing words. Intensity of bubble color might be a good parameter to change for this metric.

qpleple 12y ago

You could run a topic model [1] to display, say, the top 20 topics discussed on Twitter. LDA [2] is a good one. [1] http://en.wikipedia.org/wiki/Topic_model http://en.wikipedia.org/wiki/Topic_model [2] https://pypi.python.org/pypi/lda https://pypi.python.org/pypi/lda

hnriot 12y ago
It's more complicated than that, an LDA clusters documents into topics but it's non-trivial to determine what the topic is. You can use the head words of a tf.idf analysis but those still don't necessarily equate to topics. For what you're looking for I think you'd need ontology tagging so a bunch of tweets mentioning soccer players would give a topic word like 'soccer'. The problem then becomes the granularity to ascribe topic to, for example, should it be soccer or sports? Should it be more specific still. Then there's the non-obvious things like a plane goes down and the topic would likely be aviation, but that hardly gives any new information. Representing 20 topics on twitter is very difficult problem. Someone dies and the topic of "death" shows up, not very useful. I'm not disagreeing with you but rather saying that what you're suggesting is a very difficult problem to do in any useful and meaningful way.

whistlerbrk 12y ago

This is great and I bet there are a ton of directions the author can go from here, pausing bubble movement on hover, clicking on bubbles to see the tweets, etc. JSYK, I reloaded and a fast moving but small bubble became a much slower moving much bigger bubble.

gravity13 12y ago

Hm. I hope this comes across as constructive criticism, but I'm not sure the visualization type matches well with the data you are presenting. The movement of the bubbles doesn't seem to convey any useful information, it's just added flare. I'd get rid of it. (you might enjoy some classic books by Edward Tufte too) The placement of the bubbles seems to be completely random. You can use your space more wisely. You are trying to represent growing trends with this visualization, perhaps some sort of component should go into representing that. Maybe you can represent that in your x and y plane somehow? You're viz looks blurry on retina screens. You can fix this by setting the width attribute of your canvas element to twice what you want it to be, and adding a css style width at what you want the width to actually be. Edit: I just read the text describing what velocity actually does, nvm, I'm dumb.

amtmz 12y ago
Thanks for the criticism! This was my first time doing data visualization, so any feedback is really helpful. I'll definitely check out some books by Professor Tufte.
hnriot 12y ago
agreed, this is basically a tag cloud with the addition of movement that serves little purpose. visualizing textual summaries is not a solved problem, the word cloud was the web 2.0 attempt but I don't believe anyone has really solved the at-a-glance textual visualization problem yet.
underwater 12y ago
Even with the desc option it doesn't seem that great. How about using color instead? Recent topics could be brighter.

baronofcheese 12y ago

A friend and I did something related to this in a project, where we attempted to analyze a hash tag, by fetching the latest 100 tweets about that hash tag. It is very useful in trending topics. For instance searching for "Stuart" right now reveals a lot of other relevant tags and attempts to find out what the general mood is of the words used in the tweets doing a simple Sentiment Analysis using AFINN. Try it here: http://hashtagram.dk/?t=stuart#hashtags http://hashtagram.dk/?t=stuart#hashtags (might get unavailable due to many visits, and don't mind the broken Instagram images at the bottom, site needs updating due to API changes). If for some reason the site does not work, see a static version here: http://imgur.com/EQzMrUP http://imgur.com/EQzMrUP

tabrischen 12y ago
It might be interesting to do a separate one just on Instagram. I have no idea what half of the trending hashtags on Instagram means and a picture speaks a thousand words.
- baronofcheese 12y ago
  The Instagram pictures were there to back up the understanding of a hashtag generally. For under the world cup, it was really easy to find out what #worldcup2014 was about. Interestingly refreshing the page for a specific page during some kind of event, such as the world cup one, or during 24 Hours of Le Mans, it is easy to follow what people say about it. In the Le Mans case it was also quite easy to follow that for instanced someone crashed their as the sentiment drastically went to the negative side, and you could back that up with pictures of the crash on Instagram. But I agree, a separate one analyzing the pictures could be valuable as well. However, Instagram pictures often don't contain much text apart from a wall of hash tags. So the text might not be super important to analyze. Anyways, picture analysis might be slightly more difficult and more resource intensive than text analysis, but very interesting as well.
amtmz 12y ago
Awesome project!

cultavix 12y ago

Looks really cool. Perhaps filtering out certain words would make it better? Most of the words don't really tell me what's going on. But I guess I could just look at the trending hashtags.

bsg75 12y ago

Color (as in a heatmap) would be a better indicator of rate than the velocity of the bubbles. Currently one is zipping around so fast I cannot read it.