6 ms·

Show HN: Search tweets for style, not content

120 points by jacob-jackson 6y ago

hyperpape 6y ago
I used my pinned tweet (https://twitter.com/hyperpape/status/1050402656181735426 https://twitter.com/hyperpape/status/1050402656181735426) "Learning Perl6 is like being stuck in a small dark room with a bat that's flapping around wildly, and talking to the bat and slowly coming to understand what it is like to be a bat." and the results are quite good: https://same.energy/?q=Learning+Perl6+is+like+being+stuck+in+a+small+dark+room+with+a+bat+that%27s+flapping+around+wildly%2C+and+talking+to+the+bat+and+slowly+coming+to+understand+what+it+is+like+to+be+a+bat https://same.energy/?q=Learning+Perl6+is+like+being+stuck+in.... I wouldn't say they 100% have the same energy in every case, but I enjoyed reading them.
- hyperpape 6y ago
  Example of where it falls down. I took the top tweet on @danluu (https://twitter.com/danluu/status/1304093800474636288 https://twitter.com/danluu/status/1304093800474636288) "I find it interesting how often the top Google results for basic questions are wrong. For example, I googled "tire grip physics" (in an incognito window) to get an explanation of why wider tires give you better grip and the top 6 explanations are wrong or at least misleading." The results are pretty weak. They're car stuff and/or "vaguely analytical" feeling. https://same.energy/?q=I+find+it+interesting+how+often+the+top+Google+results+for+basic+questions+are+wrong.%0A%0AFor+example%2C+I+googled+%22tire+grip+physics%22+(in+an+incognito+window)+to+get+an+explanation+of+why+wider+tires+give+you+better+grip+and+the+top+6+explanations+are+wrong+or+at+least+misleading.%0A https://same.energy/?q=I+find+it+interesting+how+often+the+t...
- mellosouls 6y ago
  I would say the results in your example are terrific; they seem completely of the same style (at least the first few, I stopped reading after that).
  - dmurray 6y ago
    They're also generally funny and original! I'd take these ahead of a curated list of "20 funniest tweets about programming languages" [0] or, say, Reddit r/ProgrammerHumor all time top posts, so that's something that's difficult to achieve programmatically. [0] OK, I didn't look for a source of these, because Google has the same inadequacies with recommending funny content. If anyone would like to recommend one, I'll read it to give a fair comparison.
- searchableguy 6y ago
  Unless I am doing something wrong, searching for similar tweets to realdonaldtrump only results in his tweets. https://same.energy/?q=The+Democrats+never+even+mentioned+the+words+LAW+%26+ORDER+at+their+National+Convention.+That%27s+where+they+are+coming+from.+If+I+don%27t+win%2C+America%27s+Suburbs+will+be+OVERRUN+with+Low+Income+Projects%2C+Anarchists%2C+Agitators%2C+Looters+and%2C+of+course%2C+%22Friendly+Protesters%22 https://same.energy/?q=The+Democrats+never+even+mentioned+th.... This could be used to de-anonymize people on twitter. Edit: So I did a test for an old twitter account I don't have access to anymore. I was able to find it using my comments with few tries.
  - dmurray 6y ago
    I wonder if it sorts by popularity ahead of relevance (maybe after meeting some minimum threshold for relevance). In another post I've commented about the surprising high quality of the results. @realdonaldtrump has huge reach on Twitter, as well as a distinctive style, so maybe there is no one who posts in a similar style (TBH I'd expect most to be parody accounts) who has achieved sufficient popularity to compete.
    - boogies 6y ago
      > maybe there is no one who posts in a similar style (TBH I'd expect most to be parody accounts) who has achieved sufficient popularity to compete A couple pages down there are non-@realdonaldtrump tweets scattered here and there, always in pairs as far as I can see (https://twitter.com/majorbear70/status/1286690669826842626 https://twitter.com/majorbear70/status/1286690669826842626 & https://twitter.com/DavidWaddell5/status/1127214256636813313 https://twitter.com/DavidWaddell5/status/1127214256636813313 https://same.energy/?q=I+heard+Bill+Clinton+might+be+joining+Creepy%2FSleepy+Joe+Biden+on+the+Campaign+Trail.+It+will+be+called+our+%22Fondling+Father%27s.%22 https://same.energy/?q=I+heard+Bill+Clinton+might+be+joining..., and https://twitter.com/RealWayneRoot/status/1161435864506884096 https://twitter.com/RealWayneRoot/status/1161435864506884096 & https://twitter.com/Mcphie00/status/1163080988085358592 https://twitter.com/Mcphie00/status/1163080988085358592, Control-F to search), except scattered individual tweets from @RealDonaldTrFan
  - 6y ago
- glial 6y ago
  Style aside, these results are way way better quality than the typical curated Twitter feed. > BlueSpaceCanaryTwitter "malloc" comes from the Latin "mal", meaning "bad" or "evil", and the abbreviation "LOC", meaning "lines of code.”
gotostatement 6y ago
nice work!
swlkr 6y ago
this is impressive, how does it work?
- pedro1976 6y ago
  In elasticsearch there is a more-like-tis query [0], that returns similar documents for a fulltext, next to a couple of optimizations that they might use. [0] https://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl-mlt-query.html https://www.elastic.co/guide/en/elasticsearch/reference/curr...
- keenmaster 6y ago
  I assume it uses AI/ML stylometry.
notRobot 6y ago
Really cool! It'd help with the context of the tweet if the date on which it was posted was included too.
FnControlOption 6y ago
@billwurtz: > richard simmons is plural. it's actually 2 guys, they are twins, each one is named richard simmon @YABOYEZRAFITZ: > can i send text messages using my typewriter? it doesn't give me any instructions in the owners manual https://same.energy/?q=twitter.com%2Fbillwurtz https://same.energy/?q=twitter.com%2Fbillwurtz
kristopolous 6y ago
these results are not terrible. relevant long tail results are hard. well done.
jfax 6y ago
Immediately started punching in dril classics and am thoroughly impressed with the results. Well done.
- nwsm 6y ago
  Lol I did the exact same thing. I'm also impressed with the results, although I'm also getting a lot of other dril tweets back. Don't know if I should attribute that to OP, a flaw in the app, or to dril's consistency. I'll choose to believe it's the last one.
gojomo 6y ago
Interesting! As the creator, can you say anything about the algorithm(s) used to determine similarity?
Razengan 6y ago
There was a Show HN called “Twitch Roulette – Find and chat with streamers who are streaming alone” [0] As the number of users grows on every social platform, it becomes harder for new users to get noticed. I wish every service had a feature to filter for only new contributors. [0] https://news.ycombinator.com/item?id=23114103 https://news.ycombinator.com/item?id=23114103
gitgud 6y ago
> Searched 15,541,670 tweets in 0.35s Isn't there millions of tweets posted everyday? This must be a minuscule fraction of all tweets.... Anyway, great project, had a lot of funny tweets
aurenh 6y ago
played around with this. well done!

120 points by jacob-jackson 6y ago

I used my pinned tweet (https://twitter.com/hyperpape/status/1050402656181735426 https://twitter.com/hyperpape/status/1050402656181735426) "Learning Perl6 is like being stuck in a small dark room with a bat that's flapping around wildly, and talking to the bat and slowly coming to understand what it is like to be a bat." and the results are quite good: https://same.energy/?q=Learning+Perl6+is+like+being+stuck+in+a+small+dark+room+with+a+bat+that%27s+flapping+around+wildly%2C+and+talking+to+the+bat+and+slowly+coming+to+understand+what+it+is+like+to+be+a+bat https://same.energy/?q=Learning+Perl6+is+like+being+stuck+in.... I wouldn't say they 100% have the same energy in every case, but I enjoyed reading them.

hyperpape 6y ago
Example of where it falls down. I took the top tweet on @danluu (https://twitter.com/danluu/status/1304093800474636288 https://twitter.com/danluu/status/1304093800474636288) "I find it interesting how often the top Google results for basic questions are wrong. For example, I googled "tire grip physics" (in an incognito window) to get an explanation of why wider tires give you better grip and the top 6 explanations are wrong or at least misleading." The results are pretty weak. They're car stuff and/or "vaguely analytical" feeling. https://same.energy/?q=I+find+it+interesting+how+often+the+top+Google+results+for+basic+questions+are+wrong.%0A%0AFor+example%2C+I+googled+%22tire+grip+physics%22+(in+an+incognito+window)+to+get+an+explanation+of+why+wider+tires+give+you+better+grip+and+the+top+6+explanations+are+wrong+or+at+least+misleading.%0A https://same.energy/?q=I+find+it+interesting+how+often+the+t...
mellosouls 6y ago
I would say the results in your example are terrific; they seem completely of the same style (at least the first few, I stopped reading after that).
- dmurray 6y ago
  They're also generally funny and original! I'd take these ahead of a curated list of "20 funniest tweets about programming languages" [0] or, say, Reddit r/ProgrammerHumor all time top posts, so that's something that's difficult to achieve programmatically. [0] OK, I didn't look for a source of these, because Google has the same inadequacies with recommending funny content. If anyone would like to recommend one, I'll read it to give a fair comparison.
searchableguy 6y ago
Unless I am doing something wrong, searching for similar tweets to realdonaldtrump only results in his tweets. https://same.energy/?q=The+Democrats+never+even+mentioned+the+words+LAW+%26+ORDER+at+their+National+Convention.+That%27s+where+they+are+coming+from.+If+I+don%27t+win%2C+America%27s+Suburbs+will+be+OVERRUN+with+Low+Income+Projects%2C+Anarchists%2C+Agitators%2C+Looters+and%2C+of+course%2C+%22Friendly+Protesters%22 https://same.energy/?q=The+Democrats+never+even+mentioned+th.... This could be used to de-anonymize people on twitter. Edit: So I did a test for an old twitter account I don't have access to anymore. I was able to find it using my comments with few tries.
- dmurray 6y ago
  I wonder if it sorts by popularity ahead of relevance (maybe after meeting some minimum threshold for relevance). In another post I've commented about the surprising high quality of the results. @realdonaldtrump has huge reach on Twitter, as well as a distinctive style, so maybe there is no one who posts in a similar style (TBH I'd expect most to be parody accounts) who has achieved sufficient popularity to compete.
  - boogies 6y ago
    > maybe there is no one who posts in a similar style (TBH I'd expect most to be parody accounts) who has achieved sufficient popularity to compete A couple pages down there are non-@realdonaldtrump tweets scattered here and there, always in pairs as far as I can see (https://twitter.com/majorbear70/status/1286690669826842626 https://twitter.com/majorbear70/status/1286690669826842626 & https://twitter.com/DavidWaddell5/status/1127214256636813313 https://twitter.com/DavidWaddell5/status/1127214256636813313 https://same.energy/?q=I+heard+Bill+Clinton+might+be+joining+Creepy%2FSleepy+Joe+Biden+on+the+Campaign+Trail.+It+will+be+called+our+%22Fondling+Father%27s.%22 https://same.energy/?q=I+heard+Bill+Clinton+might+be+joining..., and https://twitter.com/RealWayneRoot/status/1161435864506884096 https://twitter.com/RealWayneRoot/status/1161435864506884096 & https://twitter.com/Mcphie00/status/1163080988085358592 https://twitter.com/Mcphie00/status/1163080988085358592, Control-F to search), except scattered individual tweets from @RealDonaldTrFan
- 6y ago
glial 6y ago
Style aside, these results are way way better quality than the typical curated Twitter feed. > BlueSpaceCanaryTwitter "malloc" comes from the Latin "mal", meaning "bad" or "evil", and the abbreviation "LOC", meaning "lines of code.”

gotostatement 6y ago

nice work!

swlkr 6y ago

this is impressive, how does it work?

pedro1976 6y ago
In elasticsearch there is a more-like-tis query [0], that returns similar documents for a fulltext, next to a couple of optimizations that they might use. [0] https://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl-mlt-query.html https://www.elastic.co/guide/en/elasticsearch/reference/curr...
keenmaster 6y ago
I assume it uses AI/ML stylometry.

notRobot 6y ago

Really cool! It'd help with the context of the tweet if the date on which it was posted was included too.

FnControlOption 6y ago

@billwurtz: > richard simmons is plural. it's actually 2 guys, they are twins, each one is named richard simmon @YABOYEZRAFITZ: > can i send text messages using my typewriter? it doesn't give me any instructions in the owners manual https://same.energy/?q=twitter.com%2Fbillwurtz https://same.energy/?q=twitter.com%2Fbillwurtz

kristopolous 6y ago

these results are not terrible. relevant long tail results are hard. well done.

jfax 6y ago

Immediately started punching in dril classics and am thoroughly impressed with the results. Well done.

nwsm 6y ago
Lol I did the exact same thing. I'm also impressed with the results, although I'm also getting a lot of other dril tweets back. Don't know if I should attribute that to OP, a flaw in the app, or to dril's consistency. I'll choose to believe it's the last one.

gojomo 6y ago

Interesting! As the creator, can you say anything about the algorithm(s) used to determine similarity?

Razengan 6y ago

There was a Show HN called “Twitch Roulette – Find and chat with streamers who are streaming alone” [0] As the number of users grows on every social platform, it becomes harder for new users to get noticed. I wish every service had a feature to filter for only new contributors. [0] https://news.ycombinator.com/item?id=23114103 https://news.ycombinator.com/item?id=23114103

gitgud 6y ago

> Searched 15,541,670 tweets in 0.35s Isn't there millions of tweets posted everyday? This must be a minuscule fraction of all tweets.... Anyway, great project, had a lot of funny tweets

aurenh 6y ago

played around with this. well done!