3 ms·

Twitter only stores your last 3200 likes. What a bummer. I like a lot of very funny or informative stuff on twitter and the tweets often pop into my head even

by jchook 7y ago

Twitter only stores your last 3200 likes. What a bummer. I like a lot of very funny or informative stuff on twitter and the tweets often pop into my head even years later. Sometimes I wanna find that tweet (eg to share) and I can’t. I started using pinboard.in, which archives all my likes, but the search suuuucks. So, I started building my own archive tool, but the search part is still hard. I have looked into annoy, perkeep, tf-idf, Doc2Vec, and various other tools, but nothing really works as well as I had hoped. Your project definitely gave me some ideas! Thanks.

pgt 7y ago
Wow, I did not know that. This is such a no brainer paid feature for a premium Twitter plan: storage & search. I suspect they probably keep all likes, but do not expose them. Another premium service that searches your Twitter like is https://www.favourites.io/ https://www.favourites.io/, but it's too costly for me. I might pay $10 for a yearly subscription, but not 29 GBP/year, which is ~10% of my monthly rent.
- Kinrany 7y ago
  If they do keep all the data, you should be able to get it via GDPR
  - transitivebs 7y ago
    Yeah, you can access all the data of your own account, but third-party apps accessing your data via OAuth is another issue. In the case of Twitter's API, third-party apps can access all of your history if you upgrade to a paid partnership plan.
dewey 7y ago
> I started using pinboard.in, which archives all my likes, but the search suuuucks. What's also annoying is that I don't think there's a way to exclude from_twitter bookmarks in Pinboard when you search. So now that I enabled this feature a while ago everything is cluttered with tweets and Pinboard become useless for me. Something like a -from_twitter search would be helpful but there's only a "+" search right now.
abc126589 7y ago
You can access all your favorites (and tweets and DMs) by downloading your twitter archive. You can use Twitter Archive Eraser to browse the whole archive, search by keywords, regular expressions, mentions, tweet type, media etc. Twitter Archive Eraser allows you to bulk delete thousands of tweets at once also. https://martani.github.io/Twitter-Archive-Eraser/ https://martani.github.io/Twitter-Archive-Eraser/
simonw 7y ago
My https://github.com/dogsheep/twitter-to-sqlite https://github.com/dogsheep/twitter-to-sqlite tool has a solution for that: you can export your entire Twitter account as a zip, load more than 3,200 liked tweet IDs from that archive, then backfull their full inflate versions by fetching them from the API. Documentation for doing that here: https://github.com/dogsheep/twitter-to-sqlite#importing-data-from-your-twitter-archive https://github.com/dogsheep/twitter-to-sqlite#importing-data...

by jchook 7y ago

pgt 7y ago

Wow, I did not know that. This is such a no brainer paid feature for a premium Twitter plan: storage & search. I suspect they probably keep all likes, but do not expose them. Another premium service that searches your Twitter like is https://www.favourites.io/ https://www.favourites.io/, but it's too costly for me. I might pay $10 for a yearly subscription, but not 29 GBP/year, which is ~10% of my monthly rent.

Kinrany 7y ago
If they do keep all the data, you should be able to get it via GDPR
- transitivebs 7y ago
  Yeah, you can access all the data of your own account, but third-party apps accessing your data via OAuth is another issue. In the case of Twitter's API, third-party apps can access all of your history if you upgrade to a paid partnership plan.

dewey 7y ago

> I started using pinboard.in, which archives all my likes, but the search suuuucks. What's also annoying is that I don't think there's a way to exclude from_twitter bookmarks in Pinboard when you search. So now that I enabled this feature a while ago everything is cluttered with tweets and Pinboard become useless for me. Something like a -from_twitter search would be helpful but there's only a "+" search right now.

abc126589 7y ago

You can access all your favorites (and tweets and DMs) by downloading your twitter archive. You can use Twitter Archive Eraser to browse the whole archive, search by keywords, regular expressions, mentions, tweet type, media etc. Twitter Archive Eraser allows you to bulk delete thousands of tweets at once also. https://martani.github.io/Twitter-Archive-Eraser/ https://martani.github.io/Twitter-Archive-Eraser/

simonw 7y ago

My https://github.com/dogsheep/twitter-to-sqlite https://github.com/dogsheep/twitter-to-sqlite tool has a solution for that: you can export your entire Twitter account as a zip, load more than 3,200 liked tweet IDs from that archive, then backfull their full inflate versions by fetching them from the API. Documentation for doing that here: https://github.com/dogsheep/twitter-to-sqlite#importing-data-from-your-twitter-archive https://github.com/dogsheep/twitter-to-sqlite#importing-data...