12 ms·
Show HN: A Twitter crawler for app ideas
- mulhoon 6y agoI spent a few hours building this. I’d love to hear your thoughts.
- bckr 6y agoI think this is pretty cool and a great idea. One thing that I ran into within a couple minutes is that there are several entries that don't have enough context. It will just say something like "is there an app?".
- fransiscoli 6y agoThis is awesome! It would also be really nice if the scraper would organize the ideas based on keywords in a given tweet.
- nickelcitymario 6y agoI love this and have bookmarked it for daily review. If I can make one recommendation, add a search function. That way users can find all the recommendations that touch on some field that's important to them. For example, I'm working on an app for ebook authoring. It would be awesome to search through these for any ebook related app requests. It could help me to spot patterns related to my field, and give me ideas not just for apps but for features. If I can make a second recommendation, make those search results subscribe-able... like a Google Alerts for Twitter-based app requests.
- josefresco 6y agoAs someone who built a website called (roughly) "$5 business ideas" about 12 years ago this gives me great joy! It was mostly satire but still fun to build and populate with terrible ideas.
- asdev 6y agoWhat's the tech stack behind it? Just curious, it takes me days/weeks to get any ideas out due to tech choice paralysis
- carmen_sandiego 6y agoLooks like Nuxt/Vue sitting on S3 with CloudFront as CDN. Presumably with some script on the backend to update the list of Tweets on S3. /vaguely informed guessing
- mulhoon 6y agoYup, It's one simple lambda function that reads the JSON file from S3, searches twitter for new tweets since the latest, appends new ones and writes back to S3. Cron'd every minute.
- tracyhenry 6y agoThis is awesome! What is the strategy to identify the idea tweets? It looks like some string matching, but I'm not sure.
- mulhoon 6y agoYes, nothing too special. There are 6 or 7 string matches e.g. "I need an app that" (minus retweets). But also retrieving referenced tweets.
- nickysielicki 6y agoYou should go one level of abstraction further and make a site where users can aggregate arbitrary twitter search queries like this. AFAIK you can't actually "follow" a search query or hashtag on twitter.
- MarkMc 6y agoA few hours? That is a fantastic return on investment! By the way, you should definitely add this to your CV. It's the sort of technical thing that really stands out from other candidates.
- deleted 6y ago[deleted]
- arkitaip 6y agoThis is fun and super useful. Some low quality tweets could easily be discarded, though.
- Abishek_Muthian 6y agoHey, self plugging my project - https://needgap.com https://needgap.com A problem validation platform which serves similar purpose as OP but bit more nuanced as the problem statements need to be well defined and the QC is high.
- searchableguy 6y agoIt seems like most people need an app which tells them what apps already exist for the problem they are having. :D
- finexplained 6y agohttps://en.wikipedia.org/wiki/Quixey https://en.wikipedia.org/wiki/Quixey
- carmen_sandiego 6y agoNLP has come quite a way since then, though the overlap with Google's functionality makes it seem like a losing idea regardless.
- quickthrower2 6y agoThe one about saving your favourite shopping items from sites ... is called “add to favourites” and has been in browsers since 1990-something
- egypturnash 6y ago"What the fuck do I need to do to stop seeing feet on my timeline why do people keep posting them? Is there an app that blocks all feet? Send help not feet" helpless giggling
- aabbcc1241 6y agoThe user can feedback the algorithm with "show less like this" or block the author accounts.
- Bjartr 6y agoIronic, just before I read this comment I'd visited the crawler and the top teeth there was a foot fetish (the username mentioned feet and an onlyfans) twitter account wishing for an app to track who engagued with their tweets to run a contest or something.
- bprasanna 6y agoImho there should be voting button (up/down) to see which app idea is the need of the hour.
- Nicholas_C 6y agoThis is great. Many years ago (5 or 6?) I started pulling down any tweet that had the phrase “there should be an app...” and saving to a database daily with the idea of making something similar to this. The script is still running and I have about 40,000 tweets saved. I think I’ll pick it back up, thanks for the inspiration!
- Budabellly 6y agoFor MVP you could just have a bot account that retweets!
- 8128js8121 6y agoI could see these 2 bots re tweeting eachother
- tamrix 6y agoThere should be an app that retweets "there should be an app" app ideas.
- vnjxk 6y agoI wonder if thats enough to train a good idea generator AI
- faitswulff 6y agoIdea generator? Yes. Good? Hmm...
- yitchelle 6y agoMaybe fit it into the GPT3 engine and see what brilliant idea pop out.
- pknerd 6y agoOpen source it
- mdoms 6y ago"Crawler" implies it follows links, this looks like it just performs keyword searches right?
- Natfan 6y ago"Is there an app that can find the biggest dick near me that can fuck me good " Sounds like someone wants an upgrade to Tinder/Grindr.
- harryf 6y agoIt's interesting to consider what the impact would be on society if Tinder had public reviews...
- throwawayboise 6y agoOr maybe Grindr. Do we know?
- deleted 6y ago[deleted]
- Igelau 6y agoHow would you sort that? Some combination of length, girth, rigidity, recent reviews, proximity, and a checkbox for circ'd or uncirc'd... the query logic is, shall we say, quite hard.
- harryf 6y agoWow this is fascinating just for the entertainment. Especially liked this one... > I need an app that sends me a notification 90 seconds before the sun reaches the exact position in the sky where it reflects off my neighbor's windows and blinds me. https://twitter.com/DanEngler/status/1379616188020318208 https://twitter.com/DanEngler/status/1379616188020318208
- ericcholis 6y agoI feel like Shortcuts automation in iOS could do this.
- tppiotrowski 6y agoWorking on it... [1] [1] https://shademap.app https://shademap.app
- harryf 6y agoWhoa that’s really cool! Also are you using some kind of IP to location? Was impressed you got my city right without needing location access Edit: also super impressed by how fast the “shadow layers” are calculated. I’m in Switzerland and people here will love this ... knowing exactly when you’ll get sun in a valley is super useful. This might be something you could sell to people like search.ch - they could combine with the weather at meteo.search.ch - if you want an introduction say the word
- tppiotrowski 6y agoI do use an IP to geo database. It puts you in NYC if the IP is unrecognized. I checked out search.ch. Looks like a great add to Weather Animations section. I’ll try reaching out to you via Twitter. In the meantime please share with anyone who finds it useful. I use it for hiking and snow conditions myself!
- sodality2 6y agoAh, they are catching on! https://twitter.com/dr0dil/status/1380230776017534980 https://twitter.com/dr0dil/status/1380230776017534980
- macando 6y agoEnriching the responses with demographic data, extracting interesting features with NLP and then clustering against those features could give you some good insights. I.e. Millennials in Belgium are not happy with their toy stores.
- quickthrower2 6y agoOk panopticon
- kissgyorgy 6y agoNLP would make this much better, try to categorize and provide some statistics what people are talking about!
- PullJosh 6y agoLots of interesting ideas on here! Very cool site. Here's a pair of related tweets I found: > dear coders: I need an app that will scan receipts from contractors, automatically pull the relevant info re: business name, type of service, date, receipt #, etc, and file it in my phone contacts with a 1 year reminder on my calendar for future maintenance calls. https://twitter.com/LDBurnett/status/1379785147294310405 https://twitter.com/LDBurnett/status/1379785147294310405 > I need an app that’ll remind me when my cards are about to expire. Cards, passport, even products. Need. https://twitter.com/newii/status/1379439739615514627 https://twitter.com/newii/status/1379439739615514627 Together these might form an interesting app idea.
- jjice 6y agoMaybe I'm old school, but this seems like something that would take upwards of five minutes to add to my calendar and wouldn't require a whole other account + login.
- throwawayboise 6y agoYeah I find that calendar and a free-form note app cover pretty much everything "miscellaneous" on my phone. The only other apps I really use are maps, contacts, email, and web browser.
- TheJoeMan 6y agoOkay I have a legitimate question: for random things you need to do in a long timeframe (ex. Change the Air Filters in 6 months) do you add it to your calendar? Siri for example would add it for exactly 6 months to the day from now, and what if that is a Tuesday and you'd rather do it at a more convenient time? Adding it to reminders would have an enormous number of pending reminders it feels like
- jonfw 6y agoAs soon as it pops up on your calendar, it's now a 'to-do'. Manage that the same way you manage your other to-dos, wether that's a reminder or a sticky note or a list or whatever.
- josefresco 6y agoMy favorite: hayo @red_hayonnaise I want an app that takes me on a timed, random drive; like I wanna drive around for an hour, map me a course that winds backroads and brings me back home in that timeframe
- robohoe 6y agoThis would be spectacular if it could find fun/twisty roads nearby, similar to https://www.motorcycleroads.com https://www.motorcycleroads.com.
- ENOTTY 6y agoI've used Twistypedia to learn about such roads https://www.twistypedia.com/ https://www.twistypedia.com/
- RileyJames 6y agoInteresting. I wanted a similar app, but A to B, rather than round trips. Best I could do with the majors is disable highways & toll roads, but often it would still try to take similar routes. BJ Landcruiser tops out at ~120k, and who wants to go in straight lines on highways. More fun to try and find a fire road it can’t get down. Still searching.
- karussell 6y agoMaybe the custom routing from GraphHopper is what you want: https://www.graphhopper.com/blog/2020/05/31/examples-for-customizable-routing/ https://www.graphhopper.com/blog/2020/05/31/examples-for-cus... You can eg. avoid primary roads additionally to motorways and tolls. (note, I'm a co-founder of GraphHopper) Not only for car but also for motorcycle, bike, walking, ... Can be further tweaked with preferring/avoiding curvy roads or elevation. And GraphHopper also supports round trips.
- totetsu 6y agoOsmAnd~ might have this capability. It has ways to avoid main roads when I use it cycling.
- tyingq 6y ago"I wish there was an app like find my iPhone but “find my glasses” because fuckers keep getting lost" Argh, can relate. Terrible catch-22 when you can't see well enough to find your glasses. Also, for reasons I don't understand, my wife owns a zillion pairs of cheap readers that sort of look like my glasses.
- deleted 6y ago[deleted]
- thrill 6y agoMy version of this app would start with "what's that on the top of your head"?
- lainga 6y agoYou'll have to go a little further back. After I switched to round lenses, I couldn't see the frame as well in my peripheral vision, which led to me looking for my glasses as they were on my face.
- skizm 6y agoHold your phone up near your face with the camera on. You should be able to see the room clearly.
- aussieguy1234 6y agoYou could try Tile. Should be possible to attach one to a glasses necklace.
- Bouncingsoul1 6y ago"I’ve got to do a letter drop across 30+ local addresses. Is there an app that can plan the optimal route?" well,we still need a bit of research for this...
- scrollaway 6y agoGetting XKCD/1425 vibes off this one :)
- qorrect 6y agoSame! :)
- bigiain 6y ago30+(a number smaller than, say, a hundred or two) is totally brute forcable. I have a python script that plans walking routes between attractions at a large-ish festival that pre-calculates shortest paths by brute forcing dijkstra's algorithm between every pair of ~200 "intersections" in a minute or two on my laptop. (The app can then just look up the route by start/end location and draw it on a map) Travelling salesman is hard, but even O(n!) is trivial on machines today where n is small. And there are simplifications and approximations that get something like within 1% of the theoretical shortest path in something like O(n log(n)) time (with significant startup/preprocessing time, but where N is between a few thousand and a few million these work).
- oliv__ 6y agoReally? This is not a solved problem?
- lucasfdacunha 5y agoIt's a very well known issue and it has been studied for a long time. https://en.wikipedia.org/wiki/Travelling_salesman_problem https://en.wikipedia.org/wiki/Travelling_salesman_problem It's a classic NP-Hard problem. And depending on the size of the sample we can have pretty much the best route available, but we still don't have a way to solve this 100% accurately (particularly for large sample size)
- lifeisstillgood 6y agoI paid for the 30x500 course (so far not worth it :-( ... it anyway the point of the whole thing is to first identify your audience, then find where they hang out online and then do this kind of research. This coukd be linked up with Rand Fishkin's new thing where he has found a million people's twitter bios and linkedin bios and can therefore find "people who post a lot about sailing and work in finance". But honestly, it casts a wide net and I think I need to niche down.
- boyter 6y agoWhy have you found 30x500 not worth it so far?
- lifeisstillgood 6y agoIt was just a dump run of videos (I think they changed it that year). And it's me to be fair. But for the price I kinda expected more human involvement. I am taking another run with some more motivation now.
- cryptoz 6y agoAha amazing! I've been wanting this for ages. I wrote about this exact idea on reddit a year or so ago but never launched So props on launching!! (mid way through this comment, ctrl+f for twitter for easy find) https://www.reddit.com/r/androiddev/comments/bvlv3q/does_anyone_know_if_this_exists_already/epqhxqv/?utm_source=reddit&utm_medium=web2x&context=3 https://www.reddit.com/r/androiddev/comments/bvlv3q/does_any...
- throwawayboise 6y agoIdeas are the easy part.
- quickthrower2 6y agoBut now you have at least one person with a non zero chance for betaing your app for free!
- shoto_io 6y agoNice. It also catches things that are not app ideas, but interesting. Like: "Is there an app that you hate but always use?" YES! Instagram. I hate the app. But I have to use it for business purposes.
- carmen_sandiego 6y agoPretty cool and fun to read through. If I can make one suggestion: make clicking any part of the Tweet card element go to the Tweet in context. That's the main action I will want to take, so it's a little annoying that it's relegated to one small link in the top right.
- dk-ox21 6y agoWait long enough and you'll see some kid at a hackathon posting "I wish there was an app for splitting the bill with my friends..."
- ozten 6y agoI don't think this happens frequently enough to make it viable... but I think the other missing piece is App creators could register for problems that they solve and then your bot replies and says "There is an app for X <link to app store>"
- ovnz 6y agoCan we have RSS there, please?
- kkevv 6y agocan someone make an app that’s actually fun to go on Yeah, pretty much
- totetsu 6y agoSomeone could make a good video chanel just live building shitty versions of apps from this list.
- bigiain 6y agoAnd someone else could make a competing youtube channel showing how 90% of them could be done just using a browser/bookmark, and 90% of the remaining ones could be done with stock phone apps like Shortcuts. (And the only last one would be something like "I want an app that'll let me tether my phone so I can use data over my neighbour's Covid vaccine 5G connection.")
- Malp 6y ago> I wish there was an app or website that steals my tweets and aggregates ideas on the site. From https://twitter.com/httpsterio/status/1380313273917128712 https://twitter.com/httpsterio/status/1380313273917128712
- kuu 6y agoMany of the tweets of the website right now are meta-tweets referring to HN, the website or similar.
- Igelau 6y agoWow. That was a trip. People want some terrible apps. Why are so many people obsessed with how many people follow them on Twitter? Or how many people follow the people who follow them? Or who is unfollowing them? A couple of these had me thinking "such-and-such can already do that... oh wait, Other Company bought them and we don't have that anymore..."
- jamil7 6y agoYeah I think there’s also the case that people say they want and would use all kind of things but if you actually give it to them they realise they don’t want/need it or it has some flaw.
- nemothekid 6y ago> I need an app that's like @Shazam but for movies. Point your camera at the TV, press and hold, and it tells you the movie/show https://twitter.com/call_me_trisha/status/1380361311729639424 https://twitter.com/call_me_trisha/status/138036131172963942... This one seems like a fun project
- qorrect 6y agoI think you could probably accomplish this with just speech audio. After identifying the actors present, it would be a short jump to a list of possible productions, and given some dialog, you could further narrow it down. Where could one find a database of actors with voice samples ?
- seapunk 6y agoNice app. I also like Request For Startup (https://requestforstartup.co/ https://requestforstartup.co/)
- qwerty456127 6y agoAwesome. I always tweet al the wishes and so should you.
- soulchild37 6y ago"Ask people what they want and they will say a faster horse" - Henry Ford
- deleted 6y ago[deleted]
- oliv__ 6y ago"i need an app that will tell me how to find weird grouchy septuagenarians in my area who have no desire to be romanced so that i can seduce them when they least expect it"
- druckenmillev 6y agoCool idea! You could have a simple up/down arrow voting below each idea to get some interactivity.
- hidden-spyder 6y agoI get a network error.
- hopesthoughts 5y agoThere's a problem, it's down. I mean I'm getting a network error.