pencildiver

7 ms·

31.
by pencildiver 3y ago
Sorry about it not working. We went down for a few hours. We're back live now: https://www.searchagora.com/search?query=soap
32.
by pencildiver 3y ago
Sorry about that. The Search API went down. We're back live now.
33.
by pencildiver 3y ago
We're back live now. Had to set up a new search server and quickly importing 100k products at a time. The results should be better by the minute now (as the data set increases).
34.
by pencildiver 3y ago
Sorry about that, the Search API went down. We're back live now: https://www.searchagora.com/search?query=paper&price=&type=p...
35.
by pencildiver 3y ago
Yes, we're currently down. Working as fast as possible to get our search API back live. Really sorry about that, server crashed a few hours ago.
36.
by pencildiver 3y ago
Just woke up (in Madrid currently) and seeing all the errors. Working on getting the product back live.
37.
by pencildiver 3y ago
Agreed. I'm currently saving a data field for 'product category' but this is defined by the store owner and currently not used for search. Trying to figure out the most reliable way to categorize products, to then make it ava
38.
by pencildiver 3y ago
Absolutely. I think the key is quality over quantity. Still figuring out how to automatically remove bad products but keep the hidden gems.
39.
Show HN: I scraped 200M Shopify products to build a search engine(searchagora.com)
23 points by pencildiver 3y ago|42 comments
40.
by pencildiver 3y ago
Thanks for the heads up! I spent some time trying to get the cart route to work. Doesn't seem to be supported anymore (link you sent leads to a 404 page). Tried it with every combination of Product ID, Variant ID, etc. Let me know if y
41.
by pencildiver 3y ago
Thank you! Tied the knot back in May, so both marriage and Agora are new to me. Open to advice on either.
42.
by pencildiver 3y ago
HN— Not sure if anyone will see this but I wanted to thank you all for the support. Although I haven't slept much since going live, it has been amazing getting early feedback from the community. Agora is still in MVP stage but getting
43.
by pencildiver 3y ago
Thanks! Actually a lot easier than you'd expect. Not touching anything on the front-end of the Shopify store. Every Shopify store has a public JSON file at [Base URL]/products.json with 'price' as a field. Example here:
44.
by pencildiver 3y ago
Super helpful, thank you.
45.
by pencildiver 3y ago
Agreed on the large margin of error. Working on a bot to store and convert the images to webp to improve performance. Having the bot do a check for any images that don't exist and removing those listing. Will likely also need to triang
46.
by pencildiver 3y ago
Thanks! Laughed audibly at your comment in the other thread about Mongo haha Looking into all options right now. A tradeoff between current stability, price, and performance.
47.
by pencildiver 3y ago
Can't believe I missed this. Taking a look at both repos now. The further I get into this space, the less I feel like I know. Appreciate you sharing, will reach out!
48.
by pencildiver 3y ago
Found a list on a site called "Built With". Mentioned this in another comment but I think it's meant for building sales outreach email lists. Once you have the store URL, you can get general store information at [Base URL]&#x
49.
by pencildiver 3y ago
Thanks for sharing this! If you're up for it, I'd love to talk more about your experience, especially the technical tooling. Working as fast as I can to understand the right way to approach the tech, as there are tradeoffs with pe
50.
by pencildiver 3y ago
OP here. Yup, I am in the process of starting a holding company LLC for my software products and small investments. Just went ahead and deleted 2 from the Investments page that are not launched yet but still in-development (just had landing
51.
by pencildiver 3y ago
You’re live on Agora: https://www.searchagora.com/products/invisible-calendar-6266... Thinking that we should have a page where store owners can submit their URL to be crawled.
52.
by pencildiver 3y ago
Absolutely. Currently on the search results page, you can click on the title / price area to open the product URL in a new tab. Open to any suggestions as well. So the product URL is accessible from the search results page or if you cl
53.
by pencildiver 3y ago
Will do. Thanks for the heads up!
54.
by pencildiver 3y ago
Awesome, thanks for the suggestion / link! Actually left another comment about potentially doing semantic image search to improve results so wrapping my head around it now.
55.
by pencildiver 3y ago
Not yet! Definitely something to consider as I upgrade the architecture. Would it be helpful to have API access to all products on Agora for your own app?
56.
by pencildiver 3y ago
I definitely need to watch it now.
57.
by pencildiver 3y ago
Right now, charging Shopify store owners $99 / product / month to give them a 'verified' tag and boost their product in search results. Currently not making money on affiliate fees. I wanted to first prove that people wo
58.
by pencildiver 3y ago
I've definitely noticed that already. Any advice on how to spot that? Another challenge is that there are products sold on the original site and third-party marketplaces, both of which could sell on Shopify. So need to find a way to au
59.
by pencildiver 3y ago
Just upgraded the storage and put in a few fixes so it's working a bit faster now. Working on caching some responses locally as we speak. Great idea.
60.
by pencildiver 3y ago
Amazing, glad you were able to find it. I also just learned about what a "Dala" is :)

More ›