jasonwcfan

6 ms·

1.
Show HN: Open-source tool for building regenerative web scrapers(docs.finic.io)
2 points by jasonwcfan 2y ago|0 comments
2.
by jasonwcfan 2y ago
Yeah the ways AI models have learned to interact with the world are all hilariously skeuomorphic given their capabilities. A model that runs on silicon has to learn English and Python in order to communicate with other models that also run
3.
by jasonwcfan 2y ago
The way we plan to handle authenticated sessions is through a secret management service with the ability to ping an endpoint to check if the session is still valid, and if not, run a separate automation that re-authenticates and updates the
4.
by jasonwcfan 2y ago
Why is it unethical when courts have repeatedly affirmed browser automation to be legal and permitted? If anything, it's unethical for companies to dictate how their customers can access services they've already paid for. If I&#x2
5.
by jasonwcfan 2y ago
I mentioned this in another comment, but I know from experience that it's impossible to reliably differentiate bots from humans over a network. And since the right to automate browsers has survived repeated legal challenges, all vendor
6.
by jasonwcfan 2y ago
Thanks! Wasn't familiar with Browserless but took a quick look. It seems they're very focused on the scraping use case. We're more focused on the agent use case. One of our first customers turned us on to this - they wanted t
7.
by jasonwcfan 2y ago
Oops! We tested the Oauth flow but forgot to update the email one. Thanks for the heads up, fixing this now.
8.
by jasonwcfan 2y ago
Proxies are definitely on our roadmap, but for now it just supports stock Playwright. Thanks for the feedback! I just updated the repo to make it more clear that it's Playwright based. Once my cofounder wakes up I'll see if he can
9.
by jasonwcfan 2y ago
Yep. I used to be the guy responsible for bot detection at Robinhood so I can tell you firsthand it's impossible to reliably differentiate between humans and machines over a network. So either you accept being automated, or you overcor
10.
Show HN: Finic – Open source platform for building browser automations(github.com)
143 points by jasonwcfan 2y ago|77 comments
11.
by jasonwcfan 2y ago
A close friend of mine was an associate of Mr Beast, even living in his house in Greenville for several months. He confirmed a lot of the negative press about him in the media, and was himself ultimately screwed over by Jimmy and has been t
12.
Show HN: web2sdk – Turn any third-party API into a Python SDK(github.com)
6 points by jasonwcfan 2y ago|0 comments
13.
by jasonwcfan 2y ago
My handwriting is barely legible, even to my self. So I'll stick to Notion, thank you very much.
14.
by jasonwcfan 2y ago
Since you didn't include the link I went ahead and searched for it. Is this it? https://github.com/Storia-AI/repo2vec There's been a lot of "chat with your x" projects and the value prop always elud
15.
by jasonwcfan 2y ago
Seems like this doesn't solve the problem, it just changes the nature of the problem from a link rot to having a single point of failure. What assurances does perma cc give that it will continue to maintain its index for the foreseeabl
16.
Show HN: Finic – Apache licensed iPaaS built for Python developers(github.com)
4 points by jasonwcfan 2y ago|0 comments
17.
by jasonwcfan 3y ago
One of the open source vector DBs is probably your best bet. Chroma, weaviate, Qdrant and a few others
18.
by jasonwcfan 3y ago
From the enterprise perspective, gen AI tools are already incredibly powerful accelerators of productivity. The problem is it's unevenly distributed. Adoption at some companies is probably close to 100%, and at others maybe 1 or 2%. In
19.
by jasonwcfan 3y ago
Just ran our deployed cluster through GCP's pricing calculator and it's about $300 USD per month with Llama 2
20.
by jasonwcfan 3y ago
Yep. We use LangChain's basic text splitter to chunk the documents and the QA chain to stuff it into the prompt. But AFAIK it doesn't check for context length so that's a piece that's still missing. Upper limit depends o
21.
by jasonwcfan 3y ago
Yep the docker containers should run fine on local hardware, but the terraform config only supports GCP right now. In terms of cost - just ran our deployed cluster through GCP's pricing calculator and it's about $300 USD per month
22.
by jasonwcfan 3y ago
Not yet, but we can definitely add it. Created an issue: https://github.com/psychic-api/rag-stack/issues/2 In the meantime it uses GPT4all when running locally so you can technically deploy it as well, but it
23.
by jasonwcfan 3y ago
It uses all-MiniLM-L6-v2 from huggingface by default https://huggingface.co/sentence-transformers/all-MiniLM-L6-v... You can also specify a specific embeddings model from SentenceTransformers to use in /server&#x2
24.
by jasonwcfan 3y ago
Thanks for the callout! We'll add the local.env instructions to the readme. Are you using it with input docs or without? Locally it uses GPT4all which isn't nearly as good as Llama or Falcon. I saw a project that is docker for Lla
25.
by jasonwcfan 3y ago
You're right. Either way it's impossible to recreate Llama 2 without the data set so perhaps "free to use model" is a better description than "open source model"
26.
by jasonwcfan 3y ago
The concept of “source” is nebulous for ML models. If you have the weights you can recreate a model without access to the source code originally used to train it, and similarly just having the source code without the training data won’t all
27.
by jasonwcfan 3y ago
We have about 10 other connectors in a separate project at https://github.com/psychic-api/psychic Thanks for the feedback! We’ll include a demo soon.
28.
by jasonwcfan 3y ago
OpenAI functions solves this problem for the GPT API. It's only a matter of time before the same functionality is available for open source models
29.
How to Self-Host Llama 2 on Google Cloud Platform (GCP)(jfan001.medium.com)
7 points by jasonwcfan 3y ago|0 comments
30.
by jasonwcfan 3y ago
Looks cool! One piece of feedback: It's really tedious to have to type in JSON. Making it a form would save tons of time having to write it out manually.

More ›