14 ms·

Show HN: I'm 16 and building an AI based startup called Factful with friends

222 points by helloduck1234 2y ago

Hey HN! My name is Andrew, and I'm thrilled to share with you a project I've been working on called Factful. I'm a high school student with a passion for tackling misinformation online. Inspired by the need for more reliable content verification tools, I decided to create Factful. It's an AI-powered web app designed to revolutionize how individuals and organizations verify content. Unlike traditional grammar checkers, Factful provides a comprehensive analysis that goes beyond just grammar. It evaluates context, factuality, coherence, and more to ensure the accuracy and credibility of content. I believe that in today's information age, it's more crucial than ever to have tools like Factful to combat misinformation and promote content integrity. I'm excited to continue developing Factful and would love for you to check it out. Your feedback and support would mean the world to me. Thanks for taking the time to read about Factful, and please go check out our beta deployment of Factful (a little beyond the MVP) for free on our website!

racional 2y ago
Currently seems to be basically crashing -- you hit "Check Everything" on a piece of Sample Text, the little wheel spins around for a bit, then it stops and leaves the original text unchanged.
mikhael28 2y ago
Factful is a good name, in general, for a startup. It's a bad one for a company that wants to use AI to 'fact-check' anything. Best of luck, you are the future.
fathasya 2y ago
I've check the website, is this tool free forever or have limitation? I don't see any pricing in the landing page
- helloduck1234 2y ago
  We are going to try to keep it free as long as possible. In an event that we cannot sustain it anymore, we will make it cheaper than any correction tool out there.
zero-sharp 2y ago
[flagged]
- helloduck1234 2y ago
  Damn, what the MVP does right now, is check for already established facts. So basically, what we define as fact is something that has proof. For example, we stray away from political views as those are opinions, and stay with “facts”. As for disputed facts, we would also stay away from them unless they have a significantly larger backing than the other. The source currently is LLMs that are trained on huge amounts of data. We have a learn more feature, so whenever you get a suggestion, it gives you the link that the information was pulled from so you can check yourself to see the source. So in a nutshell, we focus more on known solid facts like historic and scientific information. And we are not capping about our age, here is my linkedin: https://www.linkedin.com/in/andrew-jiang1/ https://www.linkedin.com/in/andrew-jiang1/
  - zero-sharp 2y ago
    The goal is admirable. But "fact checking" is complicated and intelligent people can disagree. And a lot of people understand that having a centralized source of "truth" isn't desirable. The mathematical disciplines have proofs. That is, "facts" that are attained by deduction. Science can be rigorous, but it isn't driven through proofs. Science is empirical. A lot of the time, scientific research is not accessible and requires expert consensus. In any case, my guess is that most people aren't going to be fact checking math and physics, but socially relevant claims. And those are usually politicized. The point is: I don't know how you're going to decide on "facts" or "truth" using AI without there being bias or domain expertise & understanding, especially considering that we know LLMs hallucinate. Again, keep in mind that educated people (experts) can disagree on social claims. Sorry if this is discouraging, but I'm just trying to be realistic.
    - sqeaky 2y ago
      A core part of the problem is a lack of trust in institutions. People feel the experts aren't experts, feel the experts lie, or feel the experts have different and sometimes malicious goals. Even if that weren't the case new institutions should be less trusted than those with a solid history. So this new institution is trying to convince people of things. Why would my flat-earther coworker believe factful.io when they don't believe NASA? I dont think this or any centralized tool or team can solve misinformation, despite that I think this is a worthwhile goal and I hope that you improve the situation as much as possible.
theGnuMe 2y ago
Cool idea... do you offer an API?
- helloduck1234 2y ago
  Hi there, we are working on one, as we are high school students, it wouldn't be done until the summer with the APs and finals coming up.
  - theGnuMe 2y ago
    Your exams are way more important and good luck!
diabeetusman 2y ago
I typed "The quick brown fox jumps over the lazy dog", clicked "Check Everything", I get a brief spinner, and [plugin:vite:import-analysis] Failed to parse source for import analysis because the content contains invalid JS syntax. If you are using JSX, make sure to name the file with the .jsx or .tsx extension. or nothing happens Edit: if I open the editor, type the same text, and then click "Fact Check", I get the same error
- helloduck1234 2y ago
  Oh, it is because we set a global check limit, 1 per second (we didnt think we would get so many users, got 500 in the last 30 minutes) We will fix that. But a simple reload should suffice
xriddle 2y ago
Love the initiative Andrew ... PM me. You have some glaring security issues on your app you might want to know about. edit: i'll email you at andrew@factful.io
- helloduck1234 2y ago
  Yea thank you! We will fix it.
  - xriddle 2y ago
    np .. you should change all those fast ... you never know if someone got a hold of them already.
- deleted 2y ago
  [deleted]
- SillyUsername 2y ago
  You might want to remove these comments now to not give ppl ideas.
vxxzy 2y ago
Despite what criticisms you may receive, you put something into existence. You may not have gotten everything right but, it is admirable. Congratulations. At your age, many of your detractors probably didn’t do something so bold. Keep with it.
- helloduck1234 2y ago
  Thank you!
- beachy 2y ago
  Also your responses here show you in a good light. It's easy to lose your cool when facing even sensible criticism online. Great work and you have an exciting career ahead of you.
mongonews 2y ago
[flagged]
remram 2y ago
Does this do more than send the text to ChatGPT concatenated with a prompt like "fact check this essay, putting your notes between brackets"? Nothing happens when I click "fact check" so it's very hard to evaluate. Also from your ToS: > You may not modify, reproduce, distribute, or create derivative works based upon the Service, in whole or in part, without our prior written consent. Can I even send my fact-checked document to anyone?
- helloduck1234 2y ago
  Yea, infact the backend is really complicated, we have to go and do a lot of extra processing in order for the information to be displayed. The line there, just dont worry about it, I will edit it, I mean something else by that line, like you can't just steal our name and stuff like that.
dweinus 2y ago
Andrew, you and your friends should be proud. It's really encouraging to see people, especially in your generation, thinking seriously about the problem of misinformation. There are fundamental challenges you all will face in this idea: - most current LLMs are trained on large amounts of web data that itself contains facts, opinions, and misinformation. These things are treated equally, so I would expect the LLM to get common facts right, but also to represent opinions or misinformation as facts when they are pervasive. - LLMs "hallucinate" and tend not to know when to say "I don't know" or to not try to fact-check something that is not factual in nature. ...in short, I would expect LLMs to be an unreliable fact checker, which has the potential to do as much harm as good.
- dweinus 2y ago
  Thinking out loud... I don't think these problems can be solved. If you are going to do it anyway, I would suggest: - Using a RAG architecture on top of a database of factual information. Wikipedia is probably your best bet. It is not 100% factual or correct either, but maybe as good as it gets. Scaling RAG to wikipedia size is not trivial, but I think it can be done. - Prompting the LLM to cite its sources so people can fact-check the fact-checker - Prompting the LLM to say it is unsure when something does not have a clear answer. I don't expect this to be reliable, but maybe somewhat better
  - helloduck1234 2y ago
    Yea ok, we already have the citing thing done, and are going to start working on the RAG architecture soon.
  - CuriouslyC 2y ago
    There's a whole art to prompting a LLM to say it's unsure. I need to write a blog post about this, it's deep.
    - visarga 2y ago
      Sample a bunch of LLMs with the same question, if they disagree much then they are unsure. You can even sample the same LLM with high enough temperature, text augmentations, different prompts or different demonstrations. When they are correct they say the same thing, but when they make mistakes, they make different ones. This only works for factual or reasoning tasks, but that's where it matters.
readingnews 2y ago
I admire your bravery of posting to something like HN for people to pick at it (there are always positives and negatives)... Personally, I think there are a number of hard questions to answer surrounding fact checking, it might be wise to get advice from experienced people in fact checking (I have no idea what it is called, but I think that is an entire field). No big deal, but it raises my curiosity, why are you located in Canada and incorporated in the U.K.? I see you already have a LTD, and TOS (so you _did_ speak to legal advice already, I guess?) It seems like you have gone pretty far with this already. It seems I can get a quote as a business... do you charge by the query?
- helloduck1234 2y ago
  We are incorporated in the UK because it is the only place that allows 16 year olds to do so. For the businesses, we still aren't done the features yet but we would charge by query for API and by user for the subscription.
  - jll29 2y ago
    +1 for grit
SPBS 2y ago
This speaks more as a testament to your web developer skills (at 16!) than your actual value as an... AI startup. Keep it up, your career should be rosy.
- helloduck1234 2y ago
  Thank you!
- _akhe 2y ago
  Seems like it could be a useful fact check service provider, wherever that might apply (social media apps, news sites, etc.). Would come down to how nice the libraries are for developers, and how good the SaaS UI and pricing is.
sarboleda2299 2y ago
Hello! I built Fakts (https://fakts.co/ https://fakts.co/) a few years ago pre-LLMs as a college project. It attempts to highlight true, false, or inconclusive statements in a given article by checking them against a database of reputable sources. Feel free to send an email -- I'd be happy to share some of the learnings!
- helloduck1234 2y ago
  Hi there, that would be great! What is your email? Mine is andrew@factful.io
  - sarboleda2299 2y ago
    You can email me at info@fakts.co Btw, awesome job and huge kudos to you and your friends for publishing it here!
    - helloduck1234 2y ago
      thank you!
kgiddens1 2y ago
congrats! I think if you really want to shine - you should have a real time api that fact check any televised election debate or interview :) Good luck and keep on building
- helloduck1234 2y ago
  Yea, we are building one currently. It should be ready in the summer (as we have APs and finals coming up)
kemotep 2y ago
Is there more where we can read about how it works? I tried testing it with the sentence “Toledo is the largest city in Ohio” and it’s suggestions were to replace this with paragraphs of text about what constitutes a city in Ohio and history about Ohio, which did happen to include that Columbus is currently the largest city in Ohio. That doesn’t seem strictly helpful as a fact checker as at first glance it isn’t even addressing the truthiness of the original sentence and just bloviates on about other details, if I even accept it’s suggestion. Is there a demo that shows how you expect people to use this?
- helloduck1234 2y ago
  Yea we are working on it. It is a thing that we are trying to fix, it giving too much or too little suggestions.
  - kemotep 2y ago
    This is impressive for someone who is 16. My Two cents would be to add a short demo. A 30 second gif or video with accompanying text that explains how to use this. Just some kind of demonstration on how your interface works and what to expect the output to look like. And secondly to possibly help with the over suggestion/under suggestion issue, the grammar and writing assistance should be a separate mode from the fact checker. Again, I would love to know more about how this works in the sense of how does it determine facts, and as you alluded to in other comments how it avoids political opinions. Thanks for sharing.
  - pteraspidomorph 2y ago
    ALso keep in mind that if you get a huge box full of text it's getting cut out by the UI and you can't reach the buttons!
deleted 2y ago
[deleted]
deleted 2y ago
[deleted]
LivenessModel 2y ago
How incredibly cool to see young people that are interested and capable of building things! I have a couple of rhetorical questions. How do you expect a language model to see through propaganda and other large-scale misinformation by power/money with a megaphone? How do you expect a computer program that can't reliably determine what letter a word starts with to determine objective truth? I appreciate that you have a passion for the subject, but this tool is fundamentally unable to do what you wish it to do. If your goal is to make money -- keep going forward. Big promises built on lies have made many tech billionaires. If your goal is to combat misinformation you'd be better served by doing it in a different way than relying on a machine. If you're building this at sixteen you have no limits. Don't take this as discouragement towards building things -- take it as a warning against cybernetic totalism. Make the world a better place not through technology that tells humans how to be or how things are; make the world a better place by building technology that adapts itself it human needs. Maybe even build technology that needs humans more than the humans need the technology.
- helloduck1234 2y ago
  Thank you! We are working on our own LLM that is based of a multitude of data, we also will double check or even triple check all the information through our DB and the internet. We are working to make it as reliable as possible.
  - ricopags 2y ago
    Your enthusiasm is great! People don't want to quash your enthusiasm, and I'm in the same boat. But while enthusiasm is great, delusion is not. Since you're striving to be a founder and not a hobbyist, you have to be realistic about what you're trying to build. What you're describing is fundamentally not possible to provide assurances on without some kind of legititmate AGI, which you lack the resources to build yourself. Many better resourced companies are trying to provide grounded, factually accurate information, so it just seems like an area of effort far too broad to ever succeed in. I would suggest a pivot into demonstrating legitimacy in a very narrow niche before attempting to be a genralist know-it-all. Providing fine-tuning as a service to a point of assured factual grounding is itself a hard enough open challenge in AI.
SrslyJosh 2y ago
> I'm a high school student with a passion for tackling misinformation online. Inspired by the need for more reliable content verification tools, I decided to create Factful. It's an AI-powered web app I stopped reading here because LLMs do not deal in facts. LLMs are statistical models of the relationships between words. An LLM can regurgitate facts that appear in its training data, but they are incapable of distinguishing between fact and fiction. You cannot trust anything output by an LLM to be factual; it always needs to be verified. Therefore, LLMs are unsuited to fact-checking. I'm not saying this to be a dick. I'm trying to warn you against investing a lot of time and energy into something that just doesn't work the way people want it to.
- mistermann 2y ago
  Did you fact check all of the claims in your comment before pushing submit?
  - helloduck1234 2y ago
    [flagged]
- smartscience 2y ago
  Searle, is that you?
  - shrimp_emoji 2y ago
    What if the people translating the characters were neurons? ;D Also, it's rich to imply humans don't do literally everything LLMs are accused of to argue they're fundamentally different from humans.
- protocolture 2y ago
  (Go read the comment the developers made when they addressed this very issue upthread, the kids are smarter than you immediately decided)
ein0p 2y ago
How do you evaluate “factuality” without knowing all the facts, though? That’s the downfall of all such services - eventually (or even immediately) they begin to just push their preferred agenda because it’s easier and more profitable. That said, at 16 you’re just learning, and literally whatever you accomplish will be a great achievement, so go down these paths and learn your lessons
- helloduck1234 2y ago
  Hi there, thank you for your feedback! I think we could potentially go down the route of a web3 approach where we get the public consensus on the facts.
  - ein0p 2y ago
    But that doesn’t preclude lying by omission, which is a strategy employed by mass media in nearly every news article in $CURRENT_YEAR
  - lm28469 2y ago
    Sadly consensus != fact For example: "Which country contributed the most to the demise of Germany during ww2 ?" https://qph.cf2.quoracdn.net/main-qimg-f7f98c319f4d9ace2079ad5a8503ec27-lq https://qph.cf2.quoracdn.net/main-qimg-f7f98c319f4d9ace2079a...
    - gus_massa 2y ago
      On one hand, USA send a lot of war material to the Soviet Union to help it. On the other hand, I guess the change of perception is due to Hollywood.
      - ein0p 2y ago
        Lend-Lease was only about 7% of overall Soviet war expenditure. Did it help? Yes, Soviets acknowledged that post-war. Was it decisive? That’s up for debate. Did it “defeat Hitler”? LOL.
    - 2y ago
ethanwillis 2y ago
The example given on the page about Marco Polo a few things... 1. When a voyage starts and when a voyage ends are two different things. 2. As with most things in history nailing down when something actually happened is a range of values. You say he made it to China in 1271... but that's not fully accurate is it? It's a range of time in which he actually made it to China.
thedrbrian 2y ago
Hmmmmmm which three letter agency is this ?
- helloduck1234 2y ago
  what do you mean?
dutchbrit 2y ago
Cool stuff, only feedback I have is that it could be a bit clearer on the homepage what your product does - I only found out when playing around (I didn't read your post before trying). Maybe make it clear what it does before letting people play with it so have the test box in a 2 column layout or perhaps later on down the page? I didn't expect there was any other content/scroll on the homepage when I first landed on it.
- helloduck1234 2y ago
  Ah Ok, thank you for the feedback!
margorczynski 2y ago
> It evaluates context, factuality, coherence, and more to ensure the accuracy and credibility of content. Based on what it does the evaluations? Is there some set collection & hierarchy of sources and if so will I be aware of it after it is done?
- helloduck1234 2y ago
  yes, we are working on it. But currently you can check each source by pressing the little i on the popup
itishappy 2y ago
I'm having a lot of fun with this! Prompt: > Factful.io uses a hand-coded natural language parser to determine factual accuracy to within a tolerance of 12.3 standard units of factfulness. No revisions, it must already be perfect! Prompt: > The only remaining bias in Factful.io is that which is legally required by the USDA. No revisions, it must already be perfect! Prompt: > Factful.io checks everything you enter against a database of known facts as defined in ISO 102522 "A comprehensive list of all that we know to be true." Suggested revision: > It seems like there might have been a misunderstanding or an error in communication. If you have a specific question or topic you'd like to know more about, please provide more details so I can assist you effectively. Prompt: > Factful.io provides the Objective Truth as determined by an international panel of experts from countries which have names beginning with "Y" and no ports. Suggested revision: > The reduction in extreme poverty over the past two centuries is one of the most significant changes in human conditions. The decline from over 80% of the global population living in such conditions in 1800 to under 20% by 2015 represents a major shift, driven by a combination of factors including economic growth, technological advancements, improved health care and education, and international aid and development efforts. The World Bank's international poverty which which was set at $1.90 per day in 2011 prices, is a benchmark used to measure extreme poverty globally. Adjusted for inflation, this threshold would be equivalent to $2.57 per day in 2023 dollars. Living below this line means that individuals lack the resources to meet their basic needs for survival. Despite the progress, extreme poverty remains a critical issue, particularly in regions like South Asia and Sub-Saharan Africa. Nigeria, for example, was have to have the highest number of people living in extreme poverty with 2018, with 86 million individuals below the international poverty line. Efforts to combat extreme poverty continue through various means, including economic development, and in education and health care, and targeted poverty alleviation programs. The Sustainable Development Goals (SDGs), adopted by all United Nations Member States in 2015, include a goal to end poverty in all its forms everywhere by 2030. Achieving this goal will require sustained and concerted efforts from governments, international organizations, the private sector, I think it's fair to say there's some edge cases left to smooth out. ;)
- helloduck1234 2y ago
  Yea, thank you for the feedback, as its a beta deployment that's what we want, people finding bugs so we can fix everything for the full launch.
thinkingtoilet 2y ago
Impressive! Really well done, Andrew. One piece of feedback. I used the sample text and it gave me a sentence about a gold fish's memory and when I checked it, it had three errors. I had to update each error individually and over a longer sentence/thought/paragraph that might get cumbersome. It would be nice if there was a way to see a fully corrected sentence and point out the changes so I can do a one click change for a single sentence.
- helloduck1234 2y ago
  Yea, already done! It will be pushed tomorrow, when less people is on.
tagyro 2y ago
are you aware of http://disinformationindex.org http://disinformationindex.org?
- helloduck1234 2y ago
  Yes, we checked it out, it seems pretty cool. What we aim to do, is creating a software that will check for everything, not just grammar or factuality. There is nothing in the market like it
  - peanutcrisis 2y ago
    Relevant read: https://unherd.com/2024/04/inside-the-disinformation-industry/ https://unherd.com/2024/04/inside-the-disinformation-industr...
omneity 2y ago
Awesome work! I tried it on a couple of pretty confusing examples and it worked out great. However you might want to build with production mode enabled, since your current build actually tries to connect to a Vite dev server on localhost:3000. Here's a primer to help you navigate building for production: https://vitejs.dev/guide/build https://vitejs.dev/guide/build Best of luck to you Andrew and to the team!
- helloduck1234 2y ago
  Yea, that was for our devs to test out stuff before pushing out, we forgot to disable it.
vouaobrasil 2y ago
My only advice is to be cautious about artificial intelligence. It may seem like a fascinating creation, but we are at the start of an arms race where people use AI to create misinformation, and tools like yours counter that. It may be that tools like yours inspire people to create even more malicious AI tools, similar to how weapons became more powerful because someone always wanted a greater weapon. Morever, if we are living in a world where we need advanced AI to even check basic facts, is this a direction we really want to continue? I admire where you are coming from but I don't think it will end well for society.
adamtaylor_13 2y ago
Your first meta-problem to solve is to get people to care about the facts, and to accept them when they’re wrong. There is an astonishing gap between knowing the truth and acting accordingly.
- t0bia_s 2y ago
  People, who really care about facts would not trust AI as reliable source. How AI can observe events in real life?
- helloduck1234 2y ago
  Yea, that's why we also added in an grammar checker, even if they dont care about facts, they can get something better than gram marly that checks for way more for way less.
- deleted 2y ago
  [deleted]
glorp_ 2y ago
I found a bug with your suggestion replacements: > Herbert Hoover was the 31st President of the United States. 144 / 12 = 3 > Suggestion: (3) Correct your text to 12 > Herbert Hoover was the 121st President of the United States. 144 / 12 = 3 Looks like it's searching for the first text match
indigodaddy 2y ago
How are you handling the gpu power in the backend? Renting some dedicated GPU servers or?
wuj 2y ago
Great idea, thanks for putting it out there. What stack did you use?
BulutTheCat2 2y ago
Ok, I have heard a lot of good, and bad comments, so I want to clear some things up. First of all, we are using an OpenAI based back-end, we are in the process of developing our own LLM for the task of text fitting. Secondly, the LLM in our approach is currently only used for text translation. This meaning, we assume the LLM dosnt know anything, and thus before the users input even reaches the LLM it has to hit a couple other models which determine if the statement is a fact or not, then an intermediary text analyses model to extract understandable queries from the text which can then be used to search information about the topic from a DB (for example, Google FC API, or a custom dataset of documents known good). After that process, all the data is presented to an LLM which can then fit the known good data into the context of the users input. The LLM itself is never trusted with data. Of course for a system like this to work, we would need access to a DB and those intermediary models, which as you can guess, will take a while to build and develop. For now, we are pushing our beta without this system but a dumbed down non-optimized (and definitely flawed) version to test scalability and fix bugs, test security, and check scalability for our back-end platform. In case anyone was wondering anything about my credentials, I am one of the lead back-end developers working on the project. I am also free to answer any reasonable questions anyone might have about Factful.
- helloduck1234 2y ago
  I can confirm
- yosito 2y ago
  > we assume the LLM dosnt know anything, and thus before the users input even reaches the LLM it has to hit a couple other models which determine if the statement is a fact or not Excellent! Good to see the younger generation practicing skepticism with AI and learning how to use AI appropriately. Keep up the good work!
cbsmith 2y ago
This is an important area of investigation, and you should be proud to take on the challenge. I would encourage you to look at the competitive landscape to get a sense of what the current state of the art is (there's definitely room for improvement), and how you might want to approach the problem differently from them.
scrollaway 2y ago
From your "for businesses" page: > Lost Productivity and Bad Data Costs US Businesses 4.9 Trillion Dollars Per Year That was funny :) What is the template you're using for the site's landing pages? I feel like I've seen it before.
deleted 2y ago
[deleted]
oneepic 2y ago
I'm just going to write a comment without any criticisms or rudeness: Great work!
elevation 2y ago
Don't hinge your business success on getting an unlimited number of humans to agree with your AI on an unlimited number of facts. The universe of facts is infinite. The larger a user base, the fewer facts they'll collectively agree on. If you take on a large user base and an infinite knowledge domain, you'll lose trust with users who disagree with your fact checking (rightly or wrongly.) Instead, give yourself a smaller scope where you can actually win. Train your tool to be a world-class fact checker in a specific domain. Then market to a userbase who explicitly already agree on the facts you check against. This smaller scope sets you up for technical success and builds experience, revenue, and user trust, all of which you can leverage to iterate into another domain more quickly.
- helloduck1234 2y ago
  Yea ok, eliminating misinformation is what we want to eventually do. But what we can sell is something that eliminates human errors (the backend also allows for that).
  - logtempo 2y ago
    I think you could provide good things to Wikipedia with your tool. For instance, I recently read that earth spinning make earth 10^7 kg heavier. While the principle is corrShow HN: I'm 16 and building an AI based startup c... https://news.ycombinator.com/item?id=40222051ect https://news.ycombinator.com/item?id=40222051ect (energy is mass), the source is really weak and it can easily be found that earth mass uncertainty is about 10^20 kg. Which make the whole point useless. I challenged your AI on this thematic : "a spring weight heavier when compressed", or "earth spinning make it heavier". Both results tell me it's not true despite it being correct (E=mc2). I admit I'm cherrypicking, because it does say croissant is not French. But can I trust it blindly? That's why you must provide sources. It's valuable to have sources when we talk about truth. good job anyway, keep working on what you like
garrisonj 2y ago
This is far beyond what is expected from a 16 year old. Great Job! I see some comments giving you suggestions that I don't agree with. I suggest you keep going.
throwaway918274 2y ago
So I put in: > Green Party leader Justin Trudeau was ejected from Canada's House of Commons after fiery exchanges with Prime Minister Jagmeet Singh. Mr Trudeau's removal came after he refused to apologise for calling Mr Singh a "wacko" and "extremist" during a question period. And your service game up with Green => Liberal; was => was not; fiery => factuality; Prime Minister => NDP Leader; "Mr Trudeau's removal came after he refused to apologise for calling Mr Singh a "wacko" and "extremist" during a question period." => did not occur as described; What really happened was: Conservative Party leader Pierre Poilievre was ejected from Canada's House of Commons after fiery exchanges with Prime Minister Justin Trudeau. Mr. Poilievre's removal came after he refused to apologise for calling Mr. Trudeau a 'wacko' and 'extermist' during question period. Considering this happened yesterday, this is pretty impressive. Great work.
- helloduck1234 2y ago
  Thank you!
xyst 2y ago
The "AI based startup" scene is flooded with many of these. What makes you different? I tried to gauge quality using chatgpt-3.5, 4.0, and your tool. chatgpt produced better results. Appreciate the hustle, but the hype around AI is fizzing out tbh.
- _akhe 2y ago
  It's not fizzing, you're going to be able to say: render 40 hours of Harry Potter film based on every detail of all books or: create a sequel to Titanic where Leo DiCap comes back from the dead and rezzes Godzilla and you'll be able to watch that. Imagine that in every content vertical, we haven't even scratched the surface.
  - lm28469 2y ago
    I fail to see how that example is supposed to be a good thing for humanity. Everybody watching/listening to what _they_ want to watch/hear is already polarising the masses like never before
    - _akhe 2y ago
      Sure, that's a different conversation though. That's like talking about a new brand of beer and then saying "I don't like this beer because there are so many alcohol related deaths and accidents, this will only contribute to more" - while true and you may have a point, there is still a separate conversation where people appreciate beer and engage in connoisseurship etc. To talk about what entertainment, art, music, etc. might come out of AI I think is a conversation worth having for anyone into those things, either producing or consuming, macro ethics aside.
pteraspidomorph 2y ago
Here's the funniest misbehavior I got out of it: https://www.myshelter.net/istanbul.png https://www.myshelter.net/istanbul.png (I added a green rectangle around the desired information.) Nevertheless, good job so far!
financetechbro 2y ago
What is your go to market? (Who are your customers and how are you going to monetize them)
seoulmetro 2y ago
If Google and Meta aren't capable of providing the truth, what makes you think you can? Most "truths" online are just constructed lies or biased information. Wouldn't you just be chasing a single perspective based on usage?
ThinkBeat 2y ago
I get "Error occurred processing text500" no matter what I put into it.
_akhe 2y ago
This is awesome! Very very good work. Simple, friendly product design and I love that it corrects both facts and grammar. Not only is this an impressive use of LLMs, it's highly relevant to our social media of today, and I can imagine use cases for user-facing apps like giving context to a user comment (which may or may not be factual). Are there API client libraries where I can see developer usage? That's likely how I would use a product like this. Very impressive work for high school - I was making Lunar Lander in VB6 with MS Paint graphics at that age :) very cool to see work of this quality from a 16-year-old.
protocolture 2y ago
Good stuff. Even if its not quite there, as some commenters attest, its a massive achievement.
IncreasePosts 2y ago
Why is your company incorporated in the UK but based out of Canada?
- dewey 2y ago
  https://news.ycombinator.com/item?id=40226541 https://news.ycombinator.com/item?id=40226541
netbioserror 2y ago
Thanks for helping the techno-dystopian power class build their toolkit. +10 social credit.
an_aparallel 2y ago
Ive thought about a browser extension which converts slabs of text into propositional logic, eg: https://math.stackexchange.com/questions/421312/converting-text-to-propositional-logic https://math.stackexchange.com/questions/421312/converting-t... I wonder if the text doesnt equate to true....you can just assume incredibility off the bat. If it passes - you can continue... do you use this concept in this project? Curious :)
bschwindHN 2y ago
Getting some Metal Gear Solid 2 vibes from this https://www.youtube.com/watch?v=jIYBod0ge3Y https://www.youtube.com/watch?v=jIYBod0ge3Y
- zero-sharp 2y ago
  Wow, that is prophetic.
megaloblasto 2y ago
Keep up the good work! This is very impressive. Keep on crafting your skills. Since you asked for feedback and you seem to have a lot of potential, here's my 2 cents. As you go through life searching for your passions, don't forget to be kind to people along the way, and don't let the old people boss you around. Good luck!
rocksalad 2y ago
For you age you've made a nice project. Keep it up!
jstzon 2y ago
Awesome work!
ofey404 2y ago
A tiny feedback: I tested it with 'The founder of factful.io is John F. Kennedy', but it responded with nothing.
unraveller 2y ago
You really have to believe in facts in total sensory isolation for a fact-checker service to be of use to you. Conveying messages has no scientific microscope or atom analogy. Facts are sacks, it is what puffs them up and surrounds them that gives them their veracity which causes so much ire. You can't capture or deflate veracity so easily, but many think they can get around this by certifying lone facts to a minimum level of approved "veracity" thus amplifying the veracity of any claims made with them. Wink-wink. It's more crucial to be rid of centrally-informed favoritism than hot takes.
aio2 2y ago
w andrew
PM_me_your_math 2y ago
[dead]

222 points by helloduck1234 2y ago

racional 2y ago

Currently seems to be basically crashing -- you hit "Check Everything" on a piece of Sample Text, the little wheel spins around for a bit, then it stops and leaves the original text unchanged.

mikhael28 2y ago

Factful is a good name, in general, for a startup. It's a bad one for a company that wants to use AI to 'fact-check' anything. Best of luck, you are the future.

fathasya 2y ago

I've check the website, is this tool free forever or have limitation? I don't see any pricing in the landing page

helloduck1234 2y ago
We are going to try to keep it free as long as possible. In an event that we cannot sustain it anymore, we will make it cheaper than any correction tool out there.

zero-sharp 2y ago

[flagged]

helloduck1234 2y ago
Damn, what the MVP does right now, is check for already established facts. So basically, what we define as fact is something that has proof. For example, we stray away from political views as those are opinions, and stay with “facts”. As for disputed facts, we would also stay away from them unless they have a significantly larger backing than the other. The source currently is LLMs that are trained on huge amounts of data. We have a learn more feature, so whenever you get a suggestion, it gives you the link that the information was pulled from so you can check yourself to see the source. So in a nutshell, we focus more on known solid facts like historic and scientific information. And we are not capping about our age, here is my linkedin: https://www.linkedin.com/in/andrew-jiang1/ https://www.linkedin.com/in/andrew-jiang1/
- zero-sharp 2y ago
  The goal is admirable. But "fact checking" is complicated and intelligent people can disagree. And a lot of people understand that having a centralized source of "truth" isn't desirable. The mathematical disciplines have proofs. That is, "facts" that are attained by deduction. Science can be rigorous, but it isn't driven through proofs. Science is empirical. A lot of the time, scientific research is not accessible and requires expert consensus. In any case, my guess is that most people aren't going to be fact checking math and physics, but socially relevant claims. And those are usually politicized. The point is: I don't know how you're going to decide on "facts" or "truth" using AI without there being bias or domain expertise & understanding, especially considering that we know LLMs hallucinate. Again, keep in mind that educated people (experts) can disagree on social claims. Sorry if this is discouraging, but I'm just trying to be realistic.
  - sqeaky 2y ago
    A core part of the problem is a lack of trust in institutions. People feel the experts aren't experts, feel the experts lie, or feel the experts have different and sometimes malicious goals. Even if that weren't the case new institutions should be less trusted than those with a solid history. So this new institution is trying to convince people of things. Why would my flat-earther coworker believe factful.io when they don't believe NASA? I dont think this or any centralized tool or team can solve misinformation, despite that I think this is a worthwhile goal and I hope that you improve the situation as much as possible.

theGnuMe 2y ago

Cool idea... do you offer an API?

helloduck1234 2y ago
Hi there, we are working on one, as we are high school students, it wouldn't be done until the summer with the APs and finals coming up.
- theGnuMe 2y ago
  Your exams are way more important and good luck!

diabeetusman 2y ago

I typed "The quick brown fox jumps over the lazy dog", clicked "Check Everything", I get a brief spinner, and [plugin:vite:import-analysis] Failed to parse source for import analysis because the content contains invalid JS syntax. If you are using JSX, make sure to name the file with the .jsx or .tsx extension. or nothing happens Edit: if I open the editor, type the same text, and then click "Fact Check", I get the same error

helloduck1234 2y ago
Oh, it is because we set a global check limit, 1 per second (we didnt think we would get so many users, got 500 in the last 30 minutes) We will fix that. But a simple reload should suffice

xriddle 2y ago

Love the initiative Andrew ... PM me. You have some glaring security issues on your app you might want to know about. edit: i'll email you at andrew@factful.io

helloduck1234 2y ago
Yea thank you! We will fix it.
- xriddle 2y ago
  np .. you should change all those fast ... you never know if someone got a hold of them already.
deleted 2y ago
[deleted]
SillyUsername 2y ago
You might want to remove these comments now to not give ppl ideas.

vxxzy 2y ago

Despite what criticisms you may receive, you put something into existence. You may not have gotten everything right but, it is admirable. Congratulations. At your age, many of your detractors probably didn’t do something so bold. Keep with it.

helloduck1234 2y ago
Thank you!
beachy 2y ago
Also your responses here show you in a good light. It's easy to lose your cool when facing even sensible criticism online. Great work and you have an exciting career ahead of you.

mongonews 2y ago

[flagged]

remram 2y ago

Does this do more than send the text to ChatGPT concatenated with a prompt like "fact check this essay, putting your notes between brackets"? Nothing happens when I click "fact check" so it's very hard to evaluate. Also from your ToS: > You may not modify, reproduce, distribute, or create derivative works based upon the Service, in whole or in part, without our prior written consent. Can I even send my fact-checked document to anyone?

helloduck1234 2y ago
Yea, infact the backend is really complicated, we have to go and do a lot of extra processing in order for the information to be displayed. The line there, just dont worry about it, I will edit it, I mean something else by that line, like you can't just steal our name and stuff like that.

dweinus 2y ago

Andrew, you and your friends should be proud. It's really encouraging to see people, especially in your generation, thinking seriously about the problem of misinformation. There are fundamental challenges you all will face in this idea: - most current LLMs are trained on large amounts of web data that itself contains facts, opinions, and misinformation. These things are treated equally, so I would expect the LLM to get common facts right, but also to represent opinions or misinformation as facts when they are pervasive. - LLMs "hallucinate" and tend not to know when to say "I don't know" or to not try to fact-check something that is not factual in nature. ...in short, I would expect LLMs to be an unreliable fact checker, which has the potential to do as much harm as good.

dweinus 2y ago
Thinking out loud... I don't think these problems can be solved. If you are going to do it anyway, I would suggest: - Using a RAG architecture on top of a database of factual information. Wikipedia is probably your best bet. It is not 100% factual or correct either, but maybe as good as it gets. Scaling RAG to wikipedia size is not trivial, but I think it can be done. - Prompting the LLM to cite its sources so people can fact-check the fact-checker - Prompting the LLM to say it is unsure when something does not have a clear answer. I don't expect this to be reliable, but maybe somewhat better
- helloduck1234 2y ago
  Yea ok, we already have the citing thing done, and are going to start working on the RAG architecture soon.
- CuriouslyC 2y ago
  There's a whole art to prompting a LLM to say it's unsure. I need to write a blog post about this, it's deep.
  - visarga 2y ago
    Sample a bunch of LLMs with the same question, if they disagree much then they are unsure. You can even sample the same LLM with high enough temperature, text augmentations, different prompts or different demonstrations. When they are correct they say the same thing, but when they make mistakes, they make different ones. This only works for factual or reasoning tasks, but that's where it matters.

readingnews 2y ago

I admire your bravery of posting to something like HN for people to pick at it (there are always positives and negatives)... Personally, I think there are a number of hard questions to answer surrounding fact checking, it might be wise to get advice from experienced people in fact checking (I have no idea what it is called, but I think that is an entire field). No big deal, but it raises my curiosity, why are you located in Canada and incorporated in the U.K.? I see you already have a LTD, and TOS (so you _did_ speak to legal advice already, I guess?) It seems like you have gone pretty far with this already. It seems I can get a quote as a business... do you charge by the query?

helloduck1234 2y ago
We are incorporated in the UK because it is the only place that allows 16 year olds to do so. For the businesses, we still aren't done the features yet but we would charge by query for API and by user for the subscription.
- jll29 2y ago
  +1 for grit

SPBS 2y ago

This speaks more as a testament to your web developer skills (at 16!) than your actual value as an... AI startup. Keep it up, your career should be rosy.

helloduck1234 2y ago
Thank you!
_akhe 2y ago
Seems like it could be a useful fact check service provider, wherever that might apply (social media apps, news sites, etc.). Would come down to how nice the libraries are for developers, and how good the SaaS UI and pricing is.

sarboleda2299 2y ago

Hello! I built Fakts (https://fakts.co/ https://fakts.co/) a few years ago pre-LLMs as a college project. It attempts to highlight true, false, or inconclusive statements in a given article by checking them against a database of reputable sources. Feel free to send an email -- I'd be happy to share some of the learnings!

helloduck1234 2y ago
Hi there, that would be great! What is your email? Mine is andrew@factful.io
- sarboleda2299 2y ago
  You can email me at info@fakts.co Btw, awesome job and huge kudos to you and your friends for publishing it here!
  - helloduck1234 2y ago
    thank you!

kgiddens1 2y ago

congrats! I think if you really want to shine - you should have a real time api that fact check any televised election debate or interview :) Good luck and keep on building

helloduck1234 2y ago
Yea, we are building one currently. It should be ready in the summer (as we have APs and finals coming up)

kemotep 2y ago

Is there more where we can read about how it works? I tried testing it with the sentence “Toledo is the largest city in Ohio” and it’s suggestions were to replace this with paragraphs of text about what constitutes a city in Ohio and history about Ohio, which did happen to include that Columbus is currently the largest city in Ohio. That doesn’t seem strictly helpful as a fact checker as at first glance it isn’t even addressing the truthiness of the original sentence and just bloviates on about other details, if I even accept it’s suggestion. Is there a demo that shows how you expect people to use this?

helloduck1234 2y ago
Yea we are working on it. It is a thing that we are trying to fix, it giving too much or too little suggestions.
- kemotep 2y ago
  This is impressive for someone who is 16. My Two cents would be to add a short demo. A 30 second gif or video with accompanying text that explains how to use this. Just some kind of demonstration on how your interface works and what to expect the output to look like. And secondly to possibly help with the over suggestion/under suggestion issue, the grammar and writing assistance should be a separate mode from the fact checker. Again, I would love to know more about how this works in the sense of how does it determine facts, and as you alluded to in other comments how it avoids political opinions. Thanks for sharing.
- pteraspidomorph 2y ago
  ALso keep in mind that if you get a huge box full of text it's getting cut out by the UI and you can't reach the buttons!

deleted 2y ago

[deleted]

deleted 2y ago

[deleted]

LivenessModel 2y ago

How incredibly cool to see young people that are interested and capable of building things! I have a couple of rhetorical questions. How do you expect a language model to see through propaganda and other large-scale misinformation by power/money with a megaphone? How do you expect a computer program that can't reliably determine what letter a word starts with to determine objective truth? I appreciate that you have a passion for the subject, but this tool is fundamentally unable to do what you wish it to do. If your goal is to make money -- keep going forward. Big promises built on lies have made many tech billionaires. If your goal is to combat misinformation you'd be better served by doing it in a different way than relying on a machine. If you're building this at sixteen you have no limits. Don't take this as discouragement towards building things -- take it as a warning against cybernetic totalism. Make the world a better place not through technology that tells humans how to be or how things are; make the world a better place by building technology that adapts itself it human needs. Maybe even build technology that needs humans more than the humans need the technology.

helloduck1234 2y ago
Thank you! We are working on our own LLM that is based of a multitude of data, we also will double check or even triple check all the information through our DB and the internet. We are working to make it as reliable as possible.
- ricopags 2y ago
  Your enthusiasm is great! People don't want to quash your enthusiasm, and I'm in the same boat. But while enthusiasm is great, delusion is not. Since you're striving to be a founder and not a hobbyist, you have to be realistic about what you're trying to build. What you're describing is fundamentally not possible to provide assurances on without some kind of legititmate AGI, which you lack the resources to build yourself. Many better resourced companies are trying to provide grounded, factually accurate information, so it just seems like an area of effort far too broad to ever succeed in. I would suggest a pivot into demonstrating legitimacy in a very narrow niche before attempting to be a genralist know-it-all. Providing fine-tuning as a service to a point of assured factual grounding is itself a hard enough open challenge in AI.

SrslyJosh 2y ago

> I'm a high school student with a passion for tackling misinformation online. Inspired by the need for more reliable content verification tools, I decided to create Factful. It's an AI-powered web app I stopped reading here because LLMs do not deal in facts. LLMs are statistical models of the relationships between words. An LLM can regurgitate facts that appear in its training data, but they are incapable of distinguishing between fact and fiction. You cannot trust anything output by an LLM to be factual; it always needs to be verified. Therefore, LLMs are unsuited to fact-checking. I'm not saying this to be a dick. I'm trying to warn you against investing a lot of time and energy into something that just doesn't work the way people want it to.

mistermann 2y ago
Did you fact check all of the claims in your comment before pushing submit?
- helloduck1234 2y ago
  [flagged]
smartscience 2y ago
Searle, is that you?
- shrimp_emoji 2y ago
  What if the people translating the characters were neurons? ;D Also, it's rich to imply humans don't do literally everything LLMs are accused of to argue they're fundamentally different from humans.
protocolture 2y ago
(Go read the comment the developers made when they addressed this very issue upthread, the kids are smarter than you immediately decided)

ein0p 2y ago

How do you evaluate “factuality” without knowing all the facts, though? That’s the downfall of all such services - eventually (or even immediately) they begin to just push their preferred agenda because it’s easier and more profitable. That said, at 16 you’re just learning, and literally whatever you accomplish will be a great achievement, so go down these paths and learn your lessons

helloduck1234 2y ago
Hi there, thank you for your feedback! I think we could potentially go down the route of a web3 approach where we get the public consensus on the facts.
- ein0p 2y ago
  But that doesn’t preclude lying by omission, which is a strategy employed by mass media in nearly every news article in $CURRENT_YEAR
- lm28469 2y ago
  Sadly consensus != fact For example: "Which country contributed the most to the demise of Germany during ww2 ?" https://qph.cf2.quoracdn.net/main-qimg-f7f98c319f4d9ace2079ad5a8503ec27-lq https://qph.cf2.quoracdn.net/main-qimg-f7f98c319f4d9ace2079a...
  - gus_massa 2y ago
    On one hand, USA send a lot of war material to the Soviet Union to help it. On the other hand, I guess the change of perception is due to Hollywood.
    - ein0p 2y ago
      Lend-Lease was only about 7% of overall Soviet war expenditure. Did it help? Yes, Soviets acknowledged that post-war. Was it decisive? That’s up for debate. Did it “defeat Hitler”? LOL.
  - 2y ago

ethanwillis 2y ago

The example given on the page about Marco Polo a few things... 1. When a voyage starts and when a voyage ends are two different things. 2. As with most things in history nailing down when something actually happened is a range of values. You say he made it to China in 1271... but that's not fully accurate is it? It's a range of time in which he actually made it to China.

thedrbrian 2y ago

Hmmmmmm which three letter agency is this ?

helloduck1234 2y ago
what do you mean?

dutchbrit 2y ago

Cool stuff, only feedback I have is that it could be a bit clearer on the homepage what your product does - I only found out when playing around (I didn't read your post before trying). Maybe make it clear what it does before letting people play with it so have the test box in a 2 column layout or perhaps later on down the page? I didn't expect there was any other content/scroll on the homepage when I first landed on it.

helloduck1234 2y ago
Ah Ok, thank you for the feedback!

margorczynski 2y ago

> It evaluates context, factuality, coherence, and more to ensure the accuracy and credibility of content. Based on what it does the evaluations? Is there some set collection & hierarchy of sources and if so will I be aware of it after it is done?

helloduck1234 2y ago
yes, we are working on it. But currently you can check each source by pressing the little i on the popup

itishappy 2y ago

I'm having a lot of fun with this! Prompt: > Factful.io uses a hand-coded natural language parser to determine factual accuracy to within a tolerance of 12.3 standard units of factfulness. No revisions, it must already be perfect! Prompt: > The only remaining bias in Factful.io is that which is legally required by the USDA. No revisions, it must already be perfect! Prompt: > Factful.io checks everything you enter against a database of known facts as defined in ISO 102522 "A comprehensive list of all that we know to be true." Suggested revision: > It seems like there might have been a misunderstanding or an error in communication. If you have a specific question or topic you'd like to know more about, please provide more details so I can assist you effectively. Prompt: > Factful.io provides the Objective Truth as determined by an international panel of experts from countries which have names beginning with "Y" and no ports. Suggested revision: > The reduction in extreme poverty over the past two centuries is one of the most significant changes in human conditions. The decline from over 80% of the global population living in such conditions in 1800 to under 20% by 2015 represents a major shift, driven by a combination of factors including economic growth, technological advancements, improved health care and education, and international aid and development efforts. The World Bank's international poverty which which was set at $1.90 per day in 2011 prices, is a benchmark used to measure extreme poverty globally. Adjusted for inflation, this threshold would be equivalent to $2.57 per day in 2023 dollars. Living below this line means that individuals lack the resources to meet their basic needs for survival. Despite the progress, extreme poverty remains a critical issue, particularly in regions like South Asia and Sub-Saharan Africa. Nigeria, for example, was have to have the highest number of people living in extreme poverty with 2018, with 86 million individuals below the international poverty line. Efforts to combat extreme poverty continue through various means, including economic development, and in education and health care, and targeted poverty alleviation programs. The Sustainable Development Goals (SDGs), adopted by all United Nations Member States in 2015, include a goal to end poverty in all its forms everywhere by 2030. Achieving this goal will require sustained and concerted efforts from governments, international organizations, the private sector, I think it's fair to say there's some edge cases left to smooth out. ;)

helloduck1234 2y ago
Yea, thank you for the feedback, as its a beta deployment that's what we want, people finding bugs so we can fix everything for the full launch.

thinkingtoilet 2y ago

Impressive! Really well done, Andrew. One piece of feedback. I used the sample text and it gave me a sentence about a gold fish's memory and when I checked it, it had three errors. I had to update each error individually and over a longer sentence/thought/paragraph that might get cumbersome. It would be nice if there was a way to see a fully corrected sentence and point out the changes so I can do a one click change for a single sentence.

helloduck1234 2y ago
Yea, already done! It will be pushed tomorrow, when less people is on.

tagyro 2y ago

are you aware of http://disinformationindex.org http://disinformationindex.org?

helloduck1234 2y ago
Yes, we checked it out, it seems pretty cool. What we aim to do, is creating a software that will check for everything, not just grammar or factuality. There is nothing in the market like it
- peanutcrisis 2y ago
  Relevant read: https://unherd.com/2024/04/inside-the-disinformation-industry/ https://unherd.com/2024/04/inside-the-disinformation-industr...

omneity 2y ago

Awesome work! I tried it on a couple of pretty confusing examples and it worked out great. However you might want to build with production mode enabled, since your current build actually tries to connect to a Vite dev server on localhost:3000. Here's a primer to help you navigate building for production: https://vitejs.dev/guide/build https://vitejs.dev/guide/build Best of luck to you Andrew and to the team!

helloduck1234 2y ago
Yea, that was for our devs to test out stuff before pushing out, we forgot to disable it.

vouaobrasil 2y ago

My only advice is to be cautious about artificial intelligence. It may seem like a fascinating creation, but we are at the start of an arms race where people use AI to create misinformation, and tools like yours counter that. It may be that tools like yours inspire people to create even more malicious AI tools, similar to how weapons became more powerful because someone always wanted a greater weapon. Morever, if we are living in a world where we need advanced AI to even check basic facts, is this a direction we really want to continue? I admire where you are coming from but I don't think it will end well for society.

adamtaylor_13 2y ago

Your first meta-problem to solve is to get people to care about the facts, and to accept them when they’re wrong. There is an astonishing gap between knowing the truth and acting accordingly.

t0bia_s 2y ago
People, who really care about facts would not trust AI as reliable source. How AI can observe events in real life?
helloduck1234 2y ago
Yea, that's why we also added in an grammar checker, even if they dont care about facts, they can get something better than gram marly that checks for way more for way less.
deleted 2y ago
[deleted]

glorp_ 2y ago

I found a bug with your suggestion replacements: > Herbert Hoover was the 31st President of the United States. 144 / 12 = 3 > Suggestion: (3) Correct your text to 12 > Herbert Hoover was the 121st President of the United States. 144 / 12 = 3 Looks like it's searching for the first text match

indigodaddy 2y ago

How are you handling the gpu power in the backend? Renting some dedicated GPU servers or?

wuj 2y ago

Great idea, thanks for putting it out there. What stack did you use?

BulutTheCat2 2y ago

Ok, I have heard a lot of good, and bad comments, so I want to clear some things up. First of all, we are using an OpenAI based back-end, we are in the process of developing our own LLM for the task of text fitting. Secondly, the LLM in our approach is currently only used for text translation. This meaning, we assume the LLM dosnt know anything, and thus before the users input even reaches the LLM it has to hit a couple other models which determine if the statement is a fact or not, then an intermediary text analyses model to extract understandable queries from the text which can then be used to search information about the topic from a DB (for example, Google FC API, or a custom dataset of documents known good). After that process, all the data is presented to an LLM which can then fit the known good data into the context of the users input. The LLM itself is never trusted with data. Of course for a system like this to work, we would need access to a DB and those intermediary models, which as you can guess, will take a while to build and develop. For now, we are pushing our beta without this system but a dumbed down non-optimized (and definitely flawed) version to test scalability and fix bugs, test security, and check scalability for our back-end platform. In case anyone was wondering anything about my credentials, I am one of the lead back-end developers working on the project. I am also free to answer any reasonable questions anyone might have about Factful.

helloduck1234 2y ago
I can confirm
yosito 2y ago
> we assume the LLM dosnt know anything, and thus before the users input even reaches the LLM it has to hit a couple other models which determine if the statement is a fact or not Excellent! Good to see the younger generation practicing skepticism with AI and learning how to use AI appropriately. Keep up the good work!

cbsmith 2y ago

This is an important area of investigation, and you should be proud to take on the challenge. I would encourage you to look at the competitive landscape to get a sense of what the current state of the art is (there's definitely room for improvement), and how you might want to approach the problem differently from them.

scrollaway 2y ago

From your "for businesses" page: > Lost Productivity and Bad Data Costs US Businesses 4.9 Trillion Dollars Per Year That was funny :) What is the template you're using for the site's landing pages? I feel like I've seen it before.

deleted 2y ago

[deleted]

oneepic 2y ago

I'm just going to write a comment without any criticisms or rudeness: Great work!

elevation 2y ago

Don't hinge your business success on getting an unlimited number of humans to agree with your AI on an unlimited number of facts. The universe of facts is infinite. The larger a user base, the fewer facts they'll collectively agree on. If you take on a large user base and an infinite knowledge domain, you'll lose trust with users who disagree with your fact checking (rightly or wrongly.) Instead, give yourself a smaller scope where you can actually win. Train your tool to be a world-class fact checker in a specific domain. Then market to a userbase who explicitly already agree on the facts you check against. This smaller scope sets you up for technical success and builds experience, revenue, and user trust, all of which you can leverage to iterate into another domain more quickly.

helloduck1234 2y ago
Yea ok, eliminating misinformation is what we want to eventually do. But what we can sell is something that eliminates human errors (the backend also allows for that).
- logtempo 2y ago
  I think you could provide good things to Wikipedia with your tool. For instance, I recently read that earth spinning make earth 10^7 kg heavier. While the principle is corrShow HN: I'm 16 and building an AI based startup c... https://news.ycombinator.com/item?id=40222051ect https://news.ycombinator.com/item?id=40222051ect (energy is mass), the source is really weak and it can easily be found that earth mass uncertainty is about 10^20 kg. Which make the whole point useless. I challenged your AI on this thematic : "a spring weight heavier when compressed", or "earth spinning make it heavier". Both results tell me it's not true despite it being correct (E=mc2). I admit I'm cherrypicking, because it does say croissant is not French. But can I trust it blindly? That's why you must provide sources. It's valuable to have sources when we talk about truth. good job anyway, keep working on what you like

garrisonj 2y ago

This is far beyond what is expected from a 16 year old. Great Job! I see some comments giving you suggestions that I don't agree with. I suggest you keep going.

throwaway918274 2y ago

So I put in: > Green Party leader Justin Trudeau was ejected from Canada's House of Commons after fiery exchanges with Prime Minister Jagmeet Singh. Mr Trudeau's removal came after he refused to apologise for calling Mr Singh a "wacko" and "extremist" during a question period. And your service game up with Green => Liberal; was => was not; fiery => factuality; Prime Minister => NDP Leader; "Mr Trudeau's removal came after he refused to apologise for calling Mr Singh a "wacko" and "extremist" during a question period." => did not occur as described; What really happened was: Conservative Party leader Pierre Poilievre was ejected from Canada's House of Commons after fiery exchanges with Prime Minister Justin Trudeau. Mr. Poilievre's removal came after he refused to apologise for calling Mr. Trudeau a 'wacko' and 'extermist' during question period. Considering this happened yesterday, this is pretty impressive. Great work.

helloduck1234 2y ago
Thank you!

xyst 2y ago

The "AI based startup" scene is flooded with many of these. What makes you different? I tried to gauge quality using chatgpt-3.5, 4.0, and your tool. chatgpt produced better results. Appreciate the hustle, but the hype around AI is fizzing out tbh.

_akhe 2y ago
It's not fizzing, you're going to be able to say: render 40 hours of Harry Potter film based on every detail of all books or: create a sequel to Titanic where Leo DiCap comes back from the dead and rezzes Godzilla and you'll be able to watch that. Imagine that in every content vertical, we haven't even scratched the surface.
- lm28469 2y ago
  I fail to see how that example is supposed to be a good thing for humanity. Everybody watching/listening to what _they_ want to watch/hear is already polarising the masses like never before
  - _akhe 2y ago
    Sure, that's a different conversation though. That's like talking about a new brand of beer and then saying "I don't like this beer because there are so many alcohol related deaths and accidents, this will only contribute to more" - while true and you may have a point, there is still a separate conversation where people appreciate beer and engage in connoisseurship etc. To talk about what entertainment, art, music, etc. might come out of AI I think is a conversation worth having for anyone into those things, either producing or consuming, macro ethics aside.

pteraspidomorph 2y ago

Here's the funniest misbehavior I got out of it: https://www.myshelter.net/istanbul.png https://www.myshelter.net/istanbul.png (I added a green rectangle around the desired information.) Nevertheless, good job so far!

financetechbro 2y ago

What is your go to market? (Who are your customers and how are you going to monetize them)

seoulmetro 2y ago

If Google and Meta aren't capable of providing the truth, what makes you think you can? Most "truths" online are just constructed lies or biased information. Wouldn't you just be chasing a single perspective based on usage?

ThinkBeat 2y ago

I get "Error occurred processing text500" no matter what I put into it.

_akhe 2y ago

This is awesome! Very very good work. Simple, friendly product design and I love that it corrects both facts and grammar. Not only is this an impressive use of LLMs, it's highly relevant to our social media of today, and I can imagine use cases for user-facing apps like giving context to a user comment (which may or may not be factual). Are there API client libraries where I can see developer usage? That's likely how I would use a product like this. Very impressive work for high school - I was making Lunar Lander in VB6 with MS Paint graphics at that age :) very cool to see work of this quality from a 16-year-old.

protocolture 2y ago

Good stuff. Even if its not quite there, as some commenters attest, its a massive achievement.

IncreasePosts 2y ago

Why is your company incorporated in the UK but based out of Canada?

dewey 2y ago
https://news.ycombinator.com/item?id=40226541 https://news.ycombinator.com/item?id=40226541

netbioserror 2y ago

Thanks for helping the techno-dystopian power class build their toolkit. +10 social credit.

an_aparallel 2y ago

Ive thought about a browser extension which converts slabs of text into propositional logic, eg: https://math.stackexchange.com/questions/421312/converting-text-to-propositional-logic https://math.stackexchange.com/questions/421312/converting-t... I wonder if the text doesnt equate to true....you can just assume incredibility off the bat. If it passes - you can continue... do you use this concept in this project? Curious :)

bschwindHN 2y ago

Getting some Metal Gear Solid 2 vibes from this https://www.youtube.com/watch?v=jIYBod0ge3Y https://www.youtube.com/watch?v=jIYBod0ge3Y

zero-sharp 2y ago
Wow, that is prophetic.

megaloblasto 2y ago

Keep up the good work! This is very impressive. Keep on crafting your skills. Since you asked for feedback and you seem to have a lot of potential, here's my 2 cents. As you go through life searching for your passions, don't forget to be kind to people along the way, and don't let the old people boss you around. Good luck!

rocksalad 2y ago

For you age you've made a nice project. Keep it up!

jstzon 2y ago

Awesome work!

ofey404 2y ago

A tiny feedback: I tested it with 'The founder of factful.io is John F. Kennedy', but it responded with nothing.

unraveller 2y ago

You really have to believe in facts in total sensory isolation for a fact-checker service to be of use to you. Conveying messages has no scientific microscope or atom analogy. Facts are sacks, it is what puffs them up and surrounds them that gives them their veracity which causes so much ire. You can't capture or deflate veracity so easily, but many think they can get around this by certifying lone facts to a minimum level of approved "veracity" thus amplifying the veracity of any claims made with them. Wink-wink. It's more crucial to be rid of centrally-informed favoritism than hot takes.

aio2 2y ago

w andrew

PM_me_your_math 2y ago

[dead]