5 ms·

You know counting calories by taking a picture literally doesn't work right? In fact, I'd argue it's one of the best examples of when an LLM confidently feeds y

You know counting calories by taking a picture literally doesn't work right? In fact, I'd argue it's one of the best examples of when an LLM confidently feeds you misinformation. An obvious example, a chicken breast fried in oil and a chicken breast air fried look identical, yet the oil fried one would have 3-4x the calories at least. Don't take my work for it though - this was just on HN the other day: https://news.ycombinator.com/item?id=44220135 https://news.ycombinator.com/item?id=44220135

toyetic 1y ago
What happens if you give it that context though? Or prompt it to search the web for comparable meals?
- deleted 1y ago
  [deleted]
- cogman10 1y ago
  At that point I just have to ask what the AI is actually doing for you? I can just hit a search engine and say "number of calories in X" and get a precise answer with 2 seconds of calculator math. If I have to take a picture, send it to ai, but then amend it with "This is air fried chicken, it weighs x, it's a breast cut. I didn't add salt." Why do all that when a single search will give me the answer I want without the picture upload or context?
  - paul7986 1y ago
    I agree but with smart glasses doing it for you i feel it's a whole different experience and utility.
paul7986 1y ago
Well i eat out almost always at healthy-ish chains (Cava, Panera, etc) so GPT gets the calories directly from each chains website. As for food prepared in regular restaurants I use it the same and its not precise but close same with home cooked meals per my testing the data. Overall I am a bit obsessed but not that obsessed to the point it needs to be exact on-point precise.. just give me an idea of where my calorie count stands for anytime of the day. Just be way better if it was done auto-magically and Im betting this will be a good future use that gets people excited for smart glasses one of many upcoming innovations with them.
cogman10 1y ago
I agree in principle, but I'll say that the number of calories are likely not 3-4x. The 3-4x number is for deep frying chicken. You usually don't do that if you aren't also breading the chicken. A pan-fried chicken with a little oil in the pan to avoid sticking/make better thermal contact will add calories but not 3-4x more. You're likely using about 1 tbsp of oil which is around 100 kcal. 100g of chicken has around 160 kcal. Even assuming all the oil ends up on the chicken (it isn't) that's ~2x the calories at most. Perspective wise, though, it'll by the white rice or mashed potatos that are more problematic in terms of calories. Both have a load of calories and can't be eyeballed by camera. It's all about the weight for those. And if you threw in butter/oil, even harder to know what the actual calories are.
- paul7986 1y ago
  Not if you eat out at well known healthy chains they already have their nutrition details on their sites that AI pulls from.
- busymom0 1y ago
  Even a little bit of variation in the amount of calories consumed vs detected by AI will be the difference between gaining or losing weight. Also, since fats are the most dense calorie wise (9 per gram), and also hardest to detect by AI as fats are usually transparent (oil), it's even harder to get a remotely accurate measurement of calories.
  - paul7986 1y ago
    I think most important thing is calories consumed not fats and sugars, etc as it's simple the less you consume the less weight you can take on. Having smart glasses automagically telling u how much your consuming for each meal & total caloric daily intake via audio or visually within the glasses i think would be powerful! Majority of people have no idea how much they consume and I'm betting they consume anywhere between 2000 to 6000 (heavier people) calories.
    - busymom0 1y ago

toyetic 1y ago

What happens if you give it that context though? Or prompt it to search the web for comparable meals?

deleted 1y ago
[deleted]
cogman10 1y ago
At that point I just have to ask what the AI is actually doing for you? I can just hit a search engine and say "number of calories in X" and get a precise answer with 2 seconds of calculator math. If I have to take a picture, send it to ai, but then amend it with "This is air fried chicken, it weighs x, it's a breast cut. I didn't add salt." Why do all that when a single search will give me the answer I want without the picture upload or context?
- paul7986 1y ago
  I agree but with smart glasses doing it for you i feel it's a whole different experience and utility.

paul7986 1y ago

Well i eat out almost always at healthy-ish chains (Cava, Panera, etc) so GPT gets the calories directly from each chains website. As for food prepared in regular restaurants I use it the same and its not precise but close same with home cooked meals per my testing the data. Overall I am a bit obsessed but not that obsessed to the point it needs to be exact on-point precise.. just give me an idea of where my calorie count stands for anytime of the day. Just be way better if it was done auto-magically and Im betting this will be a good future use that gets people excited for smart glasses one of many upcoming innovations with them.

cogman10 1y ago

I agree in principle, but I'll say that the number of calories are likely not 3-4x. The 3-4x number is for deep frying chicken. You usually don't do that if you aren't also breading the chicken. A pan-fried chicken with a little oil in the pan to avoid sticking/make better thermal contact will add calories but not 3-4x more. You're likely using about 1 tbsp of oil which is around 100 kcal. 100g of chicken has around 160 kcal. Even assuming all the oil ends up on the chicken (it isn't) that's ~2x the calories at most. Perspective wise, though, it'll by the white rice or mashed potatos that are more problematic in terms of calories. Both have a load of calories and can't be eyeballed by camera. It's all about the weight for those. And if you threw in butter/oil, even harder to know what the actual calories are.

paul7986 1y ago
Not if you eat out at well known healthy chains they already have their nutrition details on their sites that AI pulls from.
busymom0 1y ago
Even a little bit of variation in the amount of calories consumed vs detected by AI will be the difference between gaining or losing weight. Also, since fats are the most dense calorie wise (9 per gram), and also hardest to detect by AI as fats are usually transparent (oil), it's even harder to get a remotely accurate measurement of calories.
- paul7986 1y ago
  I think most important thing is calories consumed not fats and sugars, etc as it's simple the less you consume the less weight you can take on. Having smart glasses automagically telling u how much your consuming for each meal & total caloric daily intake via audio or visually within the glasses i think would be powerful! Majority of people have no idea how much they consume and I'm betting they consume anywhere between 2000 to 6000 (heavier people) calories.
  - busymom0 1y ago