Trusting an LLM with a decision that can potentially be fatal is a good Darwin test I suppose.
Sadly I don’t think the general populace understands that LLMs are unreliable. (And even people in tech can vastly overestimate the capabilities.. at least judging by the insane spending on them).
> ...even people in tech can vastly overestimate the capabilities...
I think people in (software) tech are currently more prone to overestimate the capabilities, because LLMs in a harness are genuinely excellent at programming. Programming is the perfect LLM task since 1. it's symbolic manipulation, 2. there is a vast corpus of high quality training data, and 3. most mistakes can be harmlessly caught at compile-time or unit-test-time. Especially point 3 makes it so that just throwing more "effort" at a problem, something the machine is endlessly willing to do, virtually guarantees an improved result.
I've often seen the "Gell-Mann Amnesia Effect" referenced with respect to LLMs. It is said that most people can tell the LLM is not great at their own subject of expertise, yet they still trust it for other subjects where they can't personally assess the quality of its answers. Imagine how bad this is when the LLM actually is great at the thing you have expertise in.
Chanterelles and false chanterelles are especially tricky. They fruit at the same time in the same areas. I have to do a 2nd pass after I have washed and dried my haul.
Ha! I just had a very interesting conversation with ChatGPT about a mushroom that I found in my front lawn. I am 99% sure it was an edible oyster mushroom which included analysis the of the size, growing substrate (dead ash tree root which turns out to be a useful identifying characteristic -- I learned a lot about mycology in a short time). Plus I don't use fertilizers, herbicide, pesticides, fungicides (obviously) on my lawn so I think it would have been quite tasty. Did I eat it? Hell, no. But then I got to thinking, would I trust a human to correctly identify it? I am actually not sure I would either. Penalty is just too great for misidentification LLM or not.
I've used Gemini quiet a bit for foraging. It's definitely a "trust, but verify" situation. It's really good at at least getting you in the right lane to verify, rather than having to comb hundreds of pictures.
So even if it's wrong, a short verification usually reveals why it was wrong. I haven't had a situation yet where it was catastrophically wrong (i.e. the mushroom it called out looks nothing like the mushroom imaged). It also will generally warn of lookalikes.
I also use it a lot for general plant ID, and it's really impressive there too, with much lower stakes (I'm not eating those).
Is it possible to reliably (>99%) identify mushrooms from a single image, with any method?
All image datasets have an intrinsic minimum error that comes from the limit of information in the data, regardless of what model or method you use to analyze it.
You might not be able to tell apart two similar-looking mushroom species just by looking.
Love this idea. We should encourage every AI enthusiast to eat wild mushrooms using their sycophantic bullshit machine to determine each one's safety. Who benefits? Society
I actually find AI-based plant and mushroom identifiers very interesting. They make being curious about such things as a beginner or layperson more accessible, and you learn some patterns.
However it's very obvious that you shouldn't rely on them to decide what to put in your body. All those apps that I have seen (I guess the responsible ones?) will warn you not to do it. That's not what it's for.
There's been a spike in cases of people eating death cap mushrooms in California this year, and I would bet almost anything that LLM adoption has something to do with it.
I never touch a mushroom I am not 100% certain is safe. So far I’ve had a 100% success rate in not poisoning myself or others. Wouldn’t recommend trusting an LLM either.
I have been using "new" Siri on iOS similarly but less dangerously. Pointing my camera at dogs at the dog park and seeing how well Siri identifies them. Pretty impressed so far. I am not eating them tho.
the interesting question is: what is the barrier we need to cross to trust LLMs with stuff like this? we'll probably cross the barrier but I'd have a hard time setting a true percentage success boundary
Sometimes the things that people say, says more about themselves than the thing they said.
If the only reason you give advice is predicated on the transactional value of that action, I think you've given up on acting ethically.
While to some extent we all are motivated by some abstract transactional value, I think immediately perceiving and reducing everything to a surivivalist, transactional mentality is an empty, cynical existence.
I guess if you had a billion dollar you could assemble an ML team and fine-tune a frontier LLM specifically for that purpose through RL, and it could work better than your local pharmacologist, but I doubt anyone would bother doing that.
So it will probably come long after airplanes actually.
Giving the impossibly high standards people here have for identifying a mushroom, it’s a wonder that they would eat a mushroom at all. You may not trust an LLM, but how would you even trust yourself? Who would you ever trust?
Why would you want to eat a random wild mushroom so badly in the first place? We're not starving, wandering through the forest for anything which might be edible. Entire regulated industries exist around selling and growing human food grade mushrooms.
Curiosity is great. Take a picture, enjoy what you find in nature. At the same time, stay safe and resist the urge to throw a random mushroom down your throat just because you might be able to. If you do reaaaaallly want to try a mushroom you can't find for consumption otherwise then it's worth the heavy amount of verification - but 99.9999% of mushrooms people eat don't run into this need.
I think the more important question is: have people really run out of interesting flavors at their local stores and restaurants, that they are so obsessed with eating things they find growing on the ground?
Taste aside, foraging in the woods--whether for mushrooms, berries or herbs--unlocks some atavistic response inside me. It feels deeply true to my nature as an animal, and is very rewarding in a way that surprised me when I first did it.
Are you this actively shitty towards all hobbies you don't also enjoy?
People have been foraging for mushrooms for literally thousands of years, but mushroom cultivation is pretty recent, and the overwhelming majority of edible species have not yet been reliably cultivated.
Are you ignorant of where those interesting flavors come from (indeed, are discovered)?
This has strong "why should we care about farms? People get everything they need from the store" vibes.
You can't really understand until you've tasted choice mushrooms, the only one of which is findable in stores is the bolete, and even that's usually dry and tells terrible quality.
I used to go in the forest and find maybe 5 types of really tasty mushrooms, come back with enough for the whole family. Add some cheese and some onions and it's Michelin star in the mountains.
It's also quite a thrill to spot a log absolutely covered in oyster or woodear mushrooms (two I feel very confident in identifying, and thankfully both were common on the 10k trail above Albuquerque)
There is a great variety of mushrooms with distinct characteristics, many of which are only found in the wild. Even the ones sold at restaurants are often sourced from foragers. It's a skill to find and identify them and for many it's an exciting hobby.
Same as fishing or hunting, or foraging blueberry or blackberries while hiking, there's some primal reward in gathering your own food (occasionally, that is).
I’ve been at a locals’ restaurant in Italy where the chef had sourced some truffles from a nearby wood. They were better than anything he could have got from a store
Sadly I don’t think the general populace understands that LLMs are unreliable. (And even people in tech can vastly overestimate the capabilities.. at least judging by the insane spending on them).
I think people in (software) tech are currently more prone to overestimate the capabilities, because LLMs in a harness are genuinely excellent at programming. Programming is the perfect LLM task since 1. it's symbolic manipulation, 2. there is a vast corpus of high quality training data, and 3. most mistakes can be harmlessly caught at compile-time or unit-test-time. Especially point 3 makes it so that just throwing more "effort" at a problem, something the machine is endlessly willing to do, virtually guarantees an improved result.
I've often seen the "Gell-Mann Amnesia Effect" referenced with respect to LLMs. It is said that most people can tell the LLM is not great at their own subject of expertise, yet they still trust it for other subjects where they can't personally assess the quality of its answers. Imagine how bad this is when the LLM actually is great at the thing you have expertise in.
https://www.mushroom-appreciation.com/wp-content/uploads/202...
There are no old bold mushroom hunters.
So even if it's wrong, a short verification usually reveals why it was wrong. I haven't had a situation yet where it was catastrophically wrong (i.e. the mushroom it called out looks nothing like the mushroom imaged). It also will generally warn of lookalikes.
I also use it a lot for general plant ID, and it's really impressive there too, with much lower stakes (I'm not eating those).
All image datasets have an intrinsic minimum error that comes from the limit of information in the data, regardless of what model or method you use to analyze it.
You might not be able to tell apart two similar-looking mushroom species just by looking.
However it's very obvious that you shouldn't rely on them to decide what to put in your body. All those apps that I have seen (I guess the responsible ones?) will warn you not to do it. That's not what it's for.
(isn't that the standard proponents use for autonomous driving?)
Or, what is needed before we are forced to give LLMs control of life or death decisions in the name of profits?
Not trusting my life to an “intelligence” that has nothing to lose.
If the only reason you give advice is predicated on the transactional value of that action, I think you've given up on acting ethically.
While to some extent we all are motivated by some abstract transactional value, I think immediately perceiving and reducing everything to a surivivalist, transactional mentality is an empty, cynical existence.
So it will probably come long after airplanes actually.
Curiosity is great. Take a picture, enjoy what you find in nature. At the same time, stay safe and resist the urge to throw a random mushroom down your throat just because you might be able to. If you do reaaaaallly want to try a mushroom you can't find for consumption otherwise then it's worth the heavy amount of verification - but 99.9999% of mushrooms people eat don't run into this need.
I’ll never understand mushroom culture.
But, I still enjoy the hunt every spring.
* Foraging is very satisfying to do
* Foraging allows you to participate in your cultural practices (although sadly many people in the US are long-cut off from such cultural knowledge)
* You can get fresher food foraging
* There absolutely are interesting varieties that aren't sold because they are hard to farm/transport/store etc.
* Foraged food is free
People have been foraging for mushrooms for literally thousands of years, but mushroom cultivation is pretty recent, and the overwhelming majority of edible species have not yet been reliably cultivated.
Are you ignorant of where those interesting flavors come from (indeed, are discovered)?
This has strong "why should we care about farms? People get everything they need from the store" vibes.
I used to go in the forest and find maybe 5 types of really tasty mushrooms, come back with enough for the whole family. Add some cheese and some onions and it's Michelin star in the mountains.