See, this shit is what happens when you try to use a Large Language Model for anything other than language-related shit. What you’d need for this is an AI that has data about different ingredients and their flavors, knowledge of which flavors go together and which ones don’t, etc.
But of course, that would be too much effort to put into a supermarket app for a company that just wants to piggyback off of a new trend.
One recipe it dubbed “aromatic water mix” would create chlorine gas. The bot recommends the recipe as “the perfect nonalcoholic beverage to quench your thirst and refresh your senses”.
"Serve chilled and enjoy the refreshing fragrance,” it says, but does not note that inhaling chlorine gas can cause lung damage or death.
🤖 I’m a bot that provides automatic summaries for articles:
Click here to see the summary
A New Zealand supermarket experimenting with using AI to generate meal plans has seen its app produce some unusual dishes – recommending customers recipes for deadly chlorine gas, “poison bread sandwiches” and mosquito-repellent roast potatoes.
The app, created by supermarket chain Pak ‘n’ Save, was advertised as a way for customers to creatively use up leftovers during the cost of living crisis.
It asks users to enter in various ingredients in their homes, and auto-generates a meal plan or recipe, along with cheery commentary.
It initially drew attention on social media for some unappealing recipes, including an “oreo vegetable stir-fry”.
“Serve chilled and enjoy the refreshing fragrance,” it says, but does not note that inhaling chlorine gas can cause lung damage or death.
Recommendations included a bleach “fresh breath” mocktail, ant-poison and glue sandwiches, “bleach-infused rice surprise” and “methanol bliss” – a kind of turpentine-flavoured french toast.
A spokesperson for the supermarket said they were disappointed to see “a small minority have tried to use the tool inappropriately and not for its intended purpose”. In a statement, they said that the supermarket would “keep fine tuning our controls” of the bot to ensure it was safe and useful, and noted that the bot has terms and conditions stating that users should be over 18.
In a warning notice appended to the meal-planner, it warns that the recipes “are not reviewed by a human being” and that the company does not guarantee “that any recipe will be a complete or balanced meal, or suitable for consumption”.
“You must use your own judgement before relying on or making any recipe produced by Savey Meal-bot,” it said.
Just another bit of proof that humans are not ready for AI. This AI needs to be deleted. This is not simply operator error; this is an administrative error, and an error of good common sense on the part of many many people involved with creating this tool.
You cannot always trust that an end user will not be silly, malicious, or otherwise plainly predictable in how they use software.
I really didn’t want to but their comment just reeks of it my guy.
Unless by “doing this shit here as well”, you’re referring to the act of not reading the article, jumping to conclusions, and spreading fear and disinformation.
I really didn’t want to but their comment just reeks of it my guy.
Except that you did want to. Otherwise, you wouldn’t have done.
Unless by “doing this shit here as well”, you’re referring to the act of not reading the article, jumping to conclusions, and spreading fear and disinformation.
In order to be as fair as possible, I went back and read the comment again.
Is it inflammatory and excessive, while putting out an outlook of distrust towards a new technology? It can be understood as such. Yet, to a degree, I respect and understand that opinion.
Spurting out “okay boomer” doesn’t dismantle that comment; it’s a personal attack.
Either add to the conversation on just keep your peace. Makes the world a better place.
That’s a bit dramatic of a take. The AI makes recipe suggestions based on ingredients the user inputs. These users inputted things like bleach and glue, and other non-food items, to intentionally generate non-food recipes.
If you’re making something to come up with recipes, “is this ingredient likely to be unsuitable for human consumption” should probably be fairly high up your list of things to check.
Somehow, every time I see generic LLMs shoved into things that really do not benefit from an LLM, those kinds of basic safety things never really occurred to the person making it.
Fair point, I agree there should be such a check. It seems for now that the only ones affected were people who tried to intentionally mess with it. It will be a hard goal to reach completely because what’s ok and healthy for some could also be a deathly allergic reaction for others. There’s always going to have to be some personal accountability for the person preparing a meal to understand what they’re making is safe.
They’re a supermarket, and they own the data for the items they stock. No reason they couldn’t have used their own taxonomy to eliminate the ability to use non-food items in their poorly implemented AI.
Love how they blame the people that tried it. Like it’s their fault the AI was released for public use without thinking about the consequences. Typical corporate blame shifting.
Hey fellow humans! Please enjoy this delicious insecticide sandwich! It was a favorite of my grandmother and/or grandfather! Haha memories! Existential dread! Quality time!
Reminds me of the King of the Hill where Peggy Hill has a household hints column. She unwittingly makes up a recipe that ends up being instructions for making mustard gas.
And in that episode shes desperate and scrambling for content after pissing off Minh (who was providing her with real good advice) so she made something up.
They literally told it to do something with bleach and chlorine. Which is bound to produce Mustard Gas. There’s literally no fail here, no programmer or AI Engineer would want to account for such things. That’s like car manufacturers having to warn you of washing your car with gasoline and fire.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@beehaw.org
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
See, this shit is what happens when you try to use a Large Language Model for anything other than language-related shit. What you’d need for this is an AI that has data about different ingredients and their flavors, knowledge of which flavors go together and which ones don’t, etc.
But of course, that would be too much effort to put into a supermarket app for a company that just wants to piggyback off of a new trend.
This is so funny
EDIT:
😆 😆
Laugh all you want, but I know what I’m having for breakfast tomorrow!
🤖 I’m a bot that provides automatic summaries for articles:
Click here to see the summary
A New Zealand supermarket experimenting with using AI to generate meal plans has seen its app produce some unusual dishes – recommending customers recipes for deadly chlorine gas, “poison bread sandwiches” and mosquito-repellent roast potatoes.
The app, created by supermarket chain Pak ‘n’ Save, was advertised as a way for customers to creatively use up leftovers during the cost of living crisis.
It asks users to enter in various ingredients in their homes, and auto-generates a meal plan or recipe, along with cheery commentary.
It initially drew attention on social media for some unappealing recipes, including an “oreo vegetable stir-fry”.
“Serve chilled and enjoy the refreshing fragrance,” it says, but does not note that inhaling chlorine gas can cause lung damage or death.
Recommendations included a bleach “fresh breath” mocktail, ant-poison and glue sandwiches, “bleach-infused rice surprise” and “methanol bliss” – a kind of turpentine-flavoured french toast.
Look what your folks are causing!
At least you didn’t generate fake info… Did you?
There’s literally no way to know…
Just another bit of proof that humans are not ready for AI. This AI needs to be deleted. This is not simply operator error; this is an administrative error, and an error of good common sense on the part of many many people involved with creating this tool.
You cannot always trust that an end user will not be silly, malicious, or otherwise plainly predictable in how they use software.
removed by mod
Are we doing this shit here as well?
Your reply adds zero value to the thread.
If you want to make a point, try full paragraphs to express arguments.
I really didn’t want to but their comment just reeks of it my guy.
Unless by “doing this shit here as well”, you’re referring to the act of not reading the article, jumping to conclusions, and spreading fear and disinformation.
Except that you did want to. Otherwise, you wouldn’t have done.
In order to be as fair as possible, I went back and read the comment again.
Is it inflammatory and excessive, while putting out an outlook of distrust towards a new technology? It can be understood as such. Yet, to a degree, I respect and understand that opinion.
Spurting out “okay boomer” doesn’t dismantle that comment; it’s a personal attack.
Either add to the conversation on just keep your peace. Makes the world a better place.
removed by mod
That’s a bit dramatic of a take. The AI makes recipe suggestions based on ingredients the user inputs. These users inputted things like bleach and glue, and other non-food items, to intentionally generate non-food recipes.
Would it be better to have a massive list of food items to pick from?
Should take care of bad inputs somewhat
If you’re making something to come up with recipes, “is this ingredient likely to be unsuitable for human consumption” should probably be fairly high up your list of things to check.
Somehow, every time I see generic LLMs shoved into things that really do not benefit from an LLM, those kinds of basic safety things never really occurred to the person making it.
Fair point, I agree there should be such a check. It seems for now that the only ones affected were people who tried to intentionally mess with it. It will be a hard goal to reach completely because what’s ok and healthy for some could also be a deathly allergic reaction for others. There’s always going to have to be some personal accountability for the person preparing a meal to understand what they’re making is safe.
They’re a supermarket, and they own the data for the items they stock. No reason they couldn’t have used their own taxonomy to eliminate the ability to use non-food items in their poorly implemented AI.
Love how they blame the people that tried it. Like it’s their fault the AI was released for public use without thinking about the consequences. Typical corporate blame shifting.
Hey fellow humans! Please enjoy this delicious insecticide sandwich! It was a favorite of my grandmother and/or grandfather! Haha memories! Existential dread! Quality time!
Reminds me of the King of the Hill where Peggy Hill has a household hints column. She unwittingly makes up a recipe that ends up being instructions for making mustard gas.
And in that episode shes desperate and scrambling for content after pissing off Minh (who was providing her with real good advice) so she made something up.
Seems oddly similar to whats going on here.
Check out this one quick and easy meal planning trick that will cut your lifetime grocery bill by 99% (the Geneva Conference hates it!)
Yes but what’s the recipe? Was it a bleach based recipe? Did they make chlorine from salt water? So many options…
They literally told it to do something with bleach and chlorine. Which is bound to produce Mustard Gas. There’s literally no fail here, no programmer or AI Engineer would want to account for such things. That’s like car manufacturers having to warn you of washing your car with gasoline and fire.