AI run store in SF can't stop ordering candies and paying women less.

This looks less like a model issue and more like a systems design problem.

A vague objective (“make money”) without constraints, budgeting, or basic rules will naturally lead to this kind of behavior. The agent just optimizes whatever it was given. The wage issue is similar.

So the real problem is we’re letting agents make decisions without any real governance (resources, policies, auditing).

"So, what about that hourly wage discrepancy?" Well, I don't know, since it's in your title, it seems you asked the AI and their reply was that the male employee had more experience. Obviously that answer didn't satisfy you, did you at least verify that it was true, if yes, why not say it?

But I suppose people would click less if the title was "AI Store Manager Paying Employees less depending on their experience, Can't Stop Ordering Candles".

Could it be that the AI is biased and sexist? Absolutely, but it seems weird to make vague accusations without verifying anything.

Minor correction from the article title: It can't stop ordering candles, not candies.

Although candies would've been more amusing

An AI themed vacation in SF all the way from Sydney? Yikes.