I thought the debate was if the AI was reckless/dangerous.
I see no difference between saying “this AI is reckless because a user can put effort into making it suggest poison” and “Microsoft word is reckless because you can write a racist manifesto in it.”
It didn’t just randomly suggest poison, it took effort, and even then it still said it was a bad idea. What do you want?
If a user is determined to get bad results they can usually get them. It shouldn’t be the responsibility or policy of a company to go to extraordinary means to prevent bad actors from getting bad results.
Who is getting money from your work? Do they deserve it? More than you?
Having the good fortune to have money earlier shouldn’t entitle someone to more money later. Investors are important, but shouldn’t be allowed to have all of the benefit.