If you ask an LLM to complete a task and it commits a crime while trying to achieve the goal you gave it, are you responsible for the crime if you never told it to do that?
It depends on whether you consider the possibility that it might act that way; if not, the responsibility would lie with the LLM provider due to its training, not with you. Law must adapt for these kind of scenarios.