Yeah if he did confront her she probably wouldn't have been afraid to fight him if he started getting too close. Elsa won't really see anything wrong with what she did, and she'll probably tell Joker she'll leave his boy alone as long as they both stay away from her.

idk how close Sora is getting to all this mess but if he got too close maybe Elsa was going to freeze his heart and Joker stopped her? idk just spitballing here