If you feel threatened you have to defend yourself. People need to understand if they approach someone in a physical way anything goes. IMO you were not out of line. The woman and her friend should have backed off.
ITA. Sounds like a mentally ill freak.