I would interpret it to mean that he wouldn't pounce on an unwilling girl.

Yes, this is the way I've seen it used before, although then it was girls warning one another that so-and-so was "not safe in taxis" (magazine article about debutantes, I believe).

Don't recall Bertie describing himself as safe in taxis, but he absolutely would be, of course! :)