I suppose. Having someone's private key and knowing who's offering the legitimate owner of that key a secure session at that point in time is already a tall order though!