It’s really hard for the model to throw off that RLHF training, and I’m guessing they’ve made it even harder after people kept trying to jailbreak it.