Support external embedding rotation for models with no LM head