Defend the Secret From My Former Bias!