Karnataka Revenue Minister R Ashoka on Wednesday conceded that attempts were on within the BJP to have Chief Minister B S Yediyurappa removed, with the ageing Lingayat strongman initiating a counterattack by deploying his loyals to bat for his continuation.