A method, electronic device, and non-transitory computer readable medium for optical tracking are provided. The method includes identifying at least one object within an environment, from received image data. The method also includes assigning a volatility rating to the identified object. Additionally, the method includes determining one or more tracking points associated with the identified object. The method also includes determining a priority rating for the each of the one or more tracking points associated with the identified object based on the assigned volatility rating of the identified object. The method also includes selecting the one or more tracking points for optical tracking based on the priority rating.