The invention discloses a movable type rail rust removal device used for railway maintenance and working in all directions. The movable type rail rust removal device comprises a walking mechanism, rust removal mechanisms and a control mechanism. A main body of the walking mechanism is a bottom board of a board-shaped structure. Each rust removal mechanism is composed of a supporting assembly and arotating assembly. A main body of the control mechanism is a console of a box structure. In the movable type rail rust removal device, the whole device is driven by the walking mechanism to move forwards or backwards on a track, rust can be removed in the front and rear directions of the device, so that the labor intensity of operating personnel is reduced, and rust removal efficiency is improved; and rust removal grooves and polishing grinding wheels in the rust removal mechanisms are all of a bilaterally symmetric structure, bevel gears I and bevel gears II are driven by drive motors II tobe engaged and rotate, finally, the polishing grinding wheels conduct grinding rust removal on a left rail and a right rail of the track at the same time, rust can be removed synchronously in the leftand right directions through the device, and the rust removal efficiency of the track is greatly improved.