A mechanism for sharpening the roughing tool of a roughing machine. The roughing machine includes a roughing tool mounted to a rougher unit. The rougher unit is moveable between an upper position wherein the roughing tool is in an idle position and a lower position wherein the roughing tool is in a roughing position and is effective to rough the upper margin of a shoe assembly. A sharpening tool is mounted for movement between an idle position wherein it is spaced from the roughing tool and a working position wherein it is in engagement with the roughing tool. A positioning device is effective to bring the sharpening tool to its working position when the roughing tool is in its idle position.