High-strength medium-manganese steel sheets recrystallized in the alpha phase after cold-rolling have a good press formability due to the <111>//ND texture. If the A3 temperature and the alpha-to-gamma transformation temperature are decreased, the addition of manganese affects the recrystallization and the formability. In this work, the annealing texture evolution of medium-manganese steel was investigated, carbon-free Fe-Mn sheets being used for preliminary research, and some temperatures around the T0 temperature, at which ferrite and austenite have the same free energy, were selected for annealing. It was confirmed that the T0 temperature is a key factor to control annealing texture, i.e., although evolving with progress of recovery and partial recrystallization at annealing temperatures below the T0, the gamma fiber (<111>//ND) texture disappears at temperatures above the T0. The texture memory effect during alpha-gamma-alpha transformation was not confirmed in this binary system.