Apps no longer rearranging with flex box

The apps on the flex homepage used to rearrange themselves based on the last app used. Recently I noticed that it is no longer doing this. How can I get this to go back? Did I accidentally change something or was this an update? This has made the box so much more inconvenient.