This happens kind of randomly and the icons just stay there and do not leave until you restart the game.