Marks on map still visible after switching sides

If you switch sides, you can still see the marks put on the map by the "old" side.