Fixed duplicate new milestone buttons in new navigation
What does this MR do?
Fixes duplicate new milestone buttons when the new navigation is turned on.
Also fixed the permissions around the top most new milestone button.
What are the relevant issue numbers?
Closes #35454 (closed)