The new_permission_set test fails with a timing related issue.
The settings component reloads in an apparently new way (the test code was not change for several months at least) causing the permission set title entered by the test to get lost, and in turn the "unsaved changes" alert to pop up: