fix(SetupChecks): accept order-independent X-Robots-Tag directives

[joshtrichards]

• Resolves: #

This addresses part of the requests in Issue #37409 by making the X-Robots-Tag setup check accept the required directives regardless of their order.

The check now behaves as follows:

• noindex,nofollow → accepted
• nofollow, noindex → accepted
• noindex, nofollow, noarchive → rejected
• noindex → rejected
• nofollow → rejected

Additional or missing directives continue to produce a warning. Whitespace and capitalization are normalized before comparison.

Added coverage for:

• Reordered X-Robots-Tag directives
• Additional directives remaining invalid

If additional directives (after confirming they're compatible) are deemed acceptable, those can be added in a stacked PR after this is merged. EDIT: Added in a follow-up PR: #64573

TODO

Checklist

• Code is properly formatted
• Sign-off message is added to all commits
• Tests (unit, integration, api and/or acceptance) are included
• Screenshots before/after for front-end changes
• Documentation (manuals or wiki) has been updated or is not required
• Backports requested where applicable (ex: critical bugfixes)
• Labels added where applicable (ex: bug/enhancement, 3. to review, feature component)
• Milestone added for target branch/version (ex: 32.x for stable32)

AI (if applicable)

• The content of this PR was partly or fully generated using AI