New password cannot begin with '?' or '!'

What causes this issue?

'?' '!, when used as the first character of a password, have a special
meaning.
For this reason, you cannot use either of these characters as the first
character in a password. Otherwise, it would no longer be possible to
have password-based logons using SAP GUI.

System Response

The system issues an error message and will not allow you to continue with this transaction until the error is resolved.

How to fix this error?

Use a different password.

Error message extract from SAP system. Copyright SAP SE.