In order to fix this issue, please go to your WordPress Settings → Permalinks → Under “Common Settings” and choose any linking structure other than “Plain.”

As you can see in the screenshot, "Post name" has been selected, but you could choose "Day and name," "Month and name," or any other settings.

Confirm by pressing “Save Changes" and retry connecting your WooCommerce store again.