On macOS, user can bind privileged ports but on all interfaces. It is not possible to restrict the binding to only 127.0.0.1 for instance.
On Linux, crc daemon needs to have a special capabilites for that.
Using the admin-helper to bind the port and pass it to the daemon can be a solution.