FATA[0004] failed to initialize project: unable to scaffold with "base.go.kubebuilder.io/v3": exit status 2
After some time spending on my go environment setup I was able to figure out. I had link go with different version.
I changed my GOROOT to -> /usr/local/opt/go@1.15/libexec and then I was able to init the opeartor.
Check your GOPATH folder permissions. In my case, kubebuilder had access denied and showed the same error you found.
You can also try to reinstall GO Lang in a different folder and see what happens.