You could 0 escape and use the -0 flag to xargs.
svn st | awk '/^!/ { sub("^! +", ""); printf "%s\0", $0 }' | xargs -0 svn rm
This has another advantage in that files with quotes or other special characters will not screw up the xargs command line either.