Just for posterity: the issue was GHCi attempting to create temporary files in whatever directory it happened to be running in. If this directory happened to be one with permissions issue (such as the root dir in Windows) then the error was thrown.
I'd recommend checking the permissions for the files you're attempting to create. If you're attempting to put them in a restricted area, you'll need additional permissions to do so.