You need to use alist:
alist
formals(f) = alist(x =, y =)
alist constructs a list from its unevaluated arguments.