Clear session cookies with Selenium IDE?
Found it myself, when I stopped thinking in terms of clear and tried delete:
I've found it most useful to simply begin all tests with a call to my logout page, and on that page purposely expire any sessions the user may have.