This is a known issue, happened to me as well several years ago...here's a thread that should point you in the right direction:
Driver's Window mysteriously goes down - Anyone...
The last couple of times I have turned off my 01 Highlander, the driver's window just goes down about the time I am walking away. Any idea what is up with this??? Thanks!