Assuming you shut it down every time you walk away. AFAIK VirtualBox doesn't encrypt snapshots (which include RAM contents and therefore the encryption key).
OP could get at least get screensaver-lock functionality, but actual security in this situation is hard.