Making AI companions is becoming a widespread little hobby project. Many have created them and shared instructions on how to do it. My preference would be to use local resources only (say, with ollama), they can even be made with voice recognition, TTS, and an avatar character.
While I have not interfaced my AI with all the services that Clawdbot does (WhatsApp, Slack, etc.) I don't think that is too much of a stretch from my very simple build.
I also would like local LLMs - but that's hardly the biggest issue with these projects?
You point it at your email, and you've opened a vector for prompt injection and data exfiltration - all as an integral part of the features you want (read my emails, send some emails).
Your local LLM won't protect you there.
You could probably write some limited tools (whitelist where mail could be sent) - but it goes against the grain of "magically wonderful ai secretary".
While I have not interfaced my AI with all the services that Clawdbot does (WhatsApp, Slack, etc.) I don't think that is too much of a stretch from my very simple build.