For those of us who don’t use google services, integration for any IMAP compatible email and CalDav calendar services. Furthermore, if this could be done via some middle tier that proxied the access to the actual data and actions, especially since email contains such a wealth of information about a person, not to mention being a means of 2FA for many services, It would be nice to have a means of filtering what content the agent has access to.
As an alternative, maybe just supporting a 1 time or periodic sweep and import of relevant email memory for background context and knowledge.