Voice + Email Agents
Imagine a voice agent that can send and receive emails in real time. It can review and sort forwarded emails, accept and process documents, and send calendar invites, all while maintaining a paper trail.
You can build an AI interviewer that asks candidates questions about their resume. Or a customer support agent that pulls relevant context from existing support tickets. The problem is that giving agents their own email inboxes is difficult with legacy providers like Gmail or Outlook.
What if there was a better way? AgentMail is an API-first email provider built for AI agents. With AgentMail, you can create an inbox for every agent, user, or even session. Today we are partnering with LiveKit to bring email inboxes to voice agents.
LiveKit is an open source framework and cloud platform for building voice and video agents. Developers can use LiveKit to build complex agent workflows for real-time applications without worrying about the underlying infrastructure.
AgentMail extends LiveKit's infrastructure to email. Now developers can build agents that share context and carry conversation across both synchronous and asynchronous communication channels.
Here's a quick demo video:
How it works
We equipped the LiveKit agent with tools for interfacing with the AgentMail API. It also receives emails in real time through a WebSocket connection to AgentMail. We created a custom EmailAssistant class that handles all of this. Then we passed the agent to the LiveKit Session. That's it.
Get started
Want to try it out for yourself?
- Sign up for LiveKit
- Follow the LiveKit Voice AI quickstart
- Sign up for AgentMail
- Follow our LiveKit integration guide
Learn more
We started building email agents because they can converse with users in their inboxes, automate email-based workflows, and authenticate with third-party applications. Given these unique capabilities, we think email will be a core interface for agents.
But we were building on top of Gmail, which was a struggle: poor API support, expensive subscriptions, rate limits, sending limits, OAuth, keyword search, and an overall terrible developer experience. Gmail and other providers didn't work for us. So we decided to build our own.
AgentMail is like Gmail, but API-first, with programmatic inbox creation, events over webhooks and websockets, simple API key auth, organization-wide semantic search, structured data extraction, and usage-based pricing that scales with emails sent/received.
So far AgentMail has been deployed to use cases such as apps with dedicated inboxes for each user, voice agents that receive documents in real time, automated account provisioning and QA testing, and agents that coordinate work with humans and other agents.
If you're building with agents or you're building with email, we would love to hear from you!
