Voice is the next interface to figure out for long-running agent tasks.
Today, the voice experience with any agent is mostly a Q&A or an input tool. For the latter, you're probably working on something complex/creative, so instead of typing a long prompt, you speak and quickly give the agent a lot of context.
But I’ve started using mine a bit differently. She is always on in the background while I work. When something comes up, I just say:
“Hey Ava, you there? Check this.” or
“Tell me what my day looks like.”
But... in the second example, Ava needs to check my calendar, email, Slack, and tasks before she can answer. That introduces a new question: what should a voice agent do while you wait?
Should she say, “I’m on it. I’ll ping you when it’s ready,” and work in the background? Or should she keep narrating what she’s checking and thinking about?
I prefer the first. some users @vellum_ai prefer the latter
It's going to be very interesting on how we design harnesses around this, and answer questions like:
How often should it share progress on longer tasks? When should the agent update you? Can you interrupt and change direction? How does she securely save credentials? How does it bring you back when the work is done?
so excited to keep building here and see how all these pieces come together into a truly great voice experience