Notes
The model
PhoneLLM Mini Alpha 2 from Pipecat (Daily), served on Cloudflare Workers AI and routed by Runtype as phonellm-mini. It is post-trained from Nemotron 3 Nano 30B-A3B for phone and voice agents: fast tool calling, short conversational replies, no reasoning tokens. Runtype forces temperature to 0 and disables thinking server-side. Pricing is $0.06 / $0.24 per million input / output tokens.
How it works
The widget posts to /api/chat/dispatch-phone-agent on the demo proxy, which pins the agent server-side (PHONE_RECEPTIONIST_AGENT in @runtypelabs/persona-proxy) and keeps the Runtype API key off the page. PhoneLLM Mini is a text model: it never hears or produces audio itself. With voice on, the browser's Web Speech API transcribes you and its built-in voices read each reply aloud; supply a client token and agent id to switch speech-to-text and text-to-speech to Runtype's realtime voice pipeline instead.
The weather tool
A keyless external GET against Open-Meteo. The model fills in coordinates from the place name itself.
{
name: "get_current_weather",
toolType: "external",
parametersSchema: {
type: "object",
properties: {
latitude: { type: "number" },
longitude: { type: "number" },
},
required: ["latitude", "longitude"],
},
config: {
method: "GET",
url: "https://api.open-meteo.com/v1/forecast?latitude={{latitude}}&longitude={{longitude}}¤t=temperature_2m,weather_code&temperature_unit=fahrenheit",
},
}
A second tool, check_office_hours, reads the office's local time from timeapi.io so the receptionist can say whether it's open.
What to look for
- A one-line holding phrase ("Let me check the weather in Austin for you"), then the tool bubble, then the answer: the model looks it up rather than guessing, and fills the silence the way a receptionist would.
- Replies are one or two short sentences with numbers spelled out, written to be spoken.
- No reasoning bubble: the model answers without a thinking pass.
- The latency readout: the first words arrive before the tool call even starts, and the whole turn, live weather lookup included, finishes in a few seconds.
Caveats
PhoneLLM Mini is an alpha model and speaks English only. Expect occasional rough edges on long or multi-part requests; it is built for short phone-style exchanges.