Analyzing Phone Calls with AI
In this post I'll give you some tips on getting started with voice transcript analysis and LLMS to give you insights into your sales and support phone calls.
Tim Kenney & Nate Kenney
10/14/20253 min read


Turning phone calls into insight: a manager’s guide to LLM call analysis
Want clearer visibility into sales and support without sitting through hours of recordings? With today’s speech tech and LLMs, you can turn every call into transcripts, summaries, sentiment, and business facts that flow into your dashboards. Here’s a simple, non-technical plan you can run with.
What you’ll get out of this
For sales: spot winning talk tracks, objections that stall deals, and which reps need coaching.
For support: see top reasons for calls, early signs of churn, and which fixes actually solve the problem.
For leadership: consistent metrics across all calls—no more guessing from a few anecdotes.
Step 0: Get Permission
Pay attention to your the laws of your Federal, State and Local governments and make sure you warn users they are being recorded for quality and analysis. This is typically done automatically by the phone system.
Step 1: Transcribe every call (use WhisperX)
You need accurate transcripts with who said what and exact timing. WhisperX is a widely used, fast transcription tool that adds word-level timestamps and speaker labels (so you can separate the customer from the agent). It’s built for speed and can run well beyond real time, which matters when you’re processing lots of calls.
What this enables:
Reliable quoting in summaries.
Easy snippets for coaching (jump straight to “the objection at 03:14”).
Solid inputs for next steps like sentiment and topic tagging.
Step 2: Add sentiment and tone
Once you have text, run sentiment analysis to rate each turn as positive, neutral, or negative. You can start with a simple, proven tool like VADER (good for short, conversational text), and later layer an LLM to detect frustration, confidence, confusion, or escalation moments.
Why it helps:
Sales: flag turning points—did the deal brighten after pricing, or dip at legal terms?
Support: surface at-risk customers when sentiment drops across multiple calls.
Step 3: Enrich with CRM data (outcomes matter)
A transcript alone doesn’t tell you if the call worked. Join each call to your CRM (Salesforce, HubSpot, Zendesk, etc.) using the call ID, case/opportunity ID, agent, customer, and date. Now you can link conversations to real outcomes:
Sales: stage changes, win/loss, amount, next meeting set.
Support: resolution code, time to close, CSAT/NPS, churn/renewal.
With this join in place, you can answer questions managers actually care about:
Which phrases or talk tracks predict wins?
Which product issues drive repeat calls and low CSAT?
Which reps need coaching on objection handling or de-escalation?
Step 4: Let an LLM do the reading for you
Point an LLM at each transcript (plus the CRM fields) and have it produce:
1-minute summaries (what was the call about? outcome? next steps?).
Key moments (objection, price talk, competitor, promise made).
Action items (who does what by when).
Keep prompts short and scoped to business needs—don’t let the model ramble. (Yes, people will try to ask for a peanut butter sandwich recipe; your prompt should politely steer back to business.)
Step 5: Dashboards and alerts
Push results to your BI tool or CRM:
Team view: top topics, sentiment trend, win rate by talk track, first-contact resolution.
Rep view: recent calls, strengths, coaching clips, follow-ups due.
Early-warning alerts: sudden spikes in negative sentiment or a new failure mode after a release.
How the pieces fit (simple flow)
Recordings from your dialer/contact center
WhisperX → transcripts with speakers & timestamps
Sentiment model (+ optional LLM tone cues)
CRM join (opportunity or case + outcome)
LLM summarizer & key moments
BI/CRM dashboards & alerts
Rollout in three short phases
Pilot (2–3 weeks): 500–1,000 calls from one sales team and one support queue. Compare transcripts and summaries to manager notes; fix obvious misses.
Expand (1–2 months): add sentiment, CRM join, and weekly “top insights” email to managers. Start coaching from clips.
Scale: switch on alerts and team dashboards; revisit prompts monthly to keep them on-topic and consistent.
