AI Glossary / AI and machine learning / Beginner
Automatic Speech Recognition
Definition
Automatic Speech Recognition, or ASR, is technology that converts spoken audio into written text, so that machines can transcribe, search or act on what people say.
What it means
ASR is what sits behind voice typing, meeting transcripts, captions and voice assistants. You speak, and text appears.
It is the first step in many voice systems. Speech is converted to text, which another system, such as a language model or a command parser, then understands and responds to. A reply can be turned back into speech by a separate text-to-speech system.
Accuracy depends heavily on conditions: clear audio, a good microphone, one speaker at a time, common accents and familiar vocabulary all help. Noise, crosstalk, strong dialects and specialist terms make errors more likely.
Error is usually measured as word error rate, the share of words wrongly recognized, added or missed. A low rate on a benchmark does not guarantee the same on your calls.
For a business, ASR turns spoken material into searchable, summarizable text, but it needs checking where names, numbers or legal wording matter.
Quality claims deserve a check. Providers often report accuracy on clean benchmark audio, so run your own sample: real calls with your accents, background noise and vocabulary. Ten minutes of labeled audio tells you more than a marketing figure.
How it works
Audio is captured and broken into very short slices, then converted into numerical features that describe the sound, such as which frequencies are present over time.
A trained model maps those features to likely sounds and words. Modern systems use neural networks that learn from large amounts of recorded speech paired with transcripts, and a language component helps choose words that make sense in context.
The system outputs text, often with timestamps, confidence scores and sometimes labels for who is speaking. Low-confidence words can be flagged for review.
Performance can be improved with custom vocabularies, such as product names, and with good recording practice. Providers differ in languages supported, so check your own.
Streaming ASR returns text as you speak, trading a little accuracy for speed, while offline ASR waits for the full recording and is often more accurate.
Three practical examples
- Meetings: automatic transcripts and summaries of calls.
- Customer service: transcribing support calls so they can be searched and analyzed for common issues.
- Accessibility: live captions for lectures, videos and events.
Think of it this way
Think of a very quick typist at the back of the room, taking down what everyone says. They are fast and usually right, but they may mishear a surname or a number in a noisy room.
The limit: the typist cannot ask you to repeat. Anything that matters, like an amount or a legal term, still needs a person to check it against the audio.
Worked example
transcribing a sales call
Suppose a small agency records client calls, with consent, and runs them through an ASR service to produce transcripts.
The transcripts are searchable, so the team can find when a client mentioned a deadline. But the first week shows errors on client names and product codes.
The agency adds a custom word list with those names and checks a sample of ten transcripts against the audio, counting errors per hundred words. The figures are the agency's own and illustrative here.
Rule: transcripts are working notes. Anything quoted to a client or used for a decision is checked against the recording.
Illustrative case study
A fictional clinic tests ASR for dictated visit notes. In quiet rooms, accuracy is high, and clinicians save time.
In busy areas, errors in drug names appear, which is a safety issue. The clinic restricts use to quiet rooms, adds a mandatory review step before filing, and keeps recordings only as long as policy permits.
The invented lesson: ASR can be useful and risky in the same setting, so the surrounding process matters.
Common misconceptions and mistakes
- ASR understands what people mean. It converts sound to words; understanding is a separate step.
- It works equally well for every voice. Accuracy varies with accent, audio quality and vocabulary, so test with your own speakers.
- Recordings are always fine to transcribe. Consent and privacy rules about recording and storing voices still apply.
Business use
Use ASR for meeting notes, call analysis, captions and voice interfaces where speed matters more than perfect wording.
Get consent where required, test on your own audio, add custom vocabulary, and have people check anything that feeds legal, medical or financial decisions.
Budget for storage and consent: transcripts and recordings are personal data in many places, so define retention rules before you switch transcription on.
People also ask
Is ASR the same as speech-to-text?
Yes, in everyday use they mean the same thing.
How is accuracy measured?
Usually by word error rate, which counts wrong, missing and extra words against a reference transcript.
Does it work offline?
Some systems run on device; many use cloud services. Check where audio goes.
Check your understanding
A transcript contains the wrong figure for a contract value. What should the process be?
Answer: Treat the transcript as a draft and verify figures against the recording or the signed document before relying on it.
Related terms
- Text-to-speech
- Word error rate
- Natural language processing
- speech recognition
- transcription
- voice assistant
Learn next
Be Productive Using AI shows practical ways to turn voice and notes into useful work: https://aiforbusinessandlife.com/academy/be-productive-using-ai. [C1]
More in AI and machine learning
- Augmented reality - Augmented reality, or AR, overlays computer-generated images, text or information onto a live view of the real world, usually through a phone, tablet or...
- Autognostics - Autognostics is an uncommon term used in discussions of autonomic networking for a network's ability to monitor and diagnose its own condition and use that...
- Automated negotiation - Automated negotiation is a process in which software agents exchange, assess or revise proposals to seek an agreement under defined rules.
- Autonomic networking - Autonomic networking is an approach in which network functions manage aspects of their own configuration, optimization, protection or recovery.
- Autoregressive Hidden Markov Model - An autoregressive hidden Markov model is a hidden Markov model in which each observation depends not only on the hidden state but also on the previous...
- Auxiliary loss - An auxiliary loss is an extra loss term added to a model's training objective, alongside the main loss, to give additional learning signal and help the...
Sources
[S16] PAL Robotics documentation glossary; [S14] KNIME, Data Science Glossary. Full URLs are in the source ledger. Verified 11 October 2026.
Previous: Automatic parallelization Next: Automatic taxonomy construction