Shunya LabsShunya LabsPlayground

Horizon · WebSocket streaming

Real-Time Transcription

Convert live speech into text while the conversation is still happening for voice agents, customer support, agent assist, live captions, meetings, call routing, search, and real-time AI applications.

Stream audio to Shunya Horizon over WebSocket and receive partial and final transcripts with multilingual automated speech recognition, telephony audio support, speaker-aware workflows, and structured output for downstream applications.

WebSocket streamingPartial transcriptsFinal transcriptsSub-500 ms first token
Speaker

I wanted to check whether my payment was processed yesterday.

Horizon

I wanted to check whether my payment was processed yesterday.

Partial transcript, then final transcript
Voice agentsLive captionsAgent assistTelephony

Real-time transcription

Speech happens now. Thetranscript should Too

Traditional transcription starts after a recording is complete. Real-time transcription works differently. The application sends audiocontinuously while the person is speaking. Horizon processes that live audio and returns text as the conversation progresses.

Live speechAudio streamHorizon WebSocketPartial transcriptFinal transcriptYour application

This makes live speech usable by software before the conversation ends.

CapabilityHorizon
Real-Time Transcription
WebSocket Streaming
Partial Transcripts
Final Transcripts
Live Microphone Audio
PCM Streaming
float32 Streaming
μ-law
A-law
Telephony Audio
Multilingual Recognition
Automatic Language Detection
Voice-Agent Integration
Agent Assist
Live Captions
Call Routing
Real-Time Search

Try it yourself

Speak naturally and watchthe transcript Appear

Do not test real-time transcription only with a carefully prepared sentence. Try speech that resembles your production environment.

Examples

  • Hi, I wanted to check whether my payment was processed yesterday.
  • Can you move my appointment to Friday afternoon?
  • Mera order अभी तक deliver नहीं हुआ.
MicrophoneApplication audioHorizonPartial transcriptFinal transcript

Test with

  • Customer request
  • Product name
  • Address
  • Number
  • Voice-agent conversation
  • Hinglish sentence
  • Phone-quality audio
  • Noisy environment

Partial transcripts

See text before thespeaker Finishes

A speaker begins: “I wanted to check...” Horizon can return an interim transcript while more audio is still arriving.

SpeakerI wanted to check whether...PartialI wanted to check whether...Speaker continues...my payment was processed yesterday.FinalI wanted to check whether my payment was processed yesterday.

Partial transcripts allow applications to begin working with the conversation before the full utterance is final. Shunya explicitly documents interim/partial transcription for live streaming.

Final transcripts

Stabilise the segmentas speech Progresses

Partial text can change as additional audio provides more context. Final transcripts represent completed segments.

Live audioInterim hypothesisMore contextFinal transcript segment

Partial

Display live caption

Applications can treat final transcripts differently from partial text.

Final

  • Store transcript
  • Send to application logic
  • Index for search
  • Trigger next workflow

This distinction matters when building real-time systems.

Sub-500 ms streaming performance

Designed for applicationsthat cannot Wait

Shunya publishes sub-500 ms streaming transcription and first-token performance forreal-time Horizon workflows—useful when transcription must appear during speech rather thanafter a recording finishes.

Sub-500 msStreaming transcription / first-token performance for real-time Horizon workflows.

Use cases

  • Voice agents
  • Agent assist
  • Customer support
  • Live captions
  • Call routing
  • Knowledge retrieval
  • Supervisor tools
  • Interactive AI

ImportantActual end-to-end application latency also depends on network, audio chunking, client implementation, model configuration, and downstream application logic. The published figure should not be interpreted as a guarantee for every complete application stack.

Latency also depends on

  • Network
  • Audio chunking
  • Client implementation
  • Model configuration
  • Downstream application logic

WebSocket streaming

Keep one live connectionwhile audio Arrives

Recorded transcription typically uses an HTTP request. Real-time transcription uses a persistent WebSocket workflow.

ApplicationOpens WebSocketSends audioContinuouslyHorizonProcesses streamPartial transcriptsReturnFinal transcriptsReturnApplication reacts

The WebSocket remains part of the ongoing voice interaction rather than representing one completed file upload.

Live microphone audio

Transcribe speech directlyfrom an Application

Real-time audio may come from a browser microphone, mobile microphone, desktop application, voice assistant, call application, or meeting application.

  • Browser microphone
  • Mobile microphone
  • Desktop application
  • Voice assistant
  • Call application
  • Meeting application
MicrophoneAudio framesHorizon WebSocketLive transcript

Use for

  • Dictation
  • Voice input
  • Search
  • Real-time notes
  • Voice interfaces
  • AI assistants

Speech can become an input method in the same way typing is.

Live audio formats

Send audio in formats designedfor Streaming

Shunya documents live audio representations including int16 PCM, float32, μ-law, and A-law.

int16 PCM

For general recording and real-time audio.

float32

For pre-processed audio streams.

μ-law

For telephony and SIP workflows.

A-law

For G.711 telephony workflows.

Audio sourceMicrophone, application, telephony, SIP / PSTNStreaming representationHorizonTranscript

This lets the same streaming platform work across different real-time environments.

Real-time phone call transcription

Understand the caller beforethe call Ends

Contact-center applications often need transcription while the customeris still speaking. Shunya explicitly documents this workflow.

Customer speaksTelephony streamμ-law / A-law / supported PCMHorizonPartial transcriptText arrives during speechFinal transcriptSegment finalisedService application

The application can use the transcript before the customer hangs up.

μ-law and A-law

Stream common G.711phone audio Directly

Shunya documents native streaming support for G.711 μ-law, common in telephony environments, and G.711 A-law, common in SIPand telephone infrastructure. Shunya documents an 8 kHz telephony workflow for these codecs.

G.711 μ-law

Telephony

Common in telephony environments.

G.711 A-law

SIP and telephone

Common in SIP and telephone infrastructure.

SIP / PSTN callG.711 audioHorizon WebSocketLive transcript

8 kHzFor supported μ-law and A-law frames, Shunya does not require a separate resampling or codec-conversion layer before transmission.

Voice agents

Real-time transcription is thelistening Layer

An AI voice agent first needs to understand what the user says. Real-time automated speech recognition is typically the listening layer in a voice-agent pipeline.

  • Can you check my order status?
User speaksCan you check my order status?HorizonCan you check my order status?LLM / agentUnderstands the requestRadianceGenerates speechUser hears response

Speech, then text, then intelligence, then speech. Real-time transcription enables the listening side of that loop.

Agent assist

Give human agents livetranscript Context

A human support agent can benefit from seeing what the customer says in real time. Shunya explicitly lists agent assistamong real-time call-transcription use cases. The surrounding application controls what assistance is displayed.

CustomerSpeaksHorizonLive transcriptAgent-assist applicationHuman agent

Possible downstream uses

  • Knowledge retrieval
  • Search
  • Customer context
  • Workflow prompts
  • Call notes

Live captions

Show text while speechis Happening

Real-time transcription can power live caption experiences. The application controls caption layout and presentation. Horizon provides the live text.

SpeakerMicrophone audioHorizonPartial transcriptFinal caption

Possible use cases

  • Meetings
  • Presentations
  • Customer interactions
  • Live applications
  • Accessibility-oriented interfaces

Call routing

Route based on what the calleractually Says

Shunya explicitly lists call routing among live transcription use cases. The routing rules remain in the surrounding application.

Traditional IVR

Press 1 for support.

Conversational system

How can I help?

  • I need to reschedule my appointment.
Caller speaksHorizonLive transcriptRouting applicationAppointment workflow

Knowledge retrieval

Use the live transcriptas a Query

Shunya's real-time call material explicitly includes knowledge retrieval and real-time search among streaming use cases.

  • How do I change my billing address?
HorizonLive transcriptKnowledge applicationRelevant information

The transcript can act as input to

  • Search
  • Knowledge bases
  • RAG workflows
  • Support tools
  • Internal systems

Real-time search

Search while theconversation Continues

A live transcript can be indexed or queried as speech arrives. The search engine itself remains external. Horizon supplies the live text input.

SpeechHorizonCurrent transcriptSearch application

Potential uses

  • Product lookup
  • Support knowledge
  • Policy information
  • Customer records
  • Internal documentation

Real-time meetings

Make live discussions searchableas they Happen

Streaming transcription can support live meeting experiences. For complete post-meeting intelligence, the finished recording can also be processed through batch transcription.

Meeting audioHorizonLive transcriptMeeting application

Potential downstream features

  • Live captions
  • Search
  • Notes
  • AI assistance
  • Speaker-aware records

Multilingual real-time transcription

One live speech platformacross many Languages

Horizon supports multilingual speech recognition. A real-time application does not need a completely separate architecture for each supported market.

Examples include

  • English
  • Hindi
  • Tamil
  • Bengali
  • Japanese
  • Korean
  • Spanish
  • Arabic
  • Other supported languages
Live speechHorizonStructured transcript

Automatic language detection

Use auto-detection whenlanguage is Unknown

Horizon supports automatic language detection. When language is known, anapplication can explicitly configure the expected language.

User speaksHorizonDetected languageTranscript

For short clips, locking the known language can reduce ambiguity because there is less speech context available for detection.

Code-switched live speech

Some users switch languageinside one Conversation

Horizon includes specialised Code-switch workflows for supported mixed-language conversations.The relevant language pair should still be verified against the deployed configuration.

Examples

  • I made the payment yesterday लेकिन अभी तक confirmation नहीं आया.
  • The delivery is confirmed, but address கொஞ்சம் change பண்ணணும்.
Mixed-language speechHorizon Code-SwitchContinuous multilingual transcript

Do not assume every possible language combination is supported by a dedicated Code-switch model.

Speaker diarization

Add speaker structurewhere Supported

A conversation is more useful when each participant remains attached to their words. Shunya documents speaker diarization as part of its broader transcription stack.

Without diarization

I haven't received my refund yet. I'll check that for you.

With diarization

SPEAKER_00 I haven't received my refund yet.
SPEAKER_01 I'll check that for you.

Use for

  • Calls
  • Meetings
  • Interviews
  • QA
  • Search
  • Analytics

Speaker identification

Resolve known speakerswhere Configured

Diarization tells you that different people spoke. Speaker identification can match registered voice profiles. Plan for approximately 5–15 seconds of clean solo speech when registering a speaker profile.

Before

SPEAKER_01

I'll review that for you.

After

Priya

I'll review that for you.

Unknown participants can remain anonymous labels.

Word-level timestamps

Connect text back to the liveor recorded Audio

Verbose transcript output can include word start time, word end time, and a confidence score. Timing makes transcripts operational rather than merely readable.

  • Word start time
  • Word end time
  • Confidence score

Use for

  • Caption alignment
  • Search
  • Playback
  • Call review
  • Meeting review
  • Media editing
Search termpaymentTranscript matchAudio position

Real-time vs batch

Live now.Enrich Later

Streaming and batch transcription serve different jobs. Richer conversation intelligenceis often available on completed recordings—not automatically live during streaming.

Streaming

For conversations happening now

  • Voice agents
  • Live captions
  • Agent assist
  • Interactive AI
  • Live support
  • Real-time meetings

Batch

For complete recordings

  • Post-call analytics
  • Summaries
  • Intent
  • Sentiment
  • Emotion
  • Redaction
  • Searchable archives
  • QA
Live audioStreaming ASRPartial + final transcript
RecordingBatch transcriptionTranscript + optional intelligence

Post-call intelligence

Add richer structure after theconversation Ends

For supported batch workflows, Shunya documents speaker structure, summaries, intent, sentiment, emotion, keyterms, redaction, and word timestamps.

  • Speaker diarization
  • Speaker identification
  • Summary
  • Intent
  • Sentiment
  • Emotion
  • Keyterms
  • Redaction
  • Word timestamps
Live conversationStreaming transcriptComplete recordingBatch processingEnriched outputStructured conversation data

Understand now. Analyse more deeply afterwards.

Customer support

Understand the customerwhile they Explain

Possible real-time downstream use includes agent assist, routing, search, knowledge retrieval, and avoice agent. After the call, the recording can be used for summaries and analytics.

  • My payment is still showing as pending.
CustomerHorizonLive transcriptSupport applicationRelevant workflow

Possible real-time downstream use

  • Agent assist
  • Routing
  • Search
  • Knowledge retrieval
  • Voice agent

Contact centers

Turn live conversationsinto application Input

Shunya positions live call transcription for contact-center environments. One transcript can support several applications around the same conversation.

CallCustomer + agentHorizonStructured transcript

Possible downstream workflows

  • Agent assist
  • Voice agent
  • CRM
  • QA
  • Search
  • Analytics
  • LLM

Dictation and voice input

Speak instead of Typing

Streaming transcription can also support direct voice input. The transcript can be edited, stored, searched, or processed downstream.

UserSpeaks a note, instruction, or queryHorizonLive textApplication

Possible experiences

  • Dictation
  • Voice notes
  • Forms
  • Search
  • AI prompts
  • Field applications

Audio chunking and application design

Real-time transcriptionis a streaming System

An application does not upload an entire finished recording. It sends audio progressively. Application designtherefore matters. End-to-end responsiveness depends not only on the speech model but alsoon how audio is captured, transmitted, and consumed.

ClientCaptures audioLive framesChunksWebSocketSends framesTranscription eventsUI or application state

Developers

Add live transcriptionthrough WebSocket

InputMicrophone, application audio, or telephone audioStreaming connectionWebSocketHorizonOutputPartial transcript and final transcript

Live audio formats Shunya documents

  • int16 PCM
  • float32
  • μ-law
  • A-law

Input

  • Microphone
  • Application audio
  • Telephone audio

Configure according to workflow

  • Model
  • Language
  • Output format
  • Speaker configuration where applicable
  • Timing options

Send the transcript into

  • LLM
  • Agent
  • Search
  • CRM
  • Database
  • Routing system
  • Caption UI
  • Analytics pipeline
Audio streamHorizon WebSocketPartial + final transcriptYour application

Choose the right Horizon model

The conversation determinesthe recognition Path

One real-time API architecture can route to the recognition path that best matches the conversation.

Horizon Universal

Global languages

For supported global languages. Examples include English, Spanish, French, Japanese, and Korean.

Horizon Indic

Indic speech

For Indian-language and regional speech.

Horizon Code-Switch

Mixed-language speech

For supported mixed-language conversations.

Horizon Medical

Clinical speech

For specialised medical speech.

Global-language speechUniversalIndic speechIndicMixed-language speechCode-switchClinical speechMed

Real-world real-time use cases

Live speech wherever textis needed First

Live speech wherever text is needed before the audio ends.

AI Voice Agents

Understand users while they speak.

Agent Assist

Provide human agents with live transcript context.

Live Captions

Display spoken words as text.

Customer Support

Use speech as input to support workflows.

Call Routing

Route calls according to natural spoken requests.

Knowledge Retrieval

Turn the caller's speech into a query.

Real-Time Search

Search systems while the conversation continues.

Meetings

Create live meeting transcripts.

Voice Search

Let users speak queries.

Dictation

Convert speech directly into editable text.

Interactive AI

Send live human speech into an LLM or agent.

Built for production real-time transcription

Beyond amicrophone Demo

Production streaming transcription may need persistent connections, partial and final transcripts, telephonyaudio, multilingual recognition, speaker-aware workflows, and batch enrichment after the call.

  • WebSocket connections
  • Partial transcripts
  • Final transcripts
  • Low streaming latency
  • Live microphone audio
  • Telephony formats
  • μ-law
  • A-law
  • PCM
  • float32
  • Multilingual recognition
  • Automatic language detection
  • Code-switching
  • Speaker-aware workflows
  • Word timestamps
  • Voice-agent integration
  • Batch enrichment after the call
RequirementSupport
Real-time transcription
WebSocket
Partial Transcripts
Final Transcripts
Sub-500 ms Published Streaming Performance
int16 PCM
float32
μ-law
A-law
SIP / PSTN Workflow
8 kHz Telephony Workflow
Multilingual Recognition
Automatic Language Detection
Code-switch Platform
Speaker Diarization
Speaker Identification
Word Timestamps
Voice Agents
Agent Assist
Live Captions
Batch Post-call Intelligence
Live speechHorizonPartial + final transcriptYour application

Send live text into

  • Voice Agent
  • Agent Assist
  • Captions
  • Routing
  • Search
  • LLM
  • Application

Questions

Frequently Asked Questions

What is real-time transcription?

Real-time transcription converts live speech into text while the person is still speaking instead of waiting for a complete recording.

Does Shunya support real-time transcription?

Yes. Horizon supports WebSocket-based streaming automated speech recognition.

Does it return partial transcripts?

Yes. Partial or interim transcripts can be returned while speech continues.

Does it also return final transcripts?

Yes. Transcript segments are finalised as the speech progresses.

What is Shunya's published streaming performance?

Shunya publishes sub-500 ms streaming and first-token performance for current Horizon streaming workflows.

Does sub-500 ms mean the entire application always responds in under 500 ms?

No. End-to-end latency also depends on networking, client audio handling, downstream processing, and application architecture.

What API is used for real-time transcription?

Shunya uses a WebSocket streaming workflow for live speech.

Which live audio formats are documented?

Shunya documents int16 PCM, float32, μ-law, and A-law for live streaming.

Can it transcribe phone calls in real time?

Yes. Shunya explicitly supports live call transcription.

Does Shunya support μ-law?

Yes. G.711 μ-law is documented for native telephony streaming.

Does Shunya support A-law?

Yes. G.711 A-law is also documented.

What sample rate is documented for μ-law and A-law telephone audio?

Shunya documents an 8 kHz telephony workflow for these codecs.

Do I need to convert supported μ-law or A-law audio first?

For supported μ-law and A-law streaming frames, Shunya does not require a separate resampling or codec-conversion step before transmission.

Can real-time transcription be used for AI voice agents?

Yes. Voice agents are explicitly listed among streaming use cases.

Can it support agent assist?

Yes. Agent assist is explicitly listed.

Can it support live captions?

Yes. Live captions are explicitly listed.

Can it support call routing?

Yes. Call routing is explicitly listed as a real-time transcription use case.

Can it support knowledge retrieval?

Yes. The live transcript can be passed into a knowledge or search application.

Does Horizon support multiple languages in real time?

Horizon supports multilingual recognition across supported languages.

Can Shunya automatically detect the language?

Yes. Automatic language detection is supported when the language is not explicitly fixed.

Can it handle code-switched speech?

Horizon Code-Switch supports specialised workflows for supported mixed-language combinations.

Does every language pair work with Code-switch?

Not every language pair is supported. Verify the combination you need against your deployed configuration.

Can speaker diarization be used?

Speaker diarization is part of Shunya's transcription stack and can create speaker-labelled transcript segments.

Can known speakers be identified?

Registered speaker profiles can be used for speaker identification where configured.

Can I get word-level timestamps?

Yes. Verbose transcript output can include word-level timing and confidence.

Can intent be detected live during streaming?

Richer intelligence such as intent, sentiment, emotion, summary, and redaction is primarily available through batch and post-call workflows. Do not assume every enrichment is available live during streaming.

Can the same conversation be analysed after the call?

Yes. The completed recording can be processed through the batch workflow for richer conversation intelligence.

What is the difference between streaming and batch transcription?

Streaming processes live audio over WebSocket and returns partial and final transcripts. Batch processes completed recordings over HTTP and can include richer post-call intelligence.

Get started

Turn live speech into textwhile it Happens

Don't wait until the conversation is over. Stream microphone, application, or telephony audio into Horizon. Receive partialtranscripts while the speaker continues. Receive final transcripts as segments complete. Send that live text into a voiceagent, agent-assist tool, caption interface, search system, call router, or AI application.