What's changed: Added per-section figures (cert-figure-retrofit). Added a speech section (s3) to AI-103 Chapter 5 (the official text-analysis domain’s "speech" sub-area = STT/TTS, speech as agent modality, custom speech / custom neural voice, multimodal reasoning from audio, speech translation). Existing s1 (Azure AI Language) and s2 (translation/custom language models) preserved non-destructively
5.3Implementing Speech Solutions
Covers "speech," part of the official text-analysis domain. Understand—from a developer’s view—speech-to-text/text-to-speech (STT/TTS) with Azure AI Speech, speech as an agent modality with custom speech, multimodal reasoning from audio, and speech translation.
The official "text analysis" domain also includes speech. Azure AI Speech (in Foundry Tools) meets needs like operating a conversational agent by voice or transcribing meetings from audio. Developers call STT/TTS APIs and, when needed, integrate speech as an agent modality.
5.3.1Speech ↔ text (STT / TTS)
There are two directions. Speech-to-text (STT) converts spoken audio into text (transcription, voice input). Text-to-speech (TTS) converts text into audio (read-aloud, voice responses). For a voice-driven agent, transcribe the user with STT → process with the model/agent → speak the response with TTS, making speech the input/output modality.
5.3.2Speech as an agent modality and custom speech
Continue reading — free sign-up
You're reading the free preview. Sign up free to read this section in full, plus every chapter (including 4+) and all questions.