# AssemblyAI Docs ## Docs - [Changelog](https://assembly-preview.mintlify.app/changelog/changelog.md): Follow along to see weekly accuracy and product improvements. - [Automatically Generate Action Items From A Meeting With LeMUR](https://assembly-preview.mintlify.app/cookbooks/lemur/automatically-generate-action-items-from-a-meeting-with-lemur.md): Learn how to use AssemblyAI's LeMUR - [LeMUR](https://assembly-preview.mintlify.app/cookbooks/lemur/overview.md): Apply Large Language Models to spoken data. A Large Language Model (LLM) is a machine learning model that uses natural language processing (NLP) to generate text. LeMUR is a framework that lets you apply LLMs to audio transcripts, for example to ask questions about a call, or to summarize a meeting. - [Process Speaker Labels With LeMUR's Custom Text Input Parameter](https://assembly-preview.mintlify.app/cookbooks/lemur/process-speaker-labels-with-lemur.md): Utilize LeMUR feature - [Overview](https://assembly-preview.mintlify.app/cookbooks/overview.md) - [Library](https://assembly-preview.mintlify.app/cookbooks/search/data.md) - [Streaming SST](https://assembly-preview.mintlify.app/cookbooks/streaming-sst/overview.md): AssemblyAI's Streaming Speech-to-Text (STT) allows you to transcribe live audio streams with high accuracy and low latency. By streaming your audio data to our secure WebSocket API, you can receive transcripts back within a few hundred milliseconds. - [Separating Automatic Language Detection From Transcription](https://assembly-preview.mintlify.app/cookbooks/streaming-sst/separating-automatic-language-detection-from-transcription.md): Learn how to perform Automatic Language Detection - [Upload a media file](https://assembly-preview.mintlify.app/docs/api-reference/files/upload.md): Upload a media file to AssemblyAI's servers. - [Extract action items](https://assembly-preview.mintlify.app/docs/api-reference/lemur/action-items.md): Use LeMUR to generate a list of action items from a transcript - [Retrieve LeMUR response](https://assembly-preview.mintlify.app/docs/api-reference/lemur/get-response.md): Retrieve a LeMUR response that was previously generated. - [Purge LeMUR request data](https://assembly-preview.mintlify.app/docs/api-reference/lemur/purge-request-data.md): Delete the data for a previously submitted LeMUR request. The LLM response data, as well as any context provided in the original request will be removed. - [Ask questions using LeMUR](https://assembly-preview.mintlify.app/docs/api-reference/lemur/question-answer.md): Question & Answer allows you to ask free-form questions about a single transcript or a group of transcripts. The questions can be any whose answers you find useful, such as judging whether a caller is likely to become a customer or whether all items on a meeting's agenda were covered. - [Summarize a transcript using LeMUR](https://assembly-preview.mintlify.app/docs/api-reference/lemur/summary.md): Custom Summary allows you to distill a piece of audio into a few impactful sentences. You can give the model context to obtain more targeted results while outputting the results in a variety of formats described in human language. - [Run a task using LeMUR](https://assembly-preview.mintlify.app/docs/api-reference/lemur/task.md): Use the LeMUR task endpoint to input your own LLM prompt. - [Overview](https://assembly-preview.mintlify.app/docs/api-reference/overview.md): This page describes how to perform common operations with the REST API - [Create temporary authentication token for Streaming STT](https://assembly-preview.mintlify.app/docs/api-reference/streaming/create-temporary-token.md): Create a temporary authentication token for Streaming Speech-to-Text - [Streaming Speech-to-Text](https://assembly-preview.mintlify.app/docs/api-reference/streaming/realtime.md) - [Delete transcript](https://assembly-preview.mintlify.app/docs/api-reference/transcripts/delete.md): Remove the data from the transcript and mark it as deleted. - [Get transcript](https://assembly-preview.mintlify.app/docs/api-reference/transcripts/get.md): Get the transcript resource. The transcript is ready when the "status" is "completed". - [Get paragraphs in transcript](https://assembly-preview.mintlify.app/docs/api-reference/transcripts/get-paragraphs.md): Get the transcript split by paragraphs. The API will attempt to semantically segment your transcript into paragraphs to create more reader-friendly transcripts. - [Get redacted audio](https://assembly-preview.mintlify.app/docs/api-reference/transcripts/get-redacted-audio.md): Retrieve the redacted audio object containing the status and URL to the redacted audio. - [Get sentences in transcript](https://assembly-preview.mintlify.app/docs/api-reference/transcripts/get-sentences.md): Get the transcript split by sentences. The API will attempt to semantically segment the transcript into sentences to create more reader-friendly transcripts. - [Get subtitles for transcript](https://assembly-preview.mintlify.app/docs/api-reference/transcripts/get-subtitles.md): Export your transcript in SRT or VTT format to use with a video player for subtitles and closed captions. - [List transcripts](https://assembly-preview.mintlify.app/docs/api-reference/transcripts/list.md): Retrieve a list of transcripts you created. Transcripts are sorted from newest to oldest. The previous URL always points to a page with older transcripts. - [Transcribe audio](https://assembly-preview.mintlify.app/docs/api-reference/transcripts/submit.md): Create a transcript from a media file that is accessible via a URL. - [Search words in transcript](https://assembly-preview.mintlify.app/docs/api-reference/transcripts/word-search.md): Search through the transcript for keywords. You can search for individual words, numbers, or phrases containing up to five words or numbers. - [Audio Intelligence](https://assembly-preview.mintlify.app/docs/audio-intelligence/audio-intelligence.md): Learn about each of our Audio Intelligence models. - [Auto Chapters](https://assembly-preview.mintlify.app/docs/audio-intelligence/auto-chapters.md): The Auto Chapters model summarizes audio data over time into chapters. Chapters makes it easy for users to navigate and find specific information. - [Content Moderation](https://assembly-preview.mintlify.app/docs/audio-intelligence/content-moderation.md): The Content Moderation model lets you detect inappropriate content in audio files to ensure that your content is safe for all audiences. - [Entity Detection](https://assembly-preview.mintlify.app/docs/audio-intelligence/entity-detection.md): The Entity Detection model lets you automatically identify and categorize key information in transcribed audio content. - [Key Phrases](https://assembly-preview.mintlify.app/docs/audio-intelligence/key-phrases.md): The Key Phrases model identifies significant words and phrases in your transcript and lets you extract the most important concepts or highlights from your audio or video file. - [PII Redaction](https://assembly-preview.mintlify.app/docs/audio-intelligence/pii-redaction.md): The PII Redaction model lets you minimize sensitive information about individuals by automatically identifying and removing it from your transcript. - [Sentiment Analysis](https://assembly-preview.mintlify.app/docs/audio-intelligence/sentiment-analysis.md): The Sentiment Analysis model detects the sentiment of each spoken sentence in the transcript text. Use Sentiment Analysis to get a detailed analysis of the positive, negative, or neutral sentiment conveyed in the audio, along with a confidence score for each result. - [Summarization](https://assembly-preview.mintlify.app/docs/audio-intelligence/summarization.md): Distill important information by summarizing your audio files. - [Topic Detection](https://assembly-preview.mintlify.app/docs/audio-intelligence/topic-detection.md): The Topic Detection model lets you identify different topics in the transcript. The model uses the , a standardized language for content description which consists of 698 comprehensive topics. - [CLI](https://assembly-preview.mintlify.app/docs/concepts/cli.md): Get up and running with AssemblyAI's CLI - [Overview](https://assembly-preview.mintlify.app/docs/concepts/concepts.md) - [FAQ](https://assembly-preview.mintlify.app/docs/concepts/faq.md): Commonly asked questions - [Apply LLMs to audio files](https://assembly-preview.mintlify.app/docs/getting-started/apply-llms-to-audio-files.md): Learn how to leverage LLMs for speech using LeMUR. - [Getting started](https://assembly-preview.mintlify.app/docs/getting-started/getting-started.md): Get started using our SDKs. - [Supported Languages](https://assembly-preview.mintlify.app/docs/getting-started/supported-languages.md): Learn what languages are supported by AssemblyAI - [Transcribe an Audio File](https://assembly-preview.mintlify.app/docs/getting-started/transcribe-an-audio-file.md): Learn how to transcribe and analyze an audio file. - [Overview](https://assembly-preview.mintlify.app/docs/getting-started/transcribe-streaming-audio-from-a-microphone.md): Learn how to transcribe streaming audio from a microphone. - [Transcribe audio from a microphone in C#](https://assembly-preview.mintlify.app/docs/getting-started/transcribe-streaming-audio-from-a-microphone/csharp.md): Learn how to transcribe streaming audio in C#. - [Transcribe streaming audio from a microphone in Go](https://assembly-preview.mintlify.app/docs/getting-started/transcribe-streaming-audio-from-a-microphone/go.md): Learn how to transcribe streaming audio in Go. - [Transcribe streaming audio from a microphone in Java](https://assembly-preview.mintlify.app/docs/getting-started/transcribe-streaming-audio-from-a-microphone/java.md): Learn how to transcribe streaming audio in Java. - [Transcribe streaming audio from a microphone in Python](https://assembly-preview.mintlify.app/docs/getting-started/transcribe-streaming-audio-from-a-microphone/python.md): Learn how to transcribe streaming audio in Python. - [Transcribe streaming audio from a microphone in TypeScript](https://assembly-preview.mintlify.app/docs/getting-started/transcribe-streaming-audio-from-a-microphone/typescript.md): Learn how to transcribe streaming audio in TypeScript. - [Usage limits](https://assembly-preview.mintlify.app/docs/getting-started/usage-limits.md): To ensure a smooth experience for all users, certain operations have per-account usage limits. - [Webhooks](https://assembly-preview.mintlify.app/docs/getting-started/webhooks.md): Webhooks are custom HTTP callbacks that you can define to get notified when your transcripts are ready - [Home](https://assembly-preview.mintlify.app/docs/getting-started/welcome.md): Build with our leading Speech AI models - [Integrate Activepieces with AssemblyAI](https://assembly-preview.mintlify.app/docs/integrations/activepieces.md): Activepieces is an open-source, no-code automation platform that enables users to streamline workflows by connecting various applications and automating tasks. - [AWS](https://assembly-preview.mintlify.app/docs/integrations/aws.md) - [Cloudfare](https://assembly-preview.mintlify.app/docs/integrations/cloudflare.md) - [Overview](https://assembly-preview.mintlify.app/docs/integrations/community.md): Integrations built by the AssemblyAI community. Not supported by AssemblyAI. - [Bubble](https://assembly-preview.mintlify.app/docs/integrations/community/bubble.md) - [Pipedream](https://assembly-preview.mintlify.app/docs/integrations/community/pipedream.md) - [Relay](https://assembly-preview.mintlify.app/docs/integrations/community/relay.md) - [Retool](https://assembly-preview.mintlify.app/docs/integrations/community/retool.md) - [Haystack Integration for AssemblyAI](https://assembly-preview.mintlify.app/docs/integrations/haystack.md): Haystack (2.x) is an open-source Python framework for building custom LLM applications. The Haystack Integration for AssemblyAI seamlessly integrates with Haystack to use audio files in LLM pipelines. - [Overview](https://assembly-preview.mintlify.app/docs/integrations/integrations.md): Integrate AssemblyAI with your favorite tools and services. - [Overview](https://assembly-preview.mintlify.app/docs/integrations/langchain.md) - [🦜️🔗 LangChain JavaScript Integration with AssemblyAI](https://assembly-preview.mintlify.app/docs/integrations/langchain/js.md): To apply LLMs to speech, you first need to transcribe the audio to text, which is what the AssemblyAI integration for LangChain helps you with. - [🦜️🔗 LangChain Python Integration with AssemblyAI](https://assembly-preview.mintlify.app/docs/integrations/langchain/python.md): To apply LLMs to speech, you first need to transcribe the audio to text, which is what the AssemblyAI integration for LangChain helps you with. - [Overview](https://assembly-preview.mintlify.app/docs/integrations/llamaindex.md) - [LlamaIndex Python Integration with AssemblyAI](https://assembly-preview.mintlify.app/docs/integrations/llamaindex/python.md): You can use to transcribe audio files inside your LlamaIndex applications. - [LlamaIndex TypeScript Integration with AssemblyAI](https://assembly-preview.mintlify.app/docs/integrations/llamaindex/ts.md): You can use the AssemblyAI readers from LlamaIndex.TS to transcribe audio files inside your LlamaIndex applications. - [Integrate Make with AssemblyAI](https://assembly-preview.mintlify.app/docs/integrations/make.md): Make (formerly Integromat) is a workflow automation tool that lets you integrate various services together without requiring coding knowledge. - [The Postman collection for the AssemblyAI API](https://assembly-preview.mintlify.app/docs/integrations/postman.md): Postman is a user-friendly tool for testing API endpoints. The AssemblyAI API Postman collection contains all the HTTP requests you can make to the AssemblyAI API, so you don't need to write them yourself. - [Integrate Power Automate with AssemblyAI](https://assembly-preview.mintlify.app/docs/integrations/power-automate.md): Microsoft Power Automate is a low-code workflow automation platform with a rich collection of connectors to Microsoft's first-party services and third-party services. is the equivalent service built for developers and IT pros. - [Recall](https://assembly-preview.mintlify.app/docs/integrations/recall.md) - [AssemblyAI plugin for Rivet](https://assembly-preview.mintlify.app/docs/integrations/rivet.md): Rivet is an open-source visual AI programming environment. Through a collaboration between AssemblyAI and Rivet, you can use AssemblyAI speech-to-text and LeMUR capabilities in Rivet. - [Semantic Kernel Integration for AssemblyAI](https://assembly-preview.mintlify.app/docs/integrations/semantic-kernel.md): Semantic Kernel is an SDK for multiple programming languages to develop applications with . However, LLMs only operate on textual data and don't understand what is said in audio files. With the , you can use AssemblyAI's transcription models using the to transcribe your audio and video files. - [Integrate Twilio with AssemblyAI](https://assembly-preview.mintlify.app/docs/integrations/twilio.md): Twilio is a programmable communication platform for voice, messaging, and email. By combining Twilio with AssemblyAI, you can transcribe voice calls in , and voice recordings and voice messages . Combine transcription with our and to analyze the calls and messages. - [Zapier Integration with AssemblyAI](https://assembly-preview.mintlify.app/docs/integrations/zapier.md): Zapier is a workflow automation tool that lets you integrate various services together without requiring coding knowledge. You can use our AI models to process audio data by transcribing it with speech recognition models and analyzing it with audio intelligence models. You can supply audio to the As… - [Ask questions about your audio data](https://assembly-preview.mintlify.app/docs/lemur/ask-questions.md): In this guide, you'll learn how to use LeMUR to ask questions and get answers about your audio data. - [Change model and parameters](https://assembly-preview.mintlify.app/docs/lemur/customize-parameters.md): Learn how you can customize LeMUR parameters to alter the outcome. - [Create Custom LLM Prompts](https://assembly-preview.mintlify.app/docs/lemur/examples.md): Learn about different use cases for LeMUR with these examples. - [Prompt engineering](https://assembly-preview.mintlify.app/docs/lemur/improving-your-prompt.md): Learn how to get better results from by using prompting techniques to optimize your prompt. This page walks you through the parts of a prompt and gives you tips on how to use them to improve your prompts. - [Overview](https://assembly-preview.mintlify.app/docs/lemur/lemur.md): Apply Large Language Models to spoken data. A Large Language Model (LLM) is a machine learning model that uses natural language processing (NLP) to generate text. LeMUR is a framework that lets you apply LLMs to audio transcripts, for example to ask questions about a call, or to summarize a meeting. - [Summarize Your Audio Data](https://assembly-preview.mintlify.app/docs/lemur/summarize-audio.md): Learn how to summarize your audio using LeMUR - [Speaker Diarization](https://assembly-preview.mintlify.app/docs/speech-to-text/speaker-diarization.md): Learn how to detect multiple speakers in an audio - [Speech Recognition](https://assembly-preview.mintlify.app/docs/speech-to-text/speech-recognition.md): The Speech Recognition model enables you to transcribe spoken words into written text and is the foundation of all AssemblyAI products. - [Overview](https://assembly-preview.mintlify.app/docs/speech-to-text/speech-to-text.md): Convert spoken audio into text using our Speech-to-Text models. - [Streaming](https://assembly-preview.mintlify.app/docs/speech-to-text/streaming.md): Learn how to transcribe live audio streams - [Home](https://assembly-preview.mintlify.app/home.md) ## OpenAPI Specs - [openapi](https://assembly-preview.mintlify.app/openapi.yml) ## Optional - [Blog](https://www.assemblyai.com/blog) - [Playground](https://www.assemblyai.com/playground)