|
| 1 | +# Background Speech Denoising, Cartesia Transcriber, Workflow Enhancements, and Call Error Handling |
| 2 | + |
| 3 | +1. **Background Speech Denoising Plan**: You can now enhance call quality by configuring advanced background speech denoising options using the new [`assistant.backgroundSpeechDenoisingPlan.smartDenoisingPlan`](https://api.vapi.ai/api#:~:text=SessionPaginatedResponse-,Assistant,-AssistantPaginatedResponse) (default: `false`), which replaces the previous `backgroundDenoisingEnabled` setting. |
| 4 | + |
| 5 | +<CardGroup cols={2}> |
| 6 | + <Card title="Enable Smart Denoising (Krisp)" icon="volume-up"> |
| 7 | + Use the `SmartDenoisingPlan` to filter out background speech and noise using [Krisp technology](https://krisp.ai/). |
| 8 | + </Card> |
| 9 | + <Card title="Customize Fourier Denoising" icon="sliders"> |
| 10 | + Fine-tune noise reduction with the new `FourierDenoisingPlan` for more control over audio clarity. |
| 11 | + </Card> |
| 12 | +</CardGroup> |
| 13 | + |
| 14 | +<Info> |
| 15 | + Smart and Fourier denoising can be combined for optimal results. Order of precedence: Smart denoising, then Fourier denoising. |
| 16 | +</Info> |
| 17 | + |
| 18 | +2. **Workflow Server Property**: Workflows now support a [`server`](https://api.vapi.ai/api#:~:text=TrieveKnowledgeBaseImport-,Workflow,-UpdateWorkflowDTO) property, allowing you to specify a server URL to receive webhook callbacks for workflow events directly. |
| 19 | + |
| 20 | +3. **New Workflow Models**: You can now integrate Google's LLMs or custom models into your workflows by specifying [`Google`](https://api.vapi.ai/api#:~:text=WorkflowGoogleModel) or [`Custom LLM`](https://api.vapi.ai/api#:~:text=WorkflowCustomModel) in your workflow model settings. Select your model under [Model Settings](https://dashboard.vapi.ai/workflows#:~:text=Model%20Settings) |
| 21 | + |
| 22 | +<Frame caption="Workflow Google Custom LLM"> |
| 23 | + <img src="../static/images/changelog/workflow-google-custom-llm.png" alt="Workflow Google Custom LLM" /> |
| 24 | +</Frame> |
| 25 | + |
| 26 | +4. **Enhanced Error Reporting for Cartesia Services**: A new `endedReason` value `pipeline-error-cartesia-502-server-error` has been added to help you identify and handle specific errors related to Cartesia server issues. |
| 27 | + |
| 28 | +5. **Enhanced Error Handling and Status Enums**: We've added new error enums and status codes to help you better handle and debug call-related issues: |
| 29 | + |
| 30 | + - **VAPI Fault Errors**: Detect specific VAPI-related errors during call start using `call.start.error-vapifault-get-org` and `call.start.error-vapifault-get-subscription` |
| 31 | + |
| 32 | + - **Subscription Status Errors**: Identify subscription-related issues with new enums: |
| 33 | + - `call.start.error-subscription-frozen` (replaces `unknown-error`) |
| 34 | + - `call.start.error-subscription-insufficient-credits` |
| 35 | + |
| 36 | + - **Call Completion Statuses**: Track how calls are completed with new enums: |
| 37 | + - `call.in-progress.twilio-completed-call` |
| 38 | + - `call.in-progress.sip-completed-call` |
| 39 | + |
| 40 | + - **In-Call Error Detection**: Handle specific errors during active calls using enums like `call.in-progress.error-vapifault-chat-pipeline-failed-to-start` |
0 commit comments