Spline
Talk to salesStart building

Build an AI Voice Assistant in 3D

Spline 3DAdvanced13 min

Hello everyone! This tutorial will demonstrate how to create an AI voice assistant by combining Spline's latest feature set with OpenAI's real-time API. We'll start by designing a basic 3D avatar and then connect it to OpenAI's API for real-time voice responses.

Note: Enter your OpenAI API key and ensure the developer account has sufficient credit balance to use the OpenAI API.

AI Voice Assistant API Documentation: https://docs.spline.design/doc/ai-voice-assistant-api/doczANMXu23U

Demos: Blue Face (Morph Targets): https://app.spline.design/file/87ee7a9c-fa51-4ac0-a45c-a52b410a906b Cookie Monster: https://app.spline.design/file/b1e09258-ccd1-4e19-a1e1-6378bd196dca Sphere: https://app.spline.design/file/31161d1b-6415-44ef-a026-f7241c0db963

-

Discover more amazing creators and projects #MadeInSpline at https://community.spline.design/ ---

What you’ll learn

  1. 0:00Intro
  2. 0:36Tips for Designing a Simple 3D Assistant Avatar
  3. 1:59AI Voice Assistant feature
  4. 3:08How to get your API Key
  5. 3:49Creating a new AI Voice Assistant API
  6. 4:32Make your 3D virtual assistant face your cursor - Look At Event
  7. 5:10AI Assistant Listener and AI Voice Spectrum
  8. 7:33Personalizing the Voice
  9. 8:36Implementing Triggers for Specific Actions
  10. 10:29Morph Targets
  11. 12:36Ending

Related resources

Related tutorials

All tutorials
Embed Interactive 3D Scenes into Wix Websites

Spline 3DBeginner5 min

Add Look At Animations to 3D Objects

Spline 3DBeginner10 min

Create an Interactive 3D Character using Variables

Spline 3DAdvanced17 min