Spline
Talk to salesStart building

Build an AI Voice Assistant in 3D

Lesson 9 of 17Spline 3DAdvanced13 min

Hello everyone! This tutorial will demonstrate how to create an AI voice assistant by combining Spline's latest feature set with OpenAI's real-time API. We'll start by designing a basic 3D avatar and then connect it to OpenAI's API for real-time voice responses.

Note: Enter your OpenAI API key and ensure the developer account has sufficient credit balance to use the OpenAI API.

AI Voice Assistant API Documentation: https://docs.spline.design/doc/ai-voice-assistant-api/doczANMXu23U

Demos: Blue Face (Morph Targets): https://app.spline.design/file/87ee7a9c-fa51-4ac0-a45c-a52b410a906b Cookie Monster: https://app.spline.design/file/b1e09258-ccd1-4e19-a1e1-6378bd196dca Sphere: https://app.spline.design/file/31161d1b-6415-44ef-a026-f7241c0db963

-

Discover more amazing creators and projects #MadeInSpline at https://community.spline.design/ ---

What you’ll learn

  1. 0:00Intro
  2. 0:36Tips for Designing a Simple 3D Assistant Avatar
  3. 1:59AI Voice Assistant feature
  4. 3:08How to get your API Key
  5. 3:49Creating a new AI Voice Assistant API
  6. 4:32Make your 3D virtual assistant face your cursor - Look At Event
  7. 5:10AI Assistant Listener and AI Voice Spectrum
  8. 7:33Personalizing the Voice
  9. 8:36Implementing Triggers for Specific Actions
  10. 10:29Morph Targets
  11. 12:36Ending

Related resources