D-ID API 활용 방법

Getting Started 🎉 (d-id.com)

D-ID's API | Getting Started 🎉

 

D-ID는 AI를 활용하여 이미지, 아바타 등 가상 인물이 말하는 영상을 제작할 수 있는 프로그램입니다.

D-ID의 API를 활용하여 앱을 제작해 보겠습니다.

 

1. 동영상 생성 api

https://api.d-id.com/talks

(POST)

 

1-1. Header (api key)

Authorization : Basic Y2F...

 

1-2. Body

 

(기본 제공 음성)

{
   "script":{
      "type":"text",
      "input":"안녕하세요! 저는 AI 애비사네요. 저는 인공지능 챗봇이에요. 사용자를 도와주는 역할을 맡고 있는데요, 제 이름은 애비사입니다.",
      "provider":{
         "type":"microsoft",
         "voice_id":"ko-KR-SunHiNeural"
      }
   },
   "source_url":"https://i.ibb.co/Qbm1KXY/15.png",
  "config": {
    "driver_expressions": {
      "expressions": [
        {
          "start_frame": 0,
          "expression": "surprise",
          "intensity": 1
        }
      ]
    }
  }
}

 

(사용자 업로드 음성)

{
  "script": {
    "type": "audio",
    "input": "안녕하세요 저는 D-ID를 사용하여 생성된 AI입니다.",
    "provider" : {
        "type" : "microsoft",
        "voice_id" : "ko-KR-SeoHyeonNeural"
    },
    //오디오 URL
     "audio_url": "https://blog.kakaocdn.net/dn/I98Pg/btsBl7hbLiY/qYErXtxQDCXApI3FTC4qkK/%ED%85%8C%EC%8A%A4%ED%8A%B8%20%281%29.mp3?attach=1&knm=tfile.mp3"
  },
  "source_url" : "https://i.ibb.co/Qbm1KXY/15.png", //이미지 URL
  "config": {
    "driver_expressions": {
      "expressions": [
        {
          "start_frame": 0,
          "expression": "surprise", //감정
          "intensity": 1
        }
      ]
    }
  }
}

 

return -> 동영상 생성 ID

{
    "id": "tlk_zMgQmxi1lV41Ch_lW8JyF",
    "created_at": "2024-01-28T10:39:26.539Z",
    "created_by": "google-oauth2|115954332120528488258",
    "status": "created",
    "object": "talk"
}

 

2. 동영상 불러오기 api

https://api.d-id.com/talks/tlk_cepmQJPv88CSwoUfEzERr

(GET) https://api.d-id.com/talks/ + 동영상 생성 ID

 

2-1. Header (api key)

Authorization : Basic Y2F...

 

return -> 동영상 url

{
    "user": {
        "features": [
            "stitch",
            "clips:write",
            null
        ],
        "stripe_plan_group": "deid-trial",
        "authorizer": "basic",
        "owner_id": "google-oauth2|115954332120528488258",
        "id": "google-oauth2|115954332120528488258",
        "plan": "deid-trial",
        "email": "lcstudio.italk@gmail.com"
    },
    "script": {
        "length": 71,
        "ssml": false,
        "subtitles": false,
        "type": "text",
        "provider": {
            "type": "microsoft",
            "voice_id": "ko-KR-SunHiNeural"
        }
    },
    "metadata": {
        "driver_url": "bank://natural/driver-7/original",
        "mouth_open": false,
        "num_faces": 1,
        "num_frames": 309,
        "processing_fps": 63.556014548362526,
        "resolution": [
            512,
            512
        ],
        "size_kib": 2441.8134765625
    },
    "audio_url": "https://d-id-talks-prod.s3.us-west-2.amazonaws.com/google-oauth2%7C115954332120528488258/tlk_zMgQmxi1lV41Ch_lW8JyF/microsoft.wav?AWSAccessKeyId=AKIA5CUMPJBIK65W6FGA&Expires=1706524766&Signature=5JYPuuBZB%2BrTvkPOvTXWgvLJyRA%3D&X-Amzn-Trace-Id=Root%3D1-65b62edc-2543244716db89ed39989c1d%3BParent%3D6f3ce115491bf772%3BSampled%3D0%3BLineage%3Da08e19fe%3A0",
    "created_at": "2024-01-28T10:39:26.539Z",
    "face": {
        "mask_confidence": -1,
        "detection": [
            538,
            173,
            728,
            425
        ],
        "overlap": "no",
        "size": 367,
        "top_left": [
            449,
            115
        ],
        "face_id": 0,
        "detect_confidence": 0.9976677298545837
    },
    "config": {
        "stitch": false,
        "align_driver": true,
        "sharpen": true,
        "normalization_factor": 1,
        "result_format": ".mp4",
        "fluent": false,
        "driver_expressions": {
            "expressions": [
                {
                    "intensity": 1,
                    "start_frame": 0,
                    "expression": "surprise"
                }
            ],
            "transition_frames": 50
        },
        "pad_audio": 0,
        "reduce_noise": false,
        "auto_match": true,
        "show_watermark": true,
        "motion_factor": 1,
        "align_expand_factor": 0.3
    },
    "source_url": "https://d-id-talks-prod.s3.us-west-2.amazonaws.com/google-oauth2%7C115954332120528488258/tlk_zMgQmxi1lV41Ch_lW8JyF/source/15.png?AWSAccessKeyId=AKIA5CUMPJBIK65W6FGA&Expires=1706524766&Signature=TDcj4iLFfYAMVdV0oUo8v03dzps%3D&X-Amzn-Trace-Id=Root%3D1-65b62edc-2543244716db89ed39989c1d%3BParent%3D6f3ce115491bf772%3BSampled%3D0%3BLineage%3Da08e19fe%3A0",
    "created_by": "google-oauth2|115954332120528488258",
    "status": "done",
    "driver_url": "bank://natural/",
    "modified_at": "2024-01-28T10:39:32.712Z",
    "user_id": "google-oauth2|115954332120528488258",
    "subtitles": false,
    "id": "tlk_zMgQmxi1lV41Ch_lW8JyF",
    "duration": 13,
    "started_at": "2024-01-28T10:39:26.586",
    "result_url": "https://d-id-talks-prod.s3.us-west-2.amazonaws.com/google-oauth2%7C115954332120528488258/tlk_zMgQmxi1lV41Ch_lW8JyF/1706438366539.mp4?AWSAccessKeyId=AKIA5CUMPJBIK65W6FGA&Expires=1706524772&Signature=TBu39l0W9UFug7XQZD3nZoB%2B3GI%3D&X-Amzn-Trace-Id=Root%3D1-65b62ee4-0df0c98e4aa77ca35d4463eb%3BParent%3Df2c417b3bcb87025%3BSampled%3D1%3BLineage%3D6b931dd4%3A0"
}

 

3. 동영상 완성

4. 비슷한 서비스

https://huggingface.co/spaces/vinthony/SadTalker

SadTalker - a Hugging Face Space by vinthony