Присоединяйтесь к Сэп Libre проект с открытым исходным кодом на BotLibre.org
Bot Libre Dev

Playing audio and lip sync

по golam.sarower опубликовано Apr 12 2016, 1:32

There are avatars and BOT. So far BOT is for chatting and Avatar is kind of animation. With the avatar it should be possible to play audio sound with lip sync.

What kind of API support is there to achieve this in IOS and Java?


by admin posted Apr 12 2016, 9:18
The avatars normally use our Text To Speech support for speech (or native TTS in HTML5, Android, and iOS).

You can also associate audio files for actions and poses.

We do not have support for associating real speech audio files with responses yet, but that is something we plan on. Currently if you have your own speech audio files you can use our SDK to have an avatar simulate speaking them. You can copy the SDK source code that uses our TTS audio and insert your own speech audio. You will need to code this yourself.

Thumbs up: 0, thumbs down: 0, stars: 0.0
Views: 1870, today: 4, week: 8, month: 18

by golam.sarower posted Apr 26 2016, 23:51

Currently if you have your own speech audio files you can use our SDK to have an avatar simulate speaking them. You can copy the SDK source code that uses our TTS audio and insert your own speech audio.

-> Could you please let me know in which file / class we can insert our own audio files?

You can copy the SDK source code that uses our TTS audio and insert your own speech audio.

-> So far, in Java SDK source code I did not find any such place to insert own audio. What I have found in the sample application that it plays the audio file returned from server in default player and the video of the avatar in media player in Android. According to the sample the video is looping until the audio is finished.

Could you please clarify this!


Thumbs up: 0, thumbs down: 0, stars: 0.0
Views: 1960, today: 4, week: 8, month: 25

by admin posted Apr 27 2016, 6:28
Which SDK are you using, JavaScript, Android, or iOS?

Thumbs up: 0, thumbs down: 0, stars: 0.0
Views: 1500, today: 4, week: 8, month: 15

by golam.sarower posted Apr 28 2016, 0:47

Actually we are investigating Java SDK for Android / Java app and JavaScript both SDK.


Thumbs up: 0, thumbs down: 0, stars: 0.0
Views: 1722, today: 4, week: 8, month: 20

by admin posted Apr 28 2016, 7:55
There is no support in the SDK for playing your own audio file.
You will need to modify the code, or subclass the class and overwrite the code playing the audio and switch it to use your own audio file.

Thumbs up: 0, thumbs down: 0, stars: 0.0
Views: 1625, today: 5, week: 9, month: 20

Идентификатор: 12538601
Опубликовано: Apr 12 2016, 1:32
Ответы: 5
Вид: 3149, сегодня: 5, неделю: 9, месяц: 32
Я уверен, что
Вывесить флаг как оскорбительное, или в нарушение правил сайта