Yazdi9/Talking_Face_Avatar
Yazdi9/Talking_Face_Avatar has 237 GitHub stars and 41 forks. GitHot measured 0 stars in 24 hours, 0 in 7 days, and 0 in 15 days. Last checked 2026-11-15 14:01 UTC. Last push 2024-08-18.
Measured star growth
- in 24h
- 0
- in 7 days
- 0
- in 15 days
- 0
- in 1 month
- Update delayed
Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.
About
Avatar Generation For Characters and Game Assets Using Deep Fakes
AIREADME.md
OriginalTalking Face Avatar: single portrait image From Leonardo.ai API ๐โโ๏ธ + audio From ElevenLabs TTS API ๐ค = talking head video ๐.
Leonardo.ai
Go To Leonardo.Ai And Enter your Prompt And Negative Prompts To Generate Artistic Images
Here Some Recources :Leonardo.ai Youtube Video Leonardo.ai Youtube Video Toutorial
or you can use APIs Leonardo.Ai API Guide
| Leonardo.ai Image Generation | Leonardo.ai Image Generation | Leonardo.ai Image Generation |
|
|
|
|
ElevenLabs
Go To Eleven Labs And Enter your Text And Generate Beautiful Audios With Diffrent Pitchs and Speeckers. ElvenLabs also is Multilingual
Here Some Recources :ElevenLabs Youtube Video
or you can use APIs ElevenLabs API Guide
๐ฅ Highlight
-๐ฅ Scroll To left and Right To See All Videos
| video 1 + enhancer(GFPGAN ) | video 2 | video 3 |
|---|---|---|
| video 4 | video 5 | video 6 |
|---|---|---|
- ๐ฅ Several new mode, eg,
still mode,reference mode,resize modeare online for better and custom applications.
Our Diagram Approach
Linux:
Installing anaconda, python and git.
Creating the env and install the requirements.
git clone https://github.com/saba99/Talking_Face_Avatar.git
cd SadTalker
conda create -n sadtalker python=3.8
conda activate sadtalker
pip install torch==1.12.1+cu113 torchvision==0.13.1+cu113 torchaudio==0.12.1 --extra-index-url https://download.pytorch.org/whl/cu113
conda install ffmpeg
pip install -r requirements.txt
### tts is optional for gradio demo.
### pip install TTS
UI + API:
look at index.html
๐ฅ 2. Download Trained Models.
You can run the following script to put all the models in the right place.
bash scripts/download_models.sh
Model Details
The final folder will be shown as:

Model explains:
| Model | Description |
|---|---|
| checkpoints/auido2exp_00300-model.pth | Pre-trained ExpNet in Sadtalker. |
| checkpoints/auido2pose_00140-model.pth | Pre-trained PoseVAE in Sadtalker. |
| checkpoints/mapping_00229-model.pth.tar | Pre-trained MappingNet in Sadtalker. |
| checkpoints/mapping_00109-model.pth.tar | Pre-trained MappingNet in Sadtalker. |
| checkpoints/facevid2vid_00189-model.pth.tar | Pre-trained face-vid2vid model from the reappearance of face-vid2vid. |
| checkpoints/epoch_20.pth | Pre-trained 3DMM extractor in Deep3DFaceReconstruction. |
| checkpoints/wav2lip.pth | Highly accurate lip-sync model in Wav2lip. |
| checkpoints/shape_predictor_68_face_landmarks.dat | Face landmark model used in dilb. |
| checkpoints/BFM | 3DMM library file. |
| checkpoints/hub | Face detection models used in face alignment. |
| gfpgan/weights | Face detection and enhanced models used in facexlib and gfpgan. |
๐ฎ 3. Quick Start (Best Practice).
WebUI Demos:
## you need manually install TTS(https://github.com/coqui-ai/TTS) via `pip install tts` in advanced.
python app.py
Manually usages:
Animating a portrait image from default config:
python inference.py --driven_audio <audio.wav> \
--source_image <video.mp4 or picture.png> \
--enhancer gfpgan
The results will be saved in results/$SOME_TIMESTAMP/*.mp4.
Full body/image Generation:
Using --still to generate a natural full body video. You can add enhancer to improve the quality of the generated video.
python inference.py --driven_audio <audio.wav> \
--source_image <video.mp4 or picture.png> \
--result_dir <a file to store results> \
--still \
--preprocess full \
--enhancer gfpgan
