Wav2Lip Video Generation Pipeline

🔥 Features

🛠️ Setup

1. Clone the Repository

git clone https://github.com/your-bchachar/lip_sync_video_generator.git
cd lip_sync_video_generator

2. Set Up Python Virtual Environment (Recommended)

python3 -m venv .venv
source .venv/bin/activate  # On Windows: .venv\Scripts\activate

3. Install Dependencies

pip install -r requirements.txt

4. Download Required Models

git clone https://github.com/Rudrabha/Wav2Lip.git

⚙️ How It Works

🚀 Usage

Run the full pipeline:

python main.py

🐞 Common Issues & Fixes

1. CUDA error: no kernel image is available for execution on the device

pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121

2. invalid load key, '<' or TorchScript Errors

3. Image too big to run face detection on GPU

4. Output video not found

📁 Project Structure

.
├── Wav2Lip
│   ├── checkpoints
│   │   └── wav2lip.pth
├── audio
│   └── output.wav
├── images
│   └── sample.jpg
├── video
│   └── result_voice.mp4
├── generate_lipsync_video.py
└── requirements.txt

📜 License

🙏 Acknowledgements