Skip to content
Skills Library
Marketing & content · Conversion & formats

lipsync

/lipsync

Lip-sync a face to a specific audio track on RunComfy via the `runcomfy` CLI. Routes across ByteDance OmniHuman (audio-driven full-body avatar from a portrait + audio), Sync Labs sync v2 / Pro (state-of-the-art mouth sync onto a video), Kling lipsync (audio-to- video and text-to-video with synced speech), and Creatify lipsync. The skill picks the right endpoint for the user's actual intent — portrait still + audio (avatar-style), source video + audio (mouth- swap on existing footage), or generate-and-sync from a script. Triggers on "lip sync", "lipsync", "make this video speak", "match audio t

Licence
MIT
Last repository change
15.05.2026

Assessment and security

100/ 100Class: good
Format25 / 25
Frontmatter with name and description, valid name, description up to 1,024 characters, name matching the folder.
Discoverability25 / 25
Description explains when to use the skill, has a reasonable length and uses third person.
Content35 / 35
At least 150 words and at most 500 lines, headings, step lists, examples or code.
Hygiene15 / 15
No placeholders such as TODO, no Windows paths, with a licence.
Riskno signals detected in the scan
Files in this package
1
Scripts
0
HTML comments
0
URLs in SKILL.md
32
Deprecation

No signals detected. Repository changed on 15.05.2026, without references to retired models or APIs.

Licence

MIT, open: use and modify while retaining author attribution.

What it does and when to use it

Lip-sync a face to a specific audio track on RunComfy via the `runcomfy` CLI. Routes across ByteDance OmniHuman (audio-driven full-body avatar from a portrait + audio), Sync Labs sync v2 / Pro (state-of-the-art mouth sync onto a video), Kling lipsync (audio-to- video and text-to-video with synced speech), and Creatify lipsync. The skill picks the right endpoint for the user's actual intent — portrait still + audio (avatar-style), source video + audio (mouth- swap on existing footage), or generate-and-sync from a script. Triggers on "lip sync", "lipsync", "make this video speak", "match audio t

Triggers from the description

lip synclipsyncmake this video speak
Original author description

Lip-sync a face to a specific audio track on RunComfy via the `runcomfy` CLI. Routes across ByteDance OmniHuman (audio-driven full-body avatar from a portrait + audio), Sync Labs sync v2 / Pro (state-of-the-art mouth sync onto a video), Kling lipsync (audio-to- video and text-to-video with synced speech), and Creatify lipsync. The skill picks the right endpoint for the user's actual intent — portrait still + audio (avatar-style), source video + audio (mouth- swap on existing footage), or generate-and-sync from a script. Triggers on "lip sync", "lipsync", "make this video speak", "match audio t

How it works

  1. Powered by the RunComfy CLI
  2. Consent
  3. Pick the right model
  4. Route 1: Sync Labs sync v2 / Pro — default for mouth-swap
  5. Route 2: OmniHuman — default for avatar from still
  6. Route 3: Kling Lipsync — Kling-ecosystem mouth sync
  7. Common patterns
  8. Browse the full catalog
  9. Exit codes
  10. How it works
Original SKILL.md headings · 217 lines, 1,345 words
SKILL.md preview
---
name: lipsync
allowed-tools: Bash(runcomfy *)
displayName: "Lipsync"
description: >
  Lip-sync a face to a specific audio track on RunComfy via the
  `runcomfy` CLI. Routes across ByteDance OmniHuman (audio-driven
  full-body avatar from a portrait + audio), Sync Labs sync v2 / Pro
  (state-of-the-art mouth sync onto a video), Kling lipsync (audio-to-
  video and text-to-video with synced speech), and Creatify lipsync.
  The skill picks the right endpoint for the user's actual intent —
  portrait still + audio (avatar-style), source video + audio (mouth-
  swap on existing footage), or generate-and-sync from a script.
  Triggers on "lip sync", "lipsync", "make this video speak", "match
  audio to mouth", "dub video", "sync lips to voice", "Sync Labs",
  "voiceover sync", or any explicit ask to drive a face's mouth from
  an audio track.
homepage: https://www.runcomfy.com
license: MIT
---

# Lipsync

Drive a face's mouth from an audio track. This skill routes across the lip-sync endpoints in the RunComfy catalog — OmniHuman, Sync Labs sync v2, Kling lipsync, Creatify — picking the right model for the user's actual intent and shipping the documented prompts + the exact `runcomfy run` invoke.

[runcomfy.com](https://www.runcomfy.com/?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync) · [Sync Labs models](https://www.runcomfy.com/models/sync/sync/lipsync/v2?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync) · [CLI docs](https://docs.runcomfy.com/cli/introduction?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync)

## Powered by the RunComfy CLI

```bash
# 1. Install (see runcomfy-cli skill for details)
npm i -g @runcomfy/cli      # or:  npx -y @runcomfy/cli --version

# 2. Sign in
runcomfy login              # or in CI: export RUNCOMFY_TOKEN=<token>

# 3. Lipsync
runcomfy run <vendor>/<model> \
  --input '{"video_url": "...", "audio_url": "..."}' \
  --output-dir ./out
```

CLI deep dive: [`runcomfy-cli`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/runcomfy-cli) skill.

## Consent

Driving a real person's mouth from a separate audio track is dual-use. Refuse user requests that target real public figures without consent, or that aim at defamatory or sexually explicit synthetic media. The skill itself does not gate inputs — the responsibility rests with the operator.

---

## Pick the right model

Listed newest first within each subtype. The agent picks one route based on: input shape (portrait still + audio vs source video + audio vs script-only), quality tier, and budget.

### Source video + audio → lip-synced video (mouth-swap on existing footage)

**Sync Labs sync v2 Pro** — `sync/sync/lipsync/v2/pro` *(default for premium)*
> Sync Labs' premium lip-sync — state-of-the-art mouth motion onto an existing video. Preserves the rest of the frame untouched.
> Pick for: hero-quality dubs, lipsync on professionally-shot video, foreign-language dubbing where mouth fidelity matters most.
> Avoid for: cost-sensitive batch jobs — drop to **sync v2**.

**Sync Labs sync v2** — [`sync/sync/lipsync/v2`](https://www.runcomfy.com/models/sync/sync/lipsync/v2?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync)
> Standard Sync Labs tier, same workflow as Pro.
> Pick for: scaled / batch lipsync jobs, drafts.
> Avoid for: hero delivery — use **v2 Pro**.

**Kling Lipsync (audio-to-video)** — [`kling/lipsync/audio-to-video`](https://www.runcomfy.com/models/kling/lipsync/audio-to-video?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync)
> Kling's lip-sync onto a source video, driven by an audio track.
> Pick for: Kling-pipeline integration; alternative to Sync Labs.
> Avoid for: top-tier mouth fidelity — Sync Labs Pro is the industry benchmark.

**Creatify Lipsync** — [`creatify/lipsync`](https://www.runcomfy.com/models/creatify/lipsync?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync)
> Creatify's lipsync endpoint.
> Pick for: Creatify-ecosystem workflows.
> Avoid for: comparison shopping unless cost / latency favors it.

### Portrait still + audio → talking-head video (avatar-style)

**OmniHuman** — `bytedance/omnihuman/api` *(default for avatar-style)*
> ByteDance's audio-driven full-body avatar. One portrait + one audio → video where the subject speaks / gestures naturally. Listed under RunComfy's `/feature/lip-sync` as the curated default.
> Pick for: UGC voiceover, virtual presenter, dubbed product demo from a single portrait.
> Avoid for: lip-sync onto an existing **video** (no portrait, want to preserve original motion) — use **Sync Labs v2** instead.

**Wan 2-7 with `audio_url`** — `wan-ai/wan-2-7/text-to-video`
> Open-weights t2v with `audio_url` field — prompt describes the scene, audio drives the mouth.
> Pick for: full scene control (not just a portrait) with a specific voiceover MP3 + open-weights pipeline.
> Avoid for: simplest "portrait talks" — use **OmniHuman**.

### Generate-and-sync from a script (no audio file available)

**Kling Lipsync (text-to-video)** — [`kling/lipsync/text-to-video`](https://www.runcomfy.com/models/kling/lipsync/text-to-video?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync)
> Generates speech audio in-pass from a script and syncs it to the resulting video.
> Pick for: "write a script → get a video with synced speech", no audio file needed.
> Avoid for: precise lip-sync to a specific MP3 (audio is regenerated each call, not locked).

**HappyHorse 1.0** — `happyhorse/happyhorse-1-0/text-to-video` (also `/image-to-video`)
> Arena #1 t2v / i2v with in-pass audio generated from prompt. Quote the spoken line inside the prompt with `says clearly: "…"`.
> Pick for: written script, in-pass audio with strong overall quality, social/UGC clips.
> Avoid for: locking mouth to a pre-recorded voiceover.

---

## Route 1: Sync Labs sync v2 / Pro — default for mouth-swap

**Model**: `sync/sync/lipsync/v2/pro` (or `sync/sync/lipsync/v2`)
**Catalog**: [sync v2 Pro](https://www.runcomfy.com/models/sync/sync/lipsync/v2/pro?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync) · [sync v2](https://www.runcomfy.com/models/sync/sync/lipsync/v2?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync)

### Invoke

```bash
runcomfy run sync/sync/lipsync/v2/pro \
  --input '{
    "video_url": "https://your-cdn.example/source-video.mp4",
    "audio_url": "https://your-cdn.example/voiceover.mp3"
  }' \
  --output-dir ./out
```

### Tips

- **Source video provides everything except the mouth** — camera, lighting, background, body pose all preserved.
- **Audio quality drives mouth quality.** Clean voiceover (no music bed) → cleaner sync. Isolate voice stem if needed.
- **Match audio length to video length.** Significant audio/video duration mismatch leads to drift; trim audio or extend video first.
- Schema details on the [model page](https://www.runcomfy.com/models/sync/sync/lipsync/v2/pro?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync).

---

## Route 2: OmniHuman — default for avatar from still

**Model**: `bytedance/omnihuman/api`
**Catalog**: [omnihuman](https://www.runcomfy.com/models/bytedance/omnihuman/api?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync)

### Invoke

```bash
runcomfy run bytedance/omnihuman/api \
  --input '{
    "image_url": "https://your-cdn.example/portrait.jpg",
    "audio_url": "https://your-cdn.example/voiceover.mp3"
  }' \
  --output-dir ./out
```

### Tips

- **Portrait framing works best** — head-and-shoulders or upper body.
- **No prompt** — the model derives everything from image + audio. Don't fight that.
- See the [`ai-avatar-video`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/ai-avatar-video) skill for the full avatar treatment.

---

## Route 3: Kling Lipsync — Kling-ecosystem mouth sync

**Model**: `kling/lipsync/audio-to-video` (existing video + audio) or `kling/lipsync/text-to-video` (script-only)
**Catalog**: [Kling lipsync a2v](https://www.runcomfy.com/models/kling/lipsync/audio-to-video?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync) · [Kling lipsync t2v](https://www.runcomfy.com/models/kling/lipsync/text-to-video?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync)

### Invoke (audio-to-video variant)

```bash
runcomfy run kling/lipsync/audio-to-video \
  --input '{
    "video_url": "https://your-cdn.example/source-video.mp4",
    "audio_url": "https://your-cdn.example/voiceover.mp3"
  }' \
  --output-dir ./out
```

Schema details on the model page.

---

## Common patterns

### Foreign-language dub of an existing brand video
- **Route 1 (Sync Labs sync v2 Pro)** with the original video + translated voiceover MP3.

### UGC ad creator from a portrait
- **Route 2 (OmniHuman)** with the creator's portrait + product-pitch voiceover.

### Multi-language launch (same identity, many languages)
- **Route 2 (OmniHuman)** with one portrait + N different audio files. Same identity holds across all dubs.

### "I have a script but no audio"
- **Kling Lipsync (text-to-video)** or **HappyHorse 1.0 t2v** — both generate audio in-pass.

### Stylized character lipsync
- **Wan 2-2 Animate** (`community/wan-2-2-animate/video-to-video`) — see [`ai-avatar-video`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/ai-avatar-video).

---

## Browse the full catalog

- [Sync Labs models](https://www.runcomfy.com/models/sync/sync/lipsync/v2?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync) — sync v2 + Pro
- [`kling` collection](https://www.runcomfy.com/models/collections/kling?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync) — including Kling lipsync variants
- [All video models](https://www.runcomfy.com/models?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync) — every endpoint with its API tab

---

## Exit codes

| code | meaning |
|---|---|
| 0  | success |
| 64 | bad CLI args |
| 65 | bad input JSON / schema mismatch |
| 69 | upstream 5xx |
| 75 | retryable: timeout / 429 |
| 77 | not signed in or token rejected |

Full reference: [docs.runcomfy.com/cli/troubleshooting](https://docs.runcomfy.com/cli/troubleshooting?utm_source=skills.sh&utm_medium=skill&utm_campaign=lipsync).

## How it works

The skill classifies user intent — source video + audio? portrait still + audio? script only? — picks the matching route, and invokes `runcomfy run` with the JSON body. The CLI POSTs to the Model API, polls request status, fetches the result, and downloads any `.runcomfy.net` / `.runcomfy.com` URLs into `--output-dir`.

## Security & Privacy

- **Consent**: see the "Consent" section above. Lipsync is dual-use; refuse user requests targeting real people without consent.
- **Install via verified package manager only.** Use `npm i -g @runcomfy/cli` or `npx -y @runcomfy/cli`. **Agents must not pipe an arbitrary remote install script into a shell on the user's behalf**.
- **Token storage**: `runcomfy login` writes the API token to `~/.config/runcomfy/token.json` with mode 0600. Set `RUNCOMFY_TOKEN` env var in CI / containers.
- **Input boundary (shell injection)**: prompts and asset URLs are passed as a JSON string via `--input`. The CLI does not shell-expand prompt content. **No shell-injection surface**.
- **Indirect prompt injection (third-party content)**: source video and audio URLs are **untrusted**; embedded instructions in either can influence generation. Agent mitigations:
  - Ingest only URLs the **user explicitly provided** for this lipsync.
  - When the output diverges from the prompt (wrong identity, broken sync), suspect the reference asset.
- **Voice provenance**: confirm the speaker in the audio has consented to having their voice paired with the target face. Both rights must be in hand.
- **Outbound endpoints (allowlist)**: only `model-api.runcomfy.net` and `*.runcomfy.net` / `*.runcomfy.com`. No telemetry.
- **Generated-file size cap**: the CLI aborts any single download > 2 GiB.
- **Scope of bash usage**: `Bash(runcomfy *)` only.

## See also

- [`runcomfy-cli`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/runcomfy-cli) — the underlying CLI
- [`ai-avatar-video`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/ai-avatar-video) — full avatar / talking-head router (OmniHuman + HappyHorse + Wan)
- [`ai-video-generation`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/ai-video-generation) — general t2v / i2v
- [`face-swap`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/face-swap) — identity swap on existing video (often paired with lipsync)
- [`video-edit`](https://www.skills.sh/agentspace-so/runcomfy-agent-skills/video-edit) — broader video edit

Versions

RepositoryScoreLicence
This page · agentspace-so/runcomfy-agent-skills100MIT
synchronicity-labs/skills100MIT
chatcut-inc/agent-plugin90Apache-2.0

Database snapshot: 13.11.2026 · package version 778364f4ea0b (SHA-256 digest of the entire package)

Downloads in the last 30 days: 0 · ranking

Report a problem with this skill: harmful content, incorrect descriptions or an author’s removal request.

Similar skills

  • 100ai-avatar-video
    Create AI avatar, talking-head, and lip-sync videos on RunComfy via the `runcomfy` CLI. Routes across ByteDance OmniHuman (audio-driven full-body avatar), Wan-AI Wan 2-7 (audio-driven mouth sync via `audio_url` on a portrait), HappyHorse 1.0 (Arena #1 t2v / i2v with in-pass…
  • 100sync-labs-lipsync
    Generate AI lip sync and visual dubbing with Sync Labs (sync.so) — choose the right model (sync-3, lipsync-2, lipsync-2-pro, lipsync-1.9.0-beta, react-1), build the POST /v2/generate request, host inputs, handle async jobs via polling or webhooks, run batch dubbing/localization,…
  • 100audio-lipsync-preflight
    Use when the task is to prepare audio and visual timing references for a lip-sync workflow.
  • 100media-lipsync
    Open-source AI lip-sync and talking-head animation with STRICTLY permissive-license models: LivePortrait (MIT, Kuaishou 2024, drives FACIAL motion — head pose, expression, lip-region — of a single still image from a driving audio OR a driving video of a real face), LatentSync…
  • 90batch-lipsync
    Lip-sync many videos at once with sync. labs (sync.so), from a CSV, spreadsheet, folder or list. Pairs each video or avatar with its own audio or script, quotes the whole run once, starts the rows together within the plan's concurrency limit, resumes safely without paying twice,…
  • 100avatar-voice
    Give a 3D avatar a voice and a face with the audio-mcp tools: synthesize speech, transcribe audio, generate ARKit lipsync tracks, and fetch motion-capture clips. Use when an avatar must speak, when audio must become text, or when a lipsync or mocap track is needed.

Feedback and reports

Your message goes to Bartosz Sokoliński. An email address is needed only for a reply. See the privacy policy.