Skip to content
Skills Library
AI & agents · Automation

fastgen-runtime

/fastgen-runtime

Resolve the execution context for an NVIDIA FastGen command: checkout and interpreter, config path and override syntax, output/cache/data roots, run identity, and distributed launch variables. Use it when preparing or debugging execution; method selection belongs to fastgen-configure.

Repository
skills ↗
Licence
Apache-2.0
Last repository change
12.11.2026

Assessment and security

86/ 100Class: good
Format25 / 25
Frontmatter with name and description, valid name, description up to 1,024 characters, name matching the folder.
Discoverability25 / 25
Description explains when to use the skill, has a reasonable length and uses third person.
Content21 / 35
At least 150 words and at most 500 lines, headings, step lists, examples or code.
Hygiene15 / 15
No placeholders such as TODO, no Windows paths, with a licence.
Riskno signals detected in the scan
Files in this package
15
Scripts
1
HTML comments
0
URLs in SKILL.md
10
Deprecation

No signals detected. Repository changed on 12.11.2026, without references to retired models or APIs.

Licence

Apache-2.0, otwarta: można używać i zmieniać, z zachowaniem licencji i informacji o zmianach.

What to check before installing
  • 1 scripts in this package. Review them before installing, as Claude may execute them.

Scripts: evals/files/launch.sh

What it does and when to use it

Resolve the execution context for an NVIDIA FastGen command: checkout and interpreter, config path and override syntax, output/cache/data roots, run identity, and distributed launch variables. Use it when preparing or debugging execution; method selection belongs to fastgen-configure.

Original author description

Resolve the execution context for an NVIDIA FastGen command: checkout and interpreter, config path and override syntax, output/cache/data roots, run identity, and distributed launch variables. Use it when preparing or debugging execution; method selection belongs to fastgen-configure.

How it works

SKILL.md has no level-two headings · 48 lines, 394 words

SKILL.md preview
---
name: fastgen-runtime
description: >-
  Resolve the execution context for an NVIDIA FastGen command: checkout and interpreter, config path and override syntax, output/cache/data roots, run identity, and distributed launch variables. Use it when preparing or debugging execution; method selection belongs to fastgen-configure.
license: Apache-2.0
metadata:
  author: "Julius Berner <jberner@nvidia.com>"
  domain: ml
---

# FastGen runtime

Shared prerequisite for every FastGen command. The checkout's code and READMEs are
authoritative; this skill says where to look and what to verify. The
[configuration README](https://github.com/NVlabs/FastGen/blob/main/fastgen/configs/README.md) owns syntax, environment variables
and credentials; the [troubleshooting guide](https://github.com/NVlabs/FastGen/blob/main/fern/docs/troubleshooting.mdx) owns
failure diagnosis.

1. **Checkout and interpreter.** Locate the checkout separately from this skill directory
   and read its READMEs rather than assuming another version matches. Apply
   [fastgen-setup](https://github.com/NVlabs/FastGen/blob/main/skills/fastgen-setup/SKILL.md) only for missing work. Select the
   interpreter and devices the task actually uses and obey local scheduler, container and
   storage rules; importing GPU dependencies or resolving a config may already need an
   allocation.
2. **Config and overrides.** Run from the repository root (or put it on `PYTHONPATH`):
   training enters through the root [train.py](https://github.com/NVlabs/FastGen/blob/main/train.py).
   `--config` is a relative `.py` path exposing `create_config()`, and the loader in
   [config_utils.py](https://github.com/NVlabs/FastGen/blob/main/fastgen/configs/config_utils.py) rejects absolute paths and `..`.
   Script arguments precede the single `-` required by `override_config_with_opts`
   to introduce Hydra overrides
   ([command-line arguments](https://github.com/NVlabs/FastGen/blob/main/fastgen/configs/README.md#command-line-arguments)).
   `--dryrun` resolves the config and exits before the process group is initialised and
   before the global batch is rounded to accumulation steps; it tests neither.
3. **Roots.** Set an absolute, persistent `FASTGEN_OUTPUT_ROOT` and respect the data,
   checkpoint and Hugging Face cache roots derived from it (`.env` is loaded on import;
   see [environment variables](https://github.com/NVlabs/FastGen/blob/main/fastgen/configs/README.md#environment-variables)).
   Check the documented cache layout before pre-downloading and enable offline mode only
   once every needed file is cached. Keep credentials out of snapshots and logs.
4. **Run identity.** Independent runs need distinct `log_config.project`/`group`/`name`:
   the [run directory](https://github.com/NVlabs/FastGen/blob/main/fastgen/configs/README.md#run-directory) holds the resolved
   config, checkpoints and the W&B id, and resume is on by default.
   Also check the checkpoint destination: [resolve_save_dir](https://github.com/NVlabs/FastGen/blob/main/fastgen/utils/scripts.py)
   preserves absolute paths and S3 URIs, so those must be distinct for independent runs.
5. **Launch.** Check the entry point's distributed support before building a launcher:
   training distributes only with `trainer.ddp` or `trainer.fsdp`, and the standard
   inference scripts do not shard models. Match `RANK`, `LOCAL_RANK` and `WORLD_SIZE` to
   the processes launched; stale launcher variables make setup wait for peers
   ([distributed startup](https://github.com/NVlabs/FastGen/blob/main/fern/docs/troubleshooting.mdx#distributed-startup-fails-or-waits-for-peers)).
   Verify actual world size, wrapping, accumulation and effective batch in startup logs;
   a review-only plan should identify these checks as pending.

Report the selected checkout, interpreter, config, roots and launch context. For import
failures check the imported package path and working directory first; for access
failures distinguish missing files, authentication and model terms, and never substitute
another model silently. Linked skills live in the installed catalog or in the checkout's
`skills/` directory.
Files in this package (15)
  • BENCHMARK.md 10 KB
  • SKILL.md 4 KB
  • skill-card.md 7 KB
  • skill.oms.sig 7 KB
  • evals/config.yml 1 KB
  • evals/evals.json 5 KB
  • evals/files/context.json 1 KB
  • evals/files/dryrun.json 1 KB
  • evals/files/identity.json 1 KB
  • evals/files/identity_source.md 3 KB
  • evals/files/launch.sh 1 KB
  • evals/files/launch_source.md 3 KB
  • evals/files/method_selection_source.md 1 KB
  • evals/files/setup_source.md 1 KB
  • evals/files/wan_config.py.txt 3 KB

Versions

The database has no other skills named fastgen-runtime.

Database snapshot: 13.11.2026 · package version c413bd3a3d5e (SHA-256 digest of the entire package)

Downloads in the last 30 days: 0 · ranking

Report a problem with this skill: harmful content, incorrect descriptions or an author’s removal request.

Similar skills

  • 86fastgen-configure
    Create or adapt an NVIDIA FastGen experiment config for a network, task, dataset and training objective, and pick a distillation method when none was chosen. Use it whenever a FastGen run needs a new or modified config file or non-trivial overrides.
  • 86fastgen-develop
    Implement, refactor or review NVIDIA FastGen library code using its shared design, formatting, documentation and testing conventions. Use for source changes and code reviews; configuring or running an existing workflow alone does not need this skill.

Feedback and reports

Your message goes to Bartosz Sokoliński. An email address is needed only for a reply. See the privacy policy.