Skip to content
Skills Library
Data & analytics · Analysis

hyperparameter-tuning

/hyperparameter-tuning

Hyperparameter Tuning. Tune machine learning models honestly - grid search, random search, successive halving, Hyperband, Bayesian optimization with Optuna and pruning, nested cross-validation, early stopping on validation folds, search spaces for logistic regression, random forest, XGBoost, LightGBM, SVM, k-NN and neural networks, compute budgets, reporting spread and parameter importance. Use for hyperparameter optimization, GridSearchCV, RandomizedSearchCV, Optuna, model tuning or improving a model's settings.

Licence
MIT
Last repository change
31.10.2026

Assessment and security

90/ 100Class: good
Format25 / 25
Frontmatter with name and description, valid name, description up to 1,024 characters, name matching the folder.
Discoverability25 / 25
Description explains when to use the skill, has a reasonable length and uses third person.
Content25 / 35
At least 150 words and at most 500 lines, headings, step lists, examples or code.
Hygiene15 / 15
No placeholders such as TODO, no Windows paths, with a licence.
Riskno signals detected in the scan
Files in this package
2
Scripts
0
HTML comments
0
URLs in SKILL.md
0
Deprecation

No signals detected. Repository changed on 31.10.2026, without references to retired models or APIs.

Licence

MIT, open: use and modify while retaining author attribution.

What it does and when to use it

Hyperparameter Tuning. Tune machine learning models honestly - grid search, random search, successive halving, Hyperband, Bayesian optimization with Optuna and pruning, nested cross-validation, early stopping on validation folds, search spaces for logistic regression, random forest, XGBoost, LightGBM, SVM, k-NN and neural networks, compute budgets, reporting spread and parameter importance. Use for hyperparameter optimization, GridSearchCV, RandomizedSearchCV, Optuna, model tuning or improving a model's settings.

Original author description

Hyperparameter Tuning. Tune machine learning models honestly - grid search, random search, successive halving, Hyperband, Bayesian optimization with Optuna and pruning, nested cross-validation, early stopping on validation folds, search spaces for logistic regression, random forest, XGBoost, LightGBM, SVM, k-NN and neural networks, compute budgets, reporting spread and parameter importance. Use for hyperparameter optimization, GridSearchCV, RandomizedSearchCV, Optuna, model tuning or improving a model's settings.

How it works

  1. Order of work
  2. Method choice
  3. Rules
  4. Report
Original SKILL.md headings · 32 lines, 256 words
SKILL.md preview
---
name: hyperparameter-tuning
description: Hyperparameter Tuning. Tune machine learning models honestly - grid search, random search, successive halving, Hyperband, Bayesian optimization with Optuna and pruning, nested cross-validation, early stopping on validation folds, search spaces for logistic regression, random forest, XGBoost, LightGBM, SVM, k-NN and neural networks, compute budgets, reporting spread and parameter importance. Use for hyperparameter optimization, GridSearchCV, RandomizedSearchCV, Optuna, model tuning or improving a model's settings.
---

# Hyperparameter Tuning

## Order of work

1. Fix the metric (aligned with cost: PR-AUC, F-beta, log loss, MAE), the split strategy and the baseline.
2. Score the default configuration with the same CV. Tuning gains are measured against it.
3. Tune inside cross-validation on training data only. The test set never influences tuning, early stopping or model choice.
4. Tune the decision threshold afterwards, as a separate step on validation data.

## Method choice

| Situation | Method |
|---|---|
| Two or three parameters, cheap model | `GridSearchCV` |
| Default choice | `RandomizedSearchCV` with log-uniform ranges, 30 to 100 trials |
| Large space, cheap early signal | `HalvingRandomSearchCV`, Hyperband |
| Expensive models | Optuna (TPE) with median pruning, CV inside the objective |
| Small dataset, honest estimate needed | Nested CV: inner search, outer score |

## Rules

- Log-scale ranges for learning rates, regularization strengths and `C`.
- Early stopping on a validation fold carved from training data, never on test.
- Fix the seed of the search and of the model; record the budget (trials, wall time, hardware).
- With many trials, the best CV score is optimistic (validation overfitting). Confirm on the untouched test set once, or use nested CV.
- Differences smaller than the fold-to-fold standard deviation are not improvements.

## Report

Best mean CV score with its standard deviation across folds, the default-configuration score, the baseline score, the best parameters, a parameter importance or slice plot, the budget and the seed. Spaces and code: `references/tuning.md`.
Files in this package (2)
  • SKILL.md 2 KB
  • references/tuning.md 4 KB

Versions

RepositoryScoreLicence
This page · Harrypatria/data-mining-ml90MIT
seb1n/awesome-ai-agent-skills100MIT
param087/agent-ml-skills100MIT
Amey-Thakur/AI-SKILLS90MIT

Database snapshot: 13.11.2026 · package version 07588cea286a (SHA-256 digest of the entire package)

Downloads in the last 30 days: 0 · ranking

Report a problem with this skill: harmful content, incorrect descriptions or an author’s removal request.

Similar skills

  • 100hyperparameter-optimization
    Optimizes forecaster hyperparameters using grid search, random search, or Bayesian search (Optuna). Covers single-series and multi-series search, cross-validation configuration, and search space definition. Use when the user wants to find the best model configuration.
  • 90ml-hyperparameter-tuning
    Use this skill when performing hyperparameter tuning, optimizing model performance via search strategies, or configuring tuning frameworks (Optuna, Ray Tune, Hyperopt). This skill enforces: search space definition, strategy selection (grid/random/Bayesian), framework…
  • 100hyperparameter-optimization
    Optimizes forecaster hyperparameters using grid search, random search, or Bayesian search (Optuna). Covers single-series and multi-series search, cross-validation configuration, and search space definition. Use when the user wants to find the best model configuration.
  • 100ml-hyperparameter-tuning
    This skill should be used when the user asks to tune hyperparameters, run sweeps, optimize search spaces, or use AutoML. PROACTIVELY activate for: (1) Optuna, Ray Tune, FLAML, AutoGluon, Hyperopt, Nevergrad, KerasTuner, W&B sweeps, (2) grid search, random search, Bayesian…
  • 100tuning-hyperparameters
    Optimize machine learning model hyperparameters using grid search, random search, or Bayesian optimization. Finds best parameter configurations to maximize performance. Use when asked to "tune hyperparameters" or "optimize model". Trigger with relevant phrases based on skill purpose.
  • 100tuning-hyperparameters
    Optimize machine learning model hyperparameters using grid search, random search, or Bayesian optimization. Finds best parameter configurations to maximize performance. Use when asked to "tune hyperparameters" or "optimize model". Trigger with relevant phrases based on skill purpose.

Feedback and reports

Your message goes to Bartosz Sokoliński. An email address is needed only for a reply. See the privacy policy.