hyperparameter-tuning
/hyperparameter-tuning
Hyperparameter Tuning. Tune machine learning models honestly - grid search, random search, successive halving, Hyperband, Bayesian optimization with Optuna and pruning, nested cross-validation, early stopping on validation folds, search spaces for logistic regression, random forest, XGBoost, LightGBM, SVM, k-NN and neural networks, compute budgets, reporting spread and parameter importance. Use for hyperparameter optimization, GridSearchCV, RandomizedSearchCV, Optuna, model tuning or improving a model's settings.
- Author
- Harrypatria ↗
- Repository
- data-mining-ml ↗
- Licence
- MIT
- Last repository change
- 31.10.2026
Assessment and security
- Files in this package
- 2
- Scripts
- 0
- HTML comments
- 0
- URLs in SKILL.md
- 0
No signals detected. Repository changed on 31.10.2026, without references to retired models or APIs.
MIT, open: use and modify while retaining author attribution.
What it does and when to use it
Hyperparameter Tuning. Tune machine learning models honestly - grid search, random search, successive halving, Hyperband, Bayesian optimization with Optuna and pruning, nested cross-validation, early stopping on validation folds, search spaces for logistic regression, random forest, XGBoost, LightGBM, SVM, k-NN and neural networks, compute budgets, reporting spread and parameter importance. Use for hyperparameter optimization, GridSearchCV, RandomizedSearchCV, Optuna, model tuning or improving a model's settings.
Original author description
Hyperparameter Tuning. Tune machine learning models honestly - grid search, random search, successive halving, Hyperband, Bayesian optimization with Optuna and pruning, nested cross-validation, early stopping on validation folds, search spaces for logistic regression, random forest, XGBoost, LightGBM, SVM, k-NN and neural networks, compute budgets, reporting spread and parameter importance. Use for hyperparameter optimization, GridSearchCV, RandomizedSearchCV, Optuna, model tuning or improving a model's settings.
How it works
- Order of work
- Method choice
- Rules
- Report
SKILL.md preview
--- name: hyperparameter-tuning description: Hyperparameter Tuning. Tune machine learning models honestly - grid search, random search, successive halving, Hyperband, Bayesian optimization with Optuna and pruning, nested cross-validation, early stopping on validation folds, search spaces for logistic regression, random forest, XGBoost, LightGBM, SVM, k-NN and neural networks, compute budgets, reporting spread and parameter importance. Use for hyperparameter optimization, GridSearchCV, RandomizedSearchCV, Optuna, model tuning or improving a model's settings. --- # Hyperparameter Tuning ## Order of work 1. Fix the metric (aligned with cost: PR-AUC, F-beta, log loss, MAE), the split strategy and the baseline. 2. Score the default configuration with the same CV. Tuning gains are measured against it. 3. Tune inside cross-validation on training data only. The test set never influences tuning, early stopping or model choice. 4. Tune the decision threshold afterwards, as a separate step on validation data. ## Method choice | Situation | Method | |---|---| | Two or three parameters, cheap model | `GridSearchCV` | | Default choice | `RandomizedSearchCV` with log-uniform ranges, 30 to 100 trials | | Large space, cheap early signal | `HalvingRandomSearchCV`, Hyperband | | Expensive models | Optuna (TPE) with median pruning, CV inside the objective | | Small dataset, honest estimate needed | Nested CV: inner search, outer score | ## Rules - Log-scale ranges for learning rates, regularization strengths and `C`. - Early stopping on a validation fold carved from training data, never on test. - Fix the seed of the search and of the model; record the budget (trials, wall time, hardware). - With many trials, the best CV score is optimistic (validation overfitting). Confirm on the untouched test set once, or use nested CV. - Differences smaller than the fold-to-fold standard deviation are not improvements. ## Report Best mean CV score with its standard deviation across folds, the default-configuration score, the baseline score, the best parameters, a parameter importance or slice plot, the budget and the seed. Spaces and code: `references/tuning.md`.
Files in this package (2)
- SKILL.md 2 KB
- references/tuning.md 4 KB
Versions
| Repository | Score | Licence |
|---|---|---|
| This page · Harrypatria/data-mining-ml | 90 | MIT |
| seb1n/awesome-ai-agent-skills | 100 | MIT |
| param087/agent-ml-skills | 100 | MIT |
| Amey-Thakur/AI-SKILLS | 90 | MIT |
Database snapshot: 13.11.2026 · package version 07588cea286a (SHA-256 digest of the entire package)
Downloads in the last 30 days: 0 · ranking
Report a problem with this skill: harmful content, incorrect descriptions or an author’s removal request.
Similar skills
- 100hyperparameter-optimization
Optimizes forecaster hyperparameters using grid search, random search, or Bayesian search (Optuna). Covers single-series and multi-series search, cross-validation configuration, and search space definition. Use when the user wants to find the best model configuration. - 90ml-hyperparameter-tuning
Use this skill when performing hyperparameter tuning, optimizing model performance via search strategies, or configuring tuning frameworks (Optuna, Ray Tune, Hyperopt). This skill enforces: search space definition, strategy selection (grid/random/Bayesian), framework… - 100hyperparameter-optimization
Optimizes forecaster hyperparameters using grid search, random search, or Bayesian search (Optuna). Covers single-series and multi-series search, cross-validation configuration, and search space definition. Use when the user wants to find the best model configuration. - 100ml-hyperparameter-tuning
This skill should be used when the user asks to tune hyperparameters, run sweeps, optimize search spaces, or use AutoML. PROACTIVELY activate for: (1) Optuna, Ray Tune, FLAML, AutoGluon, Hyperopt, Nevergrad, KerasTuner, W&B sweeps, (2) grid search, random search, Bayesian… - 100tuning-hyperparameters
Optimize machine learning model hyperparameters using grid search, random search, or Bayesian optimization. Finds best parameter configurations to maximize performance. Use when asked to "tune hyperparameters" or "optimize model". Trigger with relevant phrases based on skill purpose. - 100tuning-hyperparameters
Optimize machine learning model hyperparameters using grid search, random search, or Bayesian optimization. Finds best parameter configurations to maximize performance. Use when asked to "tune hyperparameters" or "optimize model". Trigger with relevant phrases based on skill purpose.