Skip to content
Skills Library
Data & analytics · Building & coding

catboost

/catboost

Expert CatBoost assistance covering gradient boosting on decision trees, native categorical feature handling, and GPU acceleration. Use when training fast, accurate tabular models without manual one-hot encoding.

Licence
MIT
Last repository change
01.10.2026

Assessment and security

100/ 100Class: good
Format25 / 25
Frontmatter with name and description, valid name, description up to 1,024 characters, name matching the folder.
Discoverability25 / 25
Description explains when to use the skill, has a reasonable length and uses third person.
Content35 / 35
At least 150 words and at most 500 lines, headings, step lists, examples or code.
Hygiene15 / 15
No placeholders such as TODO, no Windows paths, with a licence.
Riskno signals detected in the scan
Files in this package
1
Scripts
0
HTML comments
0
URLs in SKILL.md
1
Deprecation

No signals detected. Repository changed on 01.10.2026, without references to retired models or APIs.

Licence

MIT, open: use and modify while retaining author attribution.

What it does and when to use it

Expert CatBoost assistance covering gradient boosting on decision trees, native categorical feature handling, and GPU acceleration. Use when training fast, accurate tabular models without manual one-hot encoding.

Original author description

Expert CatBoost assistance covering gradient boosting on decision trees, native categorical feature handling, and GPU acceleration. Use when training fast, accurate tabular models without manual one-hot encoding.

How it works

  1. When to Use
  2. Quick Start
  3. Core Concepts
  4. Common Patterns
  5. Best Practices
  6. Troubleshooting
  7. References
Original SKILL.md headings · 155 lines, 606 words
SKILL.md preview
---
name: catboost
description: Expert CatBoost assistance covering gradient boosting on decision trees, native categorical feature handling, and GPU acceleration. Use when training fast, accurate tabular models without manual one-hot encoding.
---

# CatBoost

CatBoost (Yandex) is arguably the easiest boosting library to use because it handles **Categorical Features** automatically and perfectly without tuning.

## When to Use

- **Tabular Data with Categorical Features**: Automatic target encoding and categorical combination without manual one-hot encoding.
- **Low-Latency Inference**: Fast model scoring on CPU and GPU with minimal memory overhead.
- **Ranking & Classification Tasks**: E-commerce recommendation, fraud detection, and click-through-rate (CTR) prediction.
- **Robustness Against Overfitting**: Symmetric (oblivious) decision trees providing stable predictions on small-to-medium datasets.

## Quick Start

```python
from catboost import CatBoostClassifier, Pool
from sklearn.model_selection import train_test_split
import pandas as pd

# Native categorical feature support
df = pd.DataFrame({
    'city': ['London', 'Paris', 'Tokyo', 'London', 'Paris'],
    'age': [25, 40, 30, 22, 55],
    'target': [1, 0, 1, 1, 0]
})

X = df[['city', 'age']]
y = df['target']
cat_features = ['city']

model = CatBoostClassifier(iterations=100, learning_rate=0.1, verbose=20)
model.fit(X, y, cat_features=cat_features)
preds = model.predict(X)
```

## Core Concepts

### Native Categorical Feature Handling

Training CatBoostClassifier directly on raw categorical string columns:

```python
from catboost import CatBoostClassifier, Pool
from sklearn.model_selection import train_test_split
import pandas as pd

# Load dataset with categorical features
data = pd.DataFrame({
    'city': ['London', 'Paris', 'Tokyo', 'London', 'Tokyo', 'Berlin'],
    'device': ['mobile', 'desktop', 'mobile', 'tablet', 'desktop', 'mobile'],
    'age': [24, 45, 32, 19, 58, 29],
    'churned': [0, 1, 0, 0, 1, 0]
})

X = data[['city', 'device', 'age']]
y = data['churned']
cat_features = ['city', 'device']

X_train, X_val, y_train, y_val = train_test_split(X, y, test_size=0.33, random_state=42)

train_pool = Pool(X_train, y_train, cat_features=cat_features)
val_pool = Pool(X_val, y_val, cat_features=cat_features)

model = CatBoostClassifier(
    iterations=500,
    learning_rate=0.05,
    depth=6,
    eval_metric='AUC',
    early_stopping_rounds=30,
    random_seed=42,
    verbose=50
)

model.fit(train_pool, eval_set=val_pool)
```

### Feature Importance & SHAP Values

Interpreting model decisions with Tree SHAP:

```python
import shap

# Compute SHAP values directly from CatBoost
explainer = shap.TreeExplainer(model)
shap_values = explainer(val_pool)

# Summarize feature impact
feature_importance = model.get_feature_importance(val_pool, type='PredictionValuesChange')
for name, score in zip(X.columns, feature_importance):
    print(f"Feature: {name:10s} Importance: {score:.4f}")
```

### Exporting Model to ONNX for High-Speed Serving

Serializing trained models for cross-platform C++/Go/Rust inference:

```python
# Save model in ONNX format
model.save_model("catboost_model.onnx", format="onnx")

# Or native binary format
model.save_model("catboost_model.cbm")
```

## Common Patterns

### Early Stopping with Validation Pool

**Problem**: Overfitting on tabular training data during deep gradient tree boosting.

**Solution**:
Pass validation pool with early stopping rounds:

```python
train_pool = Pool(X_train, y_train, cat_features=cat_features)
eval_pool = Pool(X_val, y_val, cat_features=cat_features)

model = CatBoostClassifier(
    iterations=1000,
    early_stopping_rounds=50,
    eval_metric='AUC',
    random_seed=42
)
model.fit(train_pool, eval_set=eval_pool, verbose=100)
print(f"Best iteration: {model.get_best_iteration()}")
```

## Best Practices

**Do**:

- Pass categorical columns directly to `cat_features` rather than manual one-hot encoding.
- Use `early_stopping_rounds` with a dedicated validation set to prevent overfitting.
- Train on GPU (`task_type="GPU"`) for datasets exceeding 1 million rows for up to 10x-20x speedup.
- Monitor evaluation metrics using `plot=True` in Jupyter or export training logs to TensorBoard.

**Don't**:

- Label encode high-cardinality categoricals manually; CatBoost's target encoding is statistically superior.
- Use too large `depth` (> 10) unless explicitly regularized; CatBoost defaults (depth 6) are optimal.
- Evaluate final performance on the validation set used for early stopping; evaluate on a held-out test set.

## Troubleshooting

| Error                                        | Cause                                                               | Solution                                                                        |
| :------------------------------------------- | :------------------------------------------------------------------ | :------------------------------------------------------------------------------ |
| `CatBoostError: Cannot convert ... to float` | Categorical column containing strings not listed in `cat_features`. | Explicitly pass list of categorical column names/indices to `cat_features`.     |
| `CUDA out of memory in GPU training`         | Batch size or tree depth too large for GPU VRAM.                    | Reduce `max_depth` (default 6) or train on CPU with `task_type='CPU'`.          |
| `Metric value is NaN`                        | Label array contains missing values or infinite entries.            | Clean target labels and verify binary classification target values are 0 and 1. |

## References

- [CatBoost Documentation](https://catboost.ai/)

Versions

The database has no other skills named catboost.

Database snapshot: 13.11.2026 · package version a70234fe2ee3 (SHA-256 digest of the entire package)

Downloads in the last 30 days: 0 · ranking

Report a problem with this skill: harmful content, incorrect descriptions or an author’s removal request.

Similar skills

  • 100lightgbm
    Expert LightGBM assistance covering leaf-wise tree growth, histogram-based gradient boosting, and GPU acceleration. Use when training fast, memory-efficient tabular models on large datasets.
  • 90gradient-boosting-tuning
    Tune gradient-boosted trees (XGBoost, LightGBM, CatBoost) effectively: the parameters that matter and the order to tune them. Use when using gradient boosting on tabular data and wanting real gains from tuning.
  • 100xgboost
    Expert XGBoost assistance covering extreme gradient boosting, tree pruners, DMatrix, GPU hist tree method, and early stopping. Use when training high-accuracy tabular models for competitions and production.
  • 90ml-classical-ml
    Use this skill when asked about scikit-learn, XGBoost, LightGBM, CatBoost, regression, classification, clustering, ensemble, random forest, gradient boosting, SVM, PCA, feature importance, or cross-validation. This skill enforces: supervised learning pipelines (regression and…
  • 90kaggle-tabular
    Use when working on Kaggle tabular, time-series or geospatial regression/classification — GBDT stacks (LightGBM/CatBoost/XGBoost), tabular foundation models (TabICL/TabPFN), spatial/group CV, feature ablations, stacking and hill-climbing, Optuna, local training + Kaggle inference
  • 100time-series-forecasting
    Forecast or predict future values of one or many time series (sales, demand, traffic, revenue per period), e.g. "predict tomorrow's / next day's / next week's / next month's value", or find out how forecastable they are. Use it whenever the data is measured period after period…

Feedback and reports

Your message goes to Bartosz Sokoliński. An email address is needed only for a reply. See the privacy policy.