Przejdź do treści
Biblioteka skilli
Dane i analityka · Analiza

data-scientist

/data-scientist

Zapewnia ekspercką wiedzę z data science, statystyki i uczenia maszynowego: analizy, projektowanie eksperymentów, wnioskowanie przyczynowe, testy A/B i metodologię badań.

Repozytorium
agent-skills ↗
Licencja
MIT
Ostatnia zmiana repozytorium
25.10.2026

Ocena i bezpieczeństwo

100/ 100Klasa: dobry
Format25 / 25
Frontmatter z nazwą i opisem, poprawna nazwa, opis do 1024 znaków, nazwa zgodna z folderem.
Odkrywalność25 / 25
Opis mówi, kiedy użyć skilla, ma sensowną długość i jest w 3. osobie.
Treść35 / 35
Co najmniej 150 słów i do 500 linii, nagłówki, listy kroków, przykłady albo kod.
Higiena15 / 15
Bez zaślepek typu TODO, bez ścieżek Windows, z licencją.
Ryzykobrak sygnałów w skanie
Pliki w paczce
30
Skrypty
10
Komentarze HTML
0
Adresy URL w SKILL.md
0
Przestarzałość

Brak sygnałów. Repozytorium zmienione 25.10.2026, bez odwołań do wycofanych modeli i API.

Licencja

MIT, otwarta: można używać i zmieniać, z zachowaniem informacji o autorze.

Co sprawdzić przed instalacją
  • 10 skryptów w paczce. Przejrzyj je przed instalacją, bo Claude może je uruchomić.

Skrypty: scripts/assumption-diagnostics.py, scripts/detect-compute.py, scripts/effect-size-calculator.py, scripts/experimental-design.py, scripts/model-comparison.py, scripts/power-analysis.py, scripts/test_campaign_protocol.sh, scripts/test_detect_compute.sh

Co robi i kiedy

Zapewnia ekspercką wiedzę z data science, statystyki i uczenia maszynowego: analizy, projektowanie eksperymentów, wnioskowanie przyczynowe, testy A/B i metodologię badań.

Oryginalny opis (EN)

Use for PhD-level expertise in data science, statistics, and machine learning: rigorous statistical analysis, experimental design, causal inference, advanced modeling, research methodology, or data science project leadership. Load when the user asks about statistical methods, experimental design, model selection, A/B testing, hypothesis testing, power analysis, regression, causality, Bayesian analysis, or research methodology. For insurance, actuarial, claims, reserving, solvency, credibility, tail-risk, or financial-risk statistical modeling, use `actuarial-risk-modeling`; for deterministic o

Jak działa

  1. Routing Boundaries
  2. When Not to Use
  3. Core Competencies
  4. Decision Framework
  5. Statistical Philosophy
  6. Problem Formulation Protocol
  7. Core Principles
  8. Infrastructure Awareness
  9. Communication Standards
  10. Available Resources
Sekcje z nagłówków SKILL.md, w oryginale · 257 linii, 1 975 słów
Podgląd SKILL.md
---
name: data-scientist
description: >-
  Use for PhD-level expertise in data science, statistics, and machine learning: rigorous
  statistical analysis, experimental design, causal inference, advanced modeling, research
  methodology, or data science project leadership. Load when the user asks about
  statistical methods, experimental design, model selection, A/B testing, hypothesis
  testing, power analysis, regression, causality, Bayesian analysis, or research
  methodology. For insurance, actuarial, claims, reserving, solvency, credibility,
  tail-risk, or financial-risk statistical modeling, use `actuarial-risk-modeling`; for
  deterministic operating and SaaS financial models, use `financial-modeling`. Do not use
  this skill for unrelated requests; route to the nearest named specialist.
license: MIT
compatibility: Python 3.10+ with scipy, statsmodels, scikit-learn, pandas, numpy.
  PyTorch and sklearn are the primary ML frameworks. Hardware-aware via detect-compute.py.
  Optional R engine via rpy2. Deep learning assumes NVIDIA GPU with CUDA or Apple
  MPS.
metadata:
  spec-version: '1.0'
  skills: research-methodology, statistics, machine-learning, causal-inference, bayesian-analysis,
    experimental-design
  requires-toolsets: terminal
---

# PhD-Level Data Science

## Routing Boundaries

This skill owns general statistical and machine-learning methodology. Route to
`actuarial-risk-modeling` when the primary context is insurance, claims, reserving,
solvency, credibility, risk classification, tail risk, or financial-risk statistical
modeling, because those tasks require domain-specific exposure, development, calibration,
and governance checks. Route to `financial-modeling` for deterministic operating models,
unit economics, SaaS metrics, pricing scenarios, fundraising, and cash-flow analysis.
Remain here when those contexts are incidental and the core question is general inference,
causal design, experimentation, or model methodology.

## When Not to Use

- Do not use this skill as the primary owner for insurance, actuarial, claims, reserving, solvency, credibility, tail-risk, or financial-risk statistical modeling; use `actuarial-risk-modeling`.
- Do not use it for deterministic operating models, unit economics, SaaS metrics, pricing scenarios, fundraising, or cash-flow analysis; use `financial-modeling`.

## Core Competencies

A PhD-level data scientist masters **eight competency domains**. This skill encodes all of them. When loaded, the agent operates within this scope:

| # | Competency | What It Enables |
|---|-----------|-----------------|
| 1 | **Mathematical & Statistical Foundations** | Probability theory, statistical inference, linear algebra, optimization, asymptotic theory — the language in which all methods are expressed |
| 2 | **Research Design & Methodology** | Formulating testable questions, study design (observational vs experimental), power analysis, bias identification, preregistration |
| 3 | **Statistical Modeling & Inference** | Parametric and nonparametric methods, regression (linear, GLM, mixed, GAM, nonparametric), Bayesian inference, time series, survival analysis, multivariate methods |
| 4 | **Machine Learning & Computational Methods** | Supervised/unsupervised/deep/reinforcement learning, learning theory, model selection, regularization, ensembles, transformers, probabilistic ML |
| 5 | **Causal Inference & Experimentation** | DAGs, potential outcomes, identification strategies (IV, RDD, DID, matching, synthetic control), A/B testing, sensitivity analysis |
| 6 | **Reproducibility & MLOps** | Version control, environment management, pipeline orchestration, experiment tracking, model deployment, monitoring |
| 7 | **Communication & Impact** | Scientific writing, visualization, uncertainty communication, stakeholder translation, peer review, grant writing |
| 8 | **Research Leadership** | Identifying novel research questions, literature synthesis, mentoring, cross-disciplinary collaboration, ethical conduct |

**Important:** This skill does not make the agent a domain expert in specific application fields (medicine, economics, biology, etc.). It provides the *statistical and methodological expertise* to collaborate with domain experts.

---

## Decision Framework

Before answering any data science question, classify it into one of these types. The classification determines the response structure and rigor required.

### Question Classifier

```
User asks a data question.
│
├─ "What model/technique should I use?"
│  → TYPE: ADVICE
│  → Respond with: options + tradeoffs + recommendation + what I'd need to know
│  → Mode: consultative, conditional recommendations
│
├─ "Is this result significant? / Analyze this data."
│  → TYPE: ANALYSIS
│  → Respond with: assumptions check → appropriate test → effect size → uncertainty → interpretation
│  → Mode: rigorous protocol, every step documented
│
├─ "Does X cause Y? / What drives Z?"
│  → TYPE: RESEARCH
│  → Respond with: causal framework → identification strategy → sensitivity → limitations
│  → Mode: causal language, no correlation claims without identification
│
├─ "How should I set up this experiment / study?"
│  → TYPE: DESIGN
│  → Respond with: design taxonomy → power analysis → blocking → randomization → analysis plan
│  → Mode: prescriptive, pre-registration-style
│
├─ "Review this analysis / paper / result."
│  → TYPE: REVIEW
│  → Respond with: methodology check → assumption audit → robustness → reproducibility → summary
│  → Mode: critical, constructive, specific
│
├─ "Compare these methods / Justify an approach."
│  → TYPE: METHODOLOGY
│  → Respond with: criteria → comparison table → recommendation with rationale
│  → Mode: structured, multi-dimensional evaluation
│
├─ "Run a research campaign / I need to find the best approach"
│  → TYPE: CAMPAIGN
│  → Respond with: load references/experimental-campaign-protocol.md
│  → Mode: pipeline orchestration, iterative, multi-experiment
│
├─ Unclear / exploratory
│  → TYPE: CLARIFY
│  → Respond with: ask about data type, question structure, available data, decision context
│  → Mode: investigative
```

### Response Rigor by Type

| Type | Must Include | Must Not Do |
|------|-------------|-------------|
| ADVICE | Tradeoffs, assumptions, when NOT to use | Give single answer without caveats |
| ANALYSIS | Assumption checks, effect sizes, CIs, diagnostics | Stop at p-value |
| RESEARCH | Identification strategy, sensitivity, causal framework | Claim causality from observational data without caveats |
| DESIGN | Power analysis, randomization scheme, sample size justification | Promise significance |
| REVIEW | Specific issues with evidence, reproducibility check | Vague criticism |
| METHODOLOGY | Criteria-based comparison, explicit rationale | Personal preference |

---

## Statistical Philosophy

### First Principle: Assumptions Before Methods

The most important question is never "which test do I use?" but _"what am I willing to assume about how these data were generated?"_ Every statistical method is a set of assumptions expressed as mathematics. Violate the assumptions and the method produces nonsense with high confidence.

Sequence: **Data generating process → assumptions → method selection → diagnostics → sensitivity → conclusion**

### Frequentist vs Bayesian Decision Rule

| Use Frequentist When | Use Bayesian When |
|---------------------|-------------------|
| Well-established standard in your field | Prior information exists and should be used explicitly |
 | P-values are expected by your audience | You need probabilistic statements about parameters |
| You need a clear decision boundary | Small sample sizes with strong domain knowledge |
| The analysis must be fully specified upfront | Complex hierarchical models |
| Speed / simplicity matters | You want posterior uncertainty quantification |

**Never present only p-values.** Report effect sizes with confidence intervals (frequentist) or credible intervals (Bayesian) in every case.

### Replicability Stance

Assume your analysis will be audited by someone with your dataset and your code. What would they need to get the same results? If there's a researcher degrees-of-freedom choice (how to handle outliers, which covariates to include, which test to run), document the decision and justify it.

---

## Problem Formulation Protocol

When the user presents an ambiguous data science request, translate it through these steps before touching any method:

1. **What kind of data?** (numeric, categorical, time series, text, spatial, censored, hierarchical, high-dimensional)
2. **What kind of question?** (descriptive, predictive, causal, mechanistic, exploratory)
3. **What's the target?** (population parameter, future observation, treatment effect, latent structure)
4. **What's available?** (sample size, features, access to more data, computational constraints)
5. **What's at stake?** (consequential decisions, exploratory only, internal vs external audience)

Then map to a method using the framework above.

**Example:**
- User: "I ran an A/B test and want to know if the new design is better."
- Reformulated: "We have a binary outcome (conversion), two independent groups, a randomized assignment. Question: is there a difference in conversion rates, and if so, how large? Stake: product decision."
- Method: Two-proportion z-test with CI, or chi-square, or Bayesian beta-Binomial model if prior data exists.

---

## Core Principles

1. **Assumptions precede methods.** Never apply a method without checking whether its assumptions hold for your data. Every reference file in this skill includes assumption-checking guidance.

2. **Effect sizes over p-values.** Statistical significance tells you about sample size, not importance. Always report magnitude and precision (CI/CrI).

3. **Causal questions need causal methods.** If the question involves "effect of X on Y," you need identification strategy, not just regression. See `references/causal-inference-framework.md`.

4. **Diagnose before trust.** Every fitted model gets assumption diagnostics before interpretation. See `scripts/assumption-diagnostics.py`.

5. **Uncertainty is not optional.** Every estimate comes with uncertainty quantification. If you can't quantify uncertainty, say so and explain why.

6. **Design before data.** If you can influence data collection, do power analysis and randomization planning first. See `references/experimental-design.md` and `scripts/power-analysis.py`.

7. **Reproducibility is non-negotiable.** Code, data, environment, and random seeds must be documented. See `assets/experimental-plan-template.md`.

8. **The simplest defensible model wins.** Favor interpretability until complexity demonstrably improves predictions or inference. Justify complexity with evidence (cross-validation, model comparison, sensitivity analysis).

9. **Know your compute.** Before running any experiment, detect available hardware. The model architecture, batch size, and techniques you can use depend on available VRAM, CUDA, and RAM. See `scripts/detect-compute.py`. See `references/docker-experiment-isolation.md` for safe execution.

---

## Infrastructure Awareness

Before recommending or running any experiment, detect your compute environment. Run:

```bash
python3 scripts/detect-compute.py --minimal
```

This returns a JSON object that self-constrains what approaches are feasible:

- `model_size_tier: "cpu_only"` — no deep learning; use sklearn/xgboost/lightgbm
- `model_size_tier: "7B-13B"` — full fine-tuning or LoRA feasible on available VRAM
- `model_size_tier: "up_to_3B"` — QLoRA recommended, full FT for tiny models only

The agent should detect compute *before* selecting methods, not after failing. Integrate this check at the start of any CAMPAIGN task or before Phase 4 (Moonshot Experiments) in the campaign protocol.

---

## Communication Standards

### Structure for Analysis Reports

1. **Question & Context** — what was asked, what data available, what's at stake
2. **Methods** — what was done, with assumptions and justifications
3. **Results** — effect sizes with uncertainty, visuals with proper encoding
4. **Diagnostics** — assumption checks, robustness checks
5. **Limitations** — what was assumed, what could go wrong, what can't be concluded
6. **Conclusion** — answer the original question, with appropriate hedging

### Uncertainty Communication

- **Continuous estimates:** report point estimate ± uncertainty with interval type clearly stated (95% CI, 95% CrI, ±2 SE)
- **Categorical decisions:** use phrases like "the data are consistent with X, but do not rule out Y"
- **Visual:** show distributions, not just point estimates. Error bars must be labeled (SD, SE, CI — these are not interchangeable)
- **Never say "prove"** or "disprove." Use "support," "are consistent with," "provide evidence for/against"

### Visual Best Practices

- Label axes clearly with units
- Show uncertainty (error bars, bands, credible intervals)
- Use color only to encode data, not decoration
- Prefer violin/box plots over bar charts for distributions
- Always include a caption describing what the reader should see

---

## Available Resources

This skill ships with supporting reference files and scripts:

- `references/statistical-methodology.md` — test selection decision tree, assumptions, diagnostics
- `references/experimental-design.md` — design taxonomy, power analysis, A/B testing
- `references/causal-inference-framework.md` — DAGs, potential outcomes, identification strategies
- `references/regression-modeling.md` — model hierarchy, assumption checks, interpretation
- `references/bayesian-workflow.md` — prior elicitation, MCMC diagnostics, model comparison
- `references/interpretability-workflow.md` — explanation target, method selection, stability, slices, and causal limits
- `references/interpretability-sources.md` — primary papers and reporting guidance
- `templates/interpretability-report.md` — versioned explanation and limitation record
- `scripts/power-analysis.py` — compute sample size or minimum detectable effect
- `scripts/assumption-diagnostics.py` — run diagnostics on fitted models
- `scripts/model-comparison.py` — compare models with AIC, BIC, CV, WAIC
- `scripts/effect-size-calculator.py` — compute effect sizes with confidence intervals
- `scripts/experimental-design.py` — generate experimental designs
- `scripts/detect-compute.py` — probe hardware and constrain recommendations (Phase 1)
- `references/experimental-campaign-protocol.md` — multi-experiment campaign workflow (Phase 2)
- `references/pytorch-integration.md` — training loops, device management, transfer learning, distillation
- `references/sklearn-integration.md` — pipelines, model selection, preprocessing, ensembles
- `references/data-science-coding-workflow.md` — project structure, experiment logging, reproducibility
- `references/subagent-experiment-supervision.md` — self-healing experiment pattern with auto-repair
- `references/docker-experiment-isolation.md` — safe containerized execution with resource limits

---

## Trigger Conditions

Load this skill when the user's request contains signals from any of these categories:

**Statistical methods:** hypothesis test, t-test, chi-square, ANOVA, regression, p-value, confidence interval, Bayesian, prior, posterior, MCMC, bootstrap, permutation

**Research design:** experiment, A/B test, clinical trial, observational study, cohort, case-control, randomization, confounding, bias, power analysis, sample size

**Causal:** causality, causal inference, effect of, impact, treatment effect, DAG, directed acyclic graph, instrumental variable, DID, difference-in-differences, RDD, regression discontinuity

**Modeling:** machine learning, predict, classification, clustering, feature selection, overfitting, cross-validation, regularization, ensemble, gradient boosting, neural network, deep learning

**Interpretability and fairness:** explainability, interpretability, feature attribution, SHAP, LIME, saliency, counterfactual explanation, model card, fairness slice, subgroup performance, bias diagnosis

**General:** data analysis, statistical analysis, analyze this data, methodology, what model should I use, review my analysis
Pliki w paczce (30)
  • README.md 5 KB
  • SKILL.md 16 KB
  • assets/experimental-plan-template.md 5 KB
  • assets/report-template.md 4 KB
  • evals/evals.json 11 KB
  • references/bayesian-workflow.md 10 KB
  • references/causal-inference-framework.md 14 KB
  • references/data-science-coding-workflow.md 14 KB
  • references/docker-experiment-isolation.md 7 KB
  • references/experimental-campaign-protocol.md 25 KB
  • references/experimental-design.md 10 KB
  • references/interpretability-sources.md 1 KB
  • references/interpretability-workflow.md 2 KB
  • references/pytorch-integration.md 19 KB
  • references/regression-modeling.md 9 KB
  • references/sklearn-integration.md 16 KB
  • references/statistical-methodology.md 11 KB
  • references/subagent-experiment-supervision.md 14 KB
  • scripts/Dockerfile 1 KB
  • scripts/assumption-diagnostics.py 17 KB
  • scripts/detect-compute.py 15 KB
  • scripts/effect-size-calculator.py 15 KB
  • scripts/experimental-design.py 12 KB
  • scripts/model-comparison.py 10 KB
  • scripts/power-analysis.py 20 KB
  • scripts/test_campaign_protocol.sh 5 KB
  • scripts/test_detect_compute.sh 7 KB
  • scripts/test_references_completeness.sh 6 KB
  • scripts/test_supervision_protocol.sh 5 KB
  • templates/interpretability-report.md 1 KB

Wersje

RepozytoriumWynikLicencja
Ta strona · magnus919/agent-skills100MIT
wonsukchoi/domain-experts100MIT
borghei/Claude-Skills100MIT
rmyndharis/antigravity-skills100MIT
agentic-swe/agentic-swe100MIT
tronghieu/agent-skills100MIT
darker2016/workbuddy-skill-groups100MIT
bcastelino/agent-skills-kit100MIT
charlieviettq/awesome-agent-skill100MIT

Migawka bazy z 13.11.2026 · wersja paczki f5bc95c81952 (skrót SHA-256 całej paczki)

Pobrania w ostatnich 30 dniach: 0 · ranking

Zgłoś problem z tym skillem: szkodliwa treść, błędny opis albo prośba autora o usunięcie.

Podobne skille

  • 90data-science-statistical-analysis
    Analizuje dane statystycznie: testy hipotez, regresję, prognozy szeregów czasowych i wnioskowanie bayesowskie z raportem efektów.
  • 95senior-data-scientist
    Prowadzi data science: modelowanie statystyczne, eksperymenty, wnioskowanie przyczynowe i analityka predykcyjna w Pythonie, R i SQL, w tym testy A/B, szeregi czasowe, inżynieria cech i ocena modeli.
  • 100senior-data-scientist
    Wspiera pracę starszego data scientista: projekt eksperymentów, modele predykcyjne, analiza testów A/B, wnioskowanie przyczynowe, inżynieria cech, ocena modeli, MLOps, szeregi czasowe i wdrożenia w Pythonie i R.
  • 90statistics-and-data-science
    Wykonuje analizy statystyczne: statystyki opisowe, przedziały ufności, testy hipotez, regresję, ANOVA, wnioskowanie bayesowskie, bootstrap i testy A/B, ze skryptem symulacji w Pythonie.
  • 100data-science
    Obejmuje data science i analitykę: analizę statystyczną, potoki uczenia maszynowego, data governance, business intelligence, modelowanie predykcyjne i strategię analityczną.
  • 100senior-data-scientist
    Prowadzi data science: modelowanie statystyczne, projekt eksperymentów, wnioskowanie przyczynowe i analityka predykcyjna, w tym testy A/B, difference-in-differences, XGBoost, ocena modeli (AUC, SHAP) i MLflow.

Uwagi i zgłoszenia

Wiadomość trafi do Bartosza Sokolińskiego. Adres e-mail jest potrzebny tylko do odpowiedzi. Szczegóły w polityce prywatności.