Przejdź do treści
Biblioteka skilli
Dane i analityka · Analiza

expectation-driven-science

/expectation-driven-science

Prowadzi analizę danych test-first: formułuje hipotezę i oczekiwanie, przewiduje wynik i dopiero potem weryfikuje go.

Repozytorium
mad-science ↗
Licencja
MIT
Ostatnia zmiana repozytorium
11.11.2026

Ocena i bezpieczeństwo

100/ 100Klasa: dobry
Format25 / 25
Frontmatter z nazwą i opisem, poprawna nazwa, opis do 1024 znaków, nazwa zgodna z folderem.
Odkrywalność25 / 25
Opis mówi, kiedy użyć skilla, ma sensowną długość i jest w 3. osobie.
Treść35 / 35
Co najmniej 150 słów i do 500 linii, nagłówki, listy kroków, przykłady albo kod.
Higiena15 / 15
Bez zaślepek typu TODO, bez ścieżek Windows, z licencją.
Ryzykobrak sygnałów w skanie
Pliki w paczce
1
Skrypty
0
Komentarze HTML
0
Adresy URL w SKILL.md
0
Przestarzałość

Brak sygnałów. Repozytorium zmienione 11.11.2026, bez odwołań do wycofanych modeli i API.

Licencja

MIT, otwarta: można używać i zmieniać, z zachowaniem informacji o autorze.

Co robi i kiedy

Prowadzi analizę danych test-first: formułuje hipotezę i oczekiwanie, przewiduje wynik i dopiero potem weryfikuje go.

Wyzwalacze z opisu

hypothesisexpectationassumption
Oryginalny opis (EN)

Development guided by the scientific method and explicit expectations. Use when the user wants to build or validate an analysis/model test-first, states a "hypothesis", "expectation" or "assumption" about the data, or asks for a principled data-science workflow (hypothesis → prediction → verification).

Jak działa

  1. What a good expectation (hypothesis/prediction) is
  2. Seams: where expectations live
  3. Anti-patterns
  4. Rules of the loop
Sekcje z nagłówków SKILL.md, w oryginale · 44 linii, 837 słów
Podgląd SKILL.md
---
name: expectation-driven-science
description: Development guided by the scientific method and explicit expectations. Use when the user wants to build or validate an analysis/model test-first, states a "hypothesis", "expectation" or "assumption" about the data, or asks for a principled data-science workflow (hypothesis → prediction → verification).
---

# Expectation-Driven Science

This is the discipline that turns data exploration from an implicit process into a verifiable **hypothesis → prediction → verification** loop. It is the data-science equivalent of TDD's red→green: the same root principle — *put the expectation before the trust* — applied to three distinct objects (hypothesis in the business, premise in the data, function in the code). This skill is the reference that makes that loop produce analyses worth keeping: what a good expectation is, where it lives, the anti-patterns, and the rules of the loop.

When exploring the domain, read the project's context documentation (if it exists) so hypothesis names, metrics, and interfaces match the business domain language, and respect the ADRs in the area you're touching.

## What a good expectation (hypothesis/prediction) is

An expectation declares **what the observer believes to be true about the world before looking at the data**, and can therefore be confirmed or refuted. It reads like a research question: *"customers with abandoned carts have lower long-term savings"* tells you exactly which relationship you're testing — and it survives model swaps, column changes, or tool changes, because it depends on the relationship of interest, not on the internal mechanism of implementation.

A good expectation must be **falsifiable** (it can be proven wrong) and **quantifiable** (it has a threshold/acceptance limit defined before running). When the expectation fails, treat the deviation as information, not failure. See the Rule of the loop below.

## Seams: where expectations live

A **seam** is the *object* on which you declare an expectation — the point where you observe reality without "reaching inside" it. Expectations live at seams, never against internal details.

**Only declare expectations at pre-agreed seams.** Before writing any hypothesis, write down the seams under test and confirm them with the user. No expectation is written at an unconfirmed seam. You can't test everything, so agreeing the seams up front is how verification effort lands on the critical hypotheses and complex logic instead of every edge case.

There are three seam families, aligned with the three layers on which a data scientist relies:

| Seam | Object of the expectation | What to expect (examples) |
|---|---|---|
| **Business hypothesis** | Causal/associative relations in the domain | "3-month retention increase → higher LTV" |
| **Data premise** | Data state/quality/schema | "`created_at` never null", "ratio ≥ 0", "schema versioned" |
| **Function/pipeline** | Code behavior (~TDD) | "the imputer preserves the mean", "transformation is idempotent" |

Ask: "What is the business question, and at which seams should we declare an expectation?" Give each proposed seam a one-line note on what it catches and what it misses.

When the shape of the question itself is in question (what the analysis intends to prove, where the hypothesis boundary lies, which metric is the source of truth), refine the hypothesis before declaring expectations — the clarity of the question decides the usefulness of every verification that follows.

## Anti-patterns

- **Hindsight (post-hoc rationalization)**: the prediction is written *after* seeing the result, so it always "matches". The tell: the expectation shapes itself to the data instead of the data judging the expectation. Expected values must come from an independent source of truth — prior knowledge, literature, a definition set before the experiment, or domain understanding — not by re-deriving what the data itself showed.
- **Tautological**: the deviation is computed the same way the analysis computes it (e.g. expecting `mean == sum/n`), so it passes by construction. The source of truth must be external: a known benchmark, a domain reference value, a hand-worked case.
- **Horizontal slicing**: declaring all hypotheses first, then running all of them. Bulk verifications test *imagined* relationships: you test the *shape* of things rather than the behavior of interest, the expectations go insensitive to real changes, and you commit to a structure before understanding the data. Work in **vertical slices** instead: one hypothesis → one verification → iterate, each slice a **tracer bullet** that responds to what the last cycle taught you.

## Rules of the loop

- **Expectation before trust (red).** Declare the hypothesis/prediction *before* looking at the result and running the verification, then only enough analysis/pipeline to pass it. Don't anticipate future hypotheses or add speculative checks.
- **One slice at a time.** One seam, one expectation, one minimal verification per cycle.
- **Refactoring is not part of the loop.** It belongs to the review stage (see the `code-review` skill), not the hypothesis loop.
- **Deviation is information, not failure.** When the expectation fails, the next step is not "make it pass at all costs": it is to **investigate** whether the deviation is (a) bad data / pipeline error, or (b) a wrong premise by the scientist. Classifying correctly decides whether the fix is technical or whether the expectation needs to be revised with justification.
- **Separate exploratory from confirmatory.** Exploratory discovers hypotheses and is free-form; confirmatory tests hypotheses and is rigid (expectation pre-registered before collection). Don't treat exploratory analysis as confirmatory — that classic error fabricates conclusions without support.

Wersje

W bazie nie ma innych skilli o nazwie expectation-driven-science.

Migawka bazy z 13.11.2026 · wersja paczki e01f4009518b (skrót SHA-256 całej paczki)

Pobrania w ostatnich 30 dniach: 0 · ranking

Zgłoś problem z tym skillem: szkodliwa treść, błędny opis albo prośba autora o usunięcie.

Podobne skille

  • 100science
    Wspiera analizę naukową i rozumowanie na danych zgodnie z metodą naukową, z hipotezami i przeglądem badań.
  • 90hypothesis-test
    Przeprowadza test hipotezy statystycznej: sprawdza założenia, dobiera test i wyjaśnia wynik prostym językiem.
  • 100thinking-science
    Prowadzi pętlę eksperymentowania opartą na hipotezach: formułuje testowalne hipotezy, wskazuje, co by je sfalsyfikowało, projektuje testy, analizuje wyniki i aktualizuje wiedzę.
  • 90what-i-do
    Pokazuje, jak łączą się skille data science i który uruchomić następnie, od hipotezy do notebooka.
  • 87hypothesys
    Wypytuje o hipotezę z nauki o danych lub ML, aż stanie się jasna, sprawdzalna i powiązana z metrykami celu.
  • 100edd
    Stosuje lekki TDD dla kodu pisanego z AI: przed każdym kawałkiem formułuje oczekiwania, uruchamia je i zapisuje wyniki w pliku EXPECT.md.

Uwagi i zgłoszenia

Wiadomość trafi do Bartosza Sokolińskiego. Adres e-mail jest potrzebny tylko do odpowiedzi. Szczegóły w polityce prywatności.