huggingface-datasets
/huggingface-datasets
Przeszukuje zbiory danych Hugging Face przez API podglądu: listuje podzbiory, czyta wiersze, filtruje, szuka tekstu i pokazuje statystyki bez pobierania.
- Autor
- The-Utopia-Studio ↗
- Repozytorium
- skills ↗
- Licencja
- Apache-2.0
- Ostatnia zmiana repozytorium
- 11.11.2026
Ocena i bezpieczeństwo
- Pliki w paczce
- 1
- Skrypty
- 0
- Komentarze HTML
- 0
- Adresy URL w SKILL.md
- 6
Brak sygnałów. Repozytorium zmienione 11.11.2026, bez odwołań do wycofanych modeli i API.
Apache-2.0, otwarta: można używać i zmieniać, z zachowaniem licencji i informacji o zmianach.
Co robi i kiedy
Przeszukuje zbiory danych Hugging Face przez API podglądu: listuje podzbiory, czyta wiersze, filtruje, szuka tekstu i pokazuje statystyki bez pobierania.
Oryginalny opis (EN)
Queries Hugging Face datasets through the Dataset Viewer API: list subsets and splits, preview and paginate rows, search text, filter rows, get parquet links, sizes and column statistics, and run SQL on parquet. Use when the user wants to explore, sample, search or filter a Hub dataset, read its rows or statistics, or find its parquet files without downloading it.
Jak działa
- Core workflow
- Defaults
- Dataset Viewer
- Querying Datasets
- Creating and Uploading Datasets
Podgląd SKILL.md
--- name: huggingface-datasets description: >- Queries Hugging Face datasets through the Dataset Viewer API: list subsets and splits, preview and paginate rows, search text, filter rows, get parquet links, sizes and column statistics, and run SQL on parquet. Use when the user wants to explore, sample, search or filter a Hub dataset, read its rows or statistics, or find its parquet files without downloading it. --- # Hugging Face Dataset Viewer Use this skill to execute read-only Dataset Viewer API calls for dataset exploration and extraction. ## Core workflow 1. Optionally validate dataset availability with `/is-valid`. 2. Resolve `config` + `split` with `/splits`. 3. Preview with `/first-rows`. 4. Paginate content with `/rows` using `offset` and `length` (max 100). 5. Use `/search` for text matching and `/filter` for row predicates. 6. Retrieve parquet links via `/parquet` and totals/metadata via `/size` and `/statistics`. ## Defaults - Base URL: `https://datasets-server.huggingface.co` - Default API method: `GET` - Query params should be URL-encoded. - `offset` is 0-based. - `length` max is usually `100` for row-like endpoints. - Gated/private datasets require `Authorization: Bearer <HF_TOKEN>`. ## Dataset Viewer - `Validate dataset`: `/is-valid?dataset=<namespace/repo>` - `List subsets and splits`: `/splits?dataset=<namespace/repo>` - `Preview first rows`: `/first-rows?dataset=<namespace/repo>&config=<config>&split=<split>` - `Paginate rows`: `/rows?dataset=<namespace/repo>&config=<config>&split=<split>&offset=<int>&length=<int>` - `Search text`: `/search?dataset=<namespace/repo>&config=<config>&split=<split>&query=<text>&offset=<int>&length=<int>` - `Filter with predicates`: `/filter?dataset=<namespace/repo>&config=<config>&split=<split>&where=<predicate>&orderby=<sort>&offset=<int>&length=<int>` - `List parquet shards`: `/parquet?dataset=<namespace/repo>` - `Get size totals`: `/size?dataset=<namespace/repo>` - `Get column statistics`: `/statistics?dataset=<namespace/repo>&config=<config>&split=<split>` - `Get Croissant metadata (if available)`: `/croissant?dataset=<namespace/repo>` Pagination pattern: ```bash curl "https://datasets-server.huggingface.co/rows?dataset=stanfordnlp/imdb&config=plain_text&split=train&offset=0&length=100" curl "https://datasets-server.huggingface.co/rows?dataset=stanfordnlp/imdb&config=plain_text&split=train&offset=100&length=100" ``` When pagination is partial, use response fields such as `num_rows_total`, `num_rows_per_page`, and `partial` to drive continuation logic. Search/filter notes: - `/search` matches string columns (full-text style behavior is internal to the API). - `/filter` requires predicate syntax in `where` and optional sort in `orderby`. - Keep filtering and searches read-only and side-effect free. ## Querying Datasets Use `npx parquetlens` with Hub parquet alias paths for SQL querying. Parquet alias shape: ```text hf://datasets/<namespace>/<repo>@~parquet/<config>/<split>/<shard>.parquet ``` Derive `<config>`, `<split>`, and `<shard>` from Dataset Viewer `/parquet`: ```bash curl -s "https://datasets-server.huggingface.co/parquet?dataset=cfahlgren1/hub-stats" \ | jq -r '.parquet_files[] | "hf://datasets/\(.dataset)@~parquet/\(.config)/\(.split)/\(.filename)"' ``` Run SQL query: ```bash npx -y -p parquetlens -p @parquetlens/sql parquetlens \ "hf://datasets/<namespace>/<repo>@~parquet/<config>/<split>/<shard>.parquet" \ --sql "SELECT * FROM data LIMIT 20" ``` ### SQL export - CSV: `--sql "COPY (SELECT * FROM data LIMIT 1000) TO 'export.csv' (FORMAT CSV, HEADER, DELIMITER ',')"` - JSON: `--sql "COPY (SELECT * FROM data LIMIT 1000) TO 'export.json' (FORMAT JSON)"` - Parquet: `--sql "COPY (SELECT * FROM data LIMIT 1000) TO 'export.parquet' (FORMAT PARQUET)"` ## Creating and Uploading Datasets Use this section only when the user requests dataset creation or upload. Exploration, preview, search, filtering and extraction remain read-only; never create a repo or upload data as a side effect of inspecting a dataset. Use one of these flows depending on dependency constraints. Zero local dependencies (Hub UI): - Create dataset repo in browser: `https://huggingface.co/new-dataset` - Upload parquet files in the repo "Files and versions" page. - Verify shards appear in Dataset Viewer: ```bash curl -s "https://datasets-server.huggingface.co/parquet?dataset=<namespace>/<repo>" ``` Low dependency CLI flow (`npx @huggingface/hub` / `hfjs`): - Set auth token: ```bash export HF_TOKEN=<your_hf_token> ``` - Upload parquet folder to a dataset repo (auto-creates repo if missing): ```bash npx -y @huggingface/hub upload datasets/<namespace>/<repo> ./local/parquet-folder data ``` - Upload as private repo on creation: ```bash npx -y @huggingface/hub upload datasets/<namespace>/<repo> ./local/parquet-folder data --private ``` After upload, call `/parquet` to discover `<config>/<split>/<shard>` values for querying with `@~parquet`.
Wersje
| Repozytorium | Wynik | Licencja |
|---|---|---|
| Ta strona · The-Utopia-Studio/skills | 100 | Apache-2.0 |
| FrancoStino/opencode-skills-collection | 100 | MIT |
| sickn33/agentic-awesome-skills | 100 | MIT |
| huggingface/skills | 100 | Apache-2.0 |
| PracticalSwan/agent-skills | 100 | MIT |
| pinkpixel-dev/skills-collection-1 | 100 | Apache-2.0 |
| sandbaseai/sandbase-skills | 90 | Apache-2.0 |
Migawka bazy z 13.11.2026 · wersja paczki 03fe7e63d26f (skrót SHA-256 całej paczki)
Pobrania w ostatnich 30 dniach: 0 · ranking
Zgłoś problem z tym skillem: szkodliwa treść, błędny opis albo prośba autora o usunięcie.
Podobne skille
- 95dataset-finder
Wyszukuje i pobiera zbiory danych z Kaggle, Hugging Face, UCI ML Repository i Data.gov, pokazuje statystyki i generuje karty danych. - 100dataset-discovery
Wyszukuje zbiory danych ML w HuggingFace Hub, OpenML, GitHubie i odnośnikach z publikacji pod zadanie badawcze. - 100fiftyone-dataset-export
Eksportuje zbiory FiftyOne do formatów COCO, YOLO, VOC, CVAT i CSV oraz publikuje je na Hugging Face Hub. - 100huggingface-models-expert
Dobiera, dostraja i wdraża modele Hugging Face z użyciem transformers, datasets i Inference Endpoints. - 98huggingface
Pomaga korzystać z Hugging Face i bibliotek transformers, datasets, peft oraz huggingface_hub: ładowanie i uruchamianie modeli, fine-tuning, publikacja na Hubie i Inference API. - 100querying-big-datasets
Analizuje zbiory zbyt duże na pandas przez SQL w DuckDB na zdalnych plikach Parquet, najpierw na próbkach i agregacjach.