data-tools

Data Tools Skill

Critical Rule

NEVER use grep, sed, awk, or inline interpreters (python3 -c, node -e) on JSON, JSONL, YAML, TOML, XML, or CSV. Refuse and use the correct tool — text tools break on structure; inline scripts are verbose and fragile.

---

Tool Selection

Format	Tool	Notes
JSON	jq	Or gh --jq for GitHub CLI
JSONL	mlr	Record-stream + DSL
YAML	yq	In-place via -i
TOML	dasel	Only native TOML tool
XML	dasel	Or xmlstarlet for XPath
CSV / TSV	qsv	Or mlr for cross-format / DSL
Multiple	dasel	Universal auto-detect

Convert: dasel -w FORMAT or yq -o FORMAT.

---

Key Patterns

jq -- JSON (no in-place)

jq -r '.version' package.json
jq '.users[] | select(.role == "admin") | .name' users.json
jq '.version = "2.0.0"' pkg.json > pkg.json.tmp && mv pkg.json.tmp pkg.json
jq -s '.[0] * .[1]' base.json override.json

yq -- YAML (in-place -i)

yq '.services.web.image' docker-compose.yml
yq -i '.services.app.image = "node:20"' docker-compose.yml
yq -o json config.yml

dasel -- TOML / XML / Universal

dasel -f Cargo.toml '.package.version'
dasel put -f config.toml -t string -v "2.0" '.project.version'
dasel -f input.json -w yaml

qsv -- CSV / TSV

qsv headers data.csv && qsv stats data.csv --everything | qsv table
qsv search -s status "active" users.csv | qsv select name,email
qsv join user_id orders.csv id users.csv

mlr -- JSONL / multi-format / DSL (in-place -I)

mlr --c2j cat data.csv
mlr --jsonl filter '$level == "error"' logs.jsonl
mlr -I --csv put '$total = $qty * $price' orders.csv

GitHub CLI -- always --jq

gh api repos/owner/repo/releases/latest --jq '.tag_name'
gh pr list --json number,title --jq '.[] | [.number, .title] | @tsv'

---

Anti-Patterns

# BAD → GOOD: jq -r '.version' package.json
grep '"version"' package.json | sed 's/.*"\(.*\)".*/\1/'
# BAD → GOOD: yq -i '.services.app.image = "node:20"' compose.yml
sed -i 's/image: node:.*/image: node:20/' docker-compose.yml
# BAD → GOOD: qsv select 2 data.csv
awk -F',' '{print $2}' data.csv
# BAD → GOOD: jq -r '.version' plugin.json
python3 -c 'import json;print(json.load(open("plugin.json"))["version"])'

---

References

Cookbook	Content
jq Cookbook	Filtering, transforms, GitHub CLI
yq Cookbook	Actions, Compose, K8s
dasel Cookbook	TOML/XML, conversion
CSV Processing	qsv workflows, joins
mlr Cookbook	JSONL, DSL, stats, joins

Docs: jq, yq, dasel, qsv, mlr.