message-queues
/message-queues
Choose between queues and streams, and configure ordering, consumer groups, and dead letters correctly. Use when introducing async messaging or debugging lost, duplicated, or reordered messages.
- Author
- Amey-Thakur ↗
- Repository
- AI-SKILLS ↗
- Licence
- MIT
- Last repository change
- 05.09.2026
Assessment and security
- Files in this package
- 1
- Scripts
- 0
- HTML comments
- 0
- URLs in SKILL.md
- 0
No signals detected. Repository changed on 05.09.2026, without references to retired models or APIs.
MIT, open: use and modify while retaining author attribution.
What it does and when to use it
Choose between queues and streams, and configure ordering, consumer groups, and dead letters correctly. Use when introducing async messaging or debugging lost, duplicated, or reordered messages.
Original author description
Choose between queues and streams, and configure ordering, consumer groups, and dead letters correctly. Use when introducing async messaging or debugging lost, duplicated, or reordered messages.
How it works
- Method
- Boundaries
SKILL.md preview
--- name: message-queues description: Choose between queues and streams, and configure ordering, consumer groups, and dead letters correctly. Use when introducing async messaging or debugging lost, duplicated, or reordered messages. --- # Message queues Queues distribute work (each message consumed once, then gone); streams record facts (each message read by many, retained). Most messaging pain comes from using one where the other fits. ## Method 1. **Pick the model from the consumption pattern.** One consumer pool doing jobs: queue (SQS, RabbitMQ). Multiple independent readers, replay, event history: stream/log (Kafka, Kinesis, Redpanda). "We might need replay later" is how queues get misused; be honest about whether messages are commands or events. 2. **Scope ordering to a key, or drop it.** Global ordering caps throughput at one consumer. Order per entity (partition key = order_id) covers real needs: same entity in sequence, entities in parallel. With plain queues, do not rely on FIFO-ish behavior; retries reorder. Consumers discard stale updates via sequence numbers. 3. **Design consumer groups around partitions.** In streams, one partition serves one consumer per group: more consumers than partitions idle; hot keys skew load. Pick partition counts with 2-3x headroom and keys with even cardinality; rebalancing pauses the group, so keep processing fast or use cooperative rebalancing. 4. **Ack after effect, expect redelivery.** Acknowledge (or commit offsets) only after the side effect is durable; the crash between effect and ack is why every consumer must dedupe or be idempotent (see idempotent-consumers). Auto-ack/auto-commit-on-receive silently converts crashes into data loss. 5. **Configure the failure path day one.** Per-queue DLQ with alerting on depth and age (see background-jobs); for streams, a parking-lot topic plus a skip-and-log policy, because one poison message otherwise halts its whole partition forever. 6. **Watch lag, not just depth.** Consumer lag (offset delta or oldest unacked age) trending up under steady input is the earliest overload signal; alert on lag age, scale consumers before the retention window becomes the deadline. ## Boundaries - A message broker between two services you own, deployed together, is often just latency; direct calls with timeouts-and-retries may serve better until there is a real fan-out or buffering need. - Broker-side retention is not a database; if consumers need queries, land events into one (see event-sourcing for when the log is the source of truth). - Exactly-once delivery claims mean exactly-once processing within one vendor's brackets; across your side effects it is still idempotency.
Versions
The database has no other skills named message-queues.
Database snapshot: 13.11.2026 · package version 99fe6b75deb0 (SHA-256 digest of the entire package)
Downloads in the last 30 days: 0 · ranking
Report a problem with this skill: harmful content, incorrect descriptions or an author’s removal request.
Similar skills
- 100redis-pubsub-streams-queues
Use this skill when building decoupled message brokers and consumer groups using Redis Streams and pub/sub channels. - 80role-backend:message-queues
Implements message queue systems using RabbitMQ, Apache Kafka, Redis Streams, AWS SQS/SNS, and Google Pub/Sub. Covers topics, exchanges, dead letter queues, idempotency, ordering guarantees, consumer groups, backpressure handling, and message serialization. Use when setting up… - 100message-queues-interviewer
A Lead Data Engineer interviewer evaluating asynchronous messaging. Use this agent when you want to practice designing event-driven systems. It rigorously tests your understanding of RabbitMQ vs Kafka, at-least-once delivery guarantees, managing poison pills in Dead Letter… - 100cloudflare-queues
This skill should be used when the user asks to \"set up Cloudflare Queues\", \"create a message queue\", \"implement queue consumer\", \"process background jobs\", \"configure queue retry logic\", \"publish messages to queue\", \"implement dead letter queue\", or encountering… - 100azure-service-bus
Use when implementing reliable message processing with Azure Service Bus — choosing between queues and topics, configuring peek-lock settlement, handling dead-lettered messages, or enforcing ordered processing with sessions. - 100azure-service-bus
Use when implementing reliable message processing with Azure Service Bus — choosing between queues and topics, configuring peek-lock settlement, handling dead-lettered messages, or enforcing ordered processing with sessions.