Visitar URL original
Overlapping Messages | Chat SDK

Overlapping Messages

When a message arrives on a thread while a handler is still processing an earlier one, the SDK drops the new message by default. The concurrency option on ChatConfig lets you choose a different strategy.

Strategies

Drop (default)

This is the original behavior. If a handler is already running on a thread, the new message is discarded and a LockError is thrown. Nothing is queued or retried.

lib/bot.ts
const bot = new Chat({
  concurrency: "drop",
  // ...
});

Queue

Messages that arrive while a handler is running are enqueued. When the current handler finishes, only the latest queued message is dispatched. The intermediate messages are passed in context.skipped, so your handler can see everything that arrived while it was busy.

lib/bot.ts
const bot = new Chat({
  concurrency: "queue",
  // ...
});

bot.onNewMention(async (thread, message, context) => {
  if (context && context.skipped.length > 0) {
    await thread.post(
      `You sent ${context.totalSinceLastHandler} messages while I was thinking. Responding to your latest.`
    );
  }

  const response = await generateAIResponse(message.text);
  await thread.post(response);
});

Flow:

A arrives  → acquire lock → process A
B arrives  → lock busy → enqueue B
C arrives  → lock busy → enqueue C
D arrives  → lock busy → enqueue D
A done     → drain: [B, C, D] → handler(D, { skipped: [B, C] })
D done     → queue empty → release lock

Burst

Waits for debounceMs before the first handler on an idle thread, then drains the collected burst like queue. The latest message is dispatched, and earlier messages in the burst are available as context.skipped.

Use this for assistant-style bots where users often send one logical turn as several short messages inside a small window and you want one response with full context. Compared to debounce, burst keeps the earlier messages in context.skipped instead of dropping them, and it flushes queued messages that arrive while the handler is running.

Choose debounce when the latest message replaces earlier ones, like rapid corrections. Choose burst when earlier messages still matter, like "hey", "quick question", and then the actual question. The tradeoff is that even a lone message waits for debounceMs before the handler runs.

lib/bot.ts
const bot = new Chat({
  concurrency: { strategy: "burst", debounceMs: 1000 },
  // ...
});

bot.onNewMention(async (thread, message, context) => {
  const turn = [...(context?.skipped ?? []), message]
    .map((m) => m.text)
    .join("\n\n");

  const response = await generateAIResponse(turn);
  await thread.post(response);
});

Flow:

A arrives  → acquire lock → enqueue A → sleep(debounceMs)
B arrives  → lock busy → enqueue B
C arrives  → lock busy → enqueue C
             ... debounceMs elapses ...
           → drain: [A, B, C] → handler(C, { skipped: [A, B] })
D arrives while C is running → lock busy → enqueue D
E arrives while C is running → lock busy → enqueue E
C done     → drain: [D, E] → handler(E, { skipped: [D] })
E done     → queue empty → release lock

Debounce

The first message waits for debounceMs. Messages that arrive during that window replace the pending message, so only the final message in the window is processed.

This helps on platforms like WhatsApp and Telegram, where users tend to send several short messages in quick succession instead of composing one. "hey", "quick question", and "how do I reset my password?" can arrive as three separate webhooks within a few seconds. Without debounce, the bot would respond to "hey" before the actual question even arrives. With debounce, the SDK waits briefly and processes only the final message in the window.

lib/bot.ts
const bot = new Chat({
  concurrency: { strategy: "debounce", debounceMs: 1500 },
  // ...
});

WhatsApp and Telegram adapters default to lockScope: "channel", so debounce applies to the entire conversation rather than a single thread.

Flow:

A arrives  → acquire lock → store A as pending → sleep(debounceMs)
B arrives  → lock busy → overwrite pending with B (A dropped)
C arrives  → lock busy → overwrite pending with C (B dropped)
             ... debounceMs elapses with no new message ...
           → process C → release lock

Debounce also works well for rapid corrections ("wait, I meant...") and multi-part messages on any platform.

Concurrent

No locking. Every message is processed immediately in its own handler invocation. Use this for stateless handlers where thread ordering doesn't matter.

lib/bot.ts
const bot = new Chat({
  concurrency: "concurrent",
  // ...
});

Configuration

To tune queue size, eviction, and timing, pass a ConcurrencyConfig object instead of a strategy string:

lib/bot.ts
const bot = new Chat({
  concurrency: {
    strategy: "queue",
    maxQueueSize: 20,          // Max queued messages per thread (default: 10)
    onQueueFull: "drop-oldest", // or "drop-newest" (default: "drop-oldest")
    queueEntryTtlMs: 60_000,  // Discard stale entries after 60s (default: 90s)
  },
  // ...
});

All options

OptionStrategiesDefaultDescription
strategyall"drop"The concurrency strategy to use
maxQueueSizequeue, burst10Maximum queued messages per thread
onQueueFullqueue, burst"drop-oldest"Whether to evict the oldest or reject the newest message when the queue is full
queueEntryTtlMsqueue, debounce, burst90000TTL for queued entries in milliseconds. Expired entries are discarded on dequeue
debounceMsdebounce, burst1500Debounce window in milliseconds
maxLockLifetimeMsdrop, queue, debounce, burst600000Max total time one handler run may keep renewing its thread lock. After this, renewal stops and the lock lapses at its TTL, so a hung handler cannot block the thread forever
maxConcurrentconcurrentInfinityMax concurrent handlers per thread

maxConcurrent only applies to the concurrent strategy. Pairing it with any other strategy logs a warning and the value is ignored. Setting maxConcurrent to a value less than 1 throws at construction time, because 0 would deadlock the strategy.

MessageContext

All handler types (onNewMention, onSubscribedMessage, onNewMessage) accept an optional MessageContext as their last parameter. It is populated when using the queue strategy for queued messages, and when using burst for a collapsed turn. A lone burst message receives skipped: [] and totalSinceLastHandler: 1.

interface MessageContext {
  /** Messages that arrived while the previous handler was running, in chronological order. */
  skipped: Message[];
  /** Total messages received since last handler ran (skipped.length + 1). */
  totalSinceLastHandler: number;
}

The parameter is optional, so existing handlers that don't use context are unaffected.

Example: Pass all messages to an LLM

lib/bot.ts
bot.onSubscribedMessage(async (thread, message, context) => {
  // Combine skipped messages with the current one for full context
  const allMessages = [...(context?.skipped ?? []), message];

  const response = await generateAIResponse(
    allMessages.map((m) => m.text).join("\n\n")
  );
  await thread.post(response);
});

Lock scope

By default, locks are scoped to the thread, so messages in different threads are processed independently. For platforms like WhatsApp and Telegram where conversations happen at the channel level rather than in threads, the lock scope defaults to "channel".

You can override this globally:

lib/bot.ts
const bot = new Chat({
  concurrency: "queue",
  lockScope: "channel", // or "thread" (default)
  // ...
});

Or resolve it dynamically per message:

lib/bot.ts
const bot = new Chat({
  concurrency: "queue",
  lockScope: ({ isDM, adapter }) => {
    // Use channel scope for DMs, thread scope for group channels
    return isDM ? "channel" : "thread";
  },
  // ...
});

State adapter requirements

The queue, debounce, and burst strategies require three additional methods on your state adapter:

MethodDescription
enqueue(threadId, entry, maxSize)Atomically append a message to the thread's queue. Returns new depth.
dequeue(threadId)Pop the next (oldest) message from the queue. Returns null if empty.
queueDepth(threadId)Return the current number of queued messages.

All built-in state adapters (@chat-adapter/state-memory, @chat-adapter/state-redis, @chat-adapter/state-ioredis) implement these methods. The Redis adapters use Lua scripts for atomicity.

An adapter can namespace these state keys by tenant, so the key passed to your state adapter isn't always the bare thread ID. The Slack adapter in multi-workspace mode scopes deduplication, locks, queues, concurrency slots, and turn cancellation by installation. If you inspect state or recover from an incident with calls like queueDepth(threadId) or forceReleaseLock(threadId), those calls won't reach the namespaced keys. Log events still report the public threadId.

Observability

All strategies emit structured log events at info level:

EventStrategyData
message-queuedqueue, burstthreadId, messageId, queueDepth
message-dequeuedqueue, debounce, burstthreadId, messageId, skippedCount for queue/burst
message-droppeddrop, queue, burstthreadId, messageId, reason
message-expiredqueue, debounce, burstthreadId, messageId
message-supersededdebouncethreadId, droppedId
message-debouncingdebounce, burstthreadId, messageId, debounceMs
message-debounce-resetdebouncethreadId, messageId

Choosing a strategy

Use caseStrategyWhy
Simple bots, one-shot commandsdropNo queue to configure and no queue overhead
AI chatbots, customer supportqueueMessages that arrive mid-run are queued, up to maxQueueSize, and the handler sees them in context.skipped
AI chatbots with multi-message user turnsburstWait for the idle burst window, then respond once with every message in that window
WhatsApp/Telegram bots, rapid correctionsdebounceUsers send many short messages in quick succession; wait briefly and keep only the latest
Stateless lookups, translationsconcurrentHighest throughput when ordering doesn't matter

Backward compatibility

  • The default strategy is drop, so existing behavior is unchanged.
  • The deprecated onLockConflict option continues to work but should be replaced with concurrency.
  • Handler signatures are backward-compatible; the new context parameter is optional.
  • Deduplication always runs regardless of strategy.

Read more