Adding Q&As via Slack

When your team discusses security questions, compliance topics, or product details in Slack, those answers often contain valuable knowledge that belongs in your library. The Slack Knowledge Updater lets you capture that knowledge with a single emoji reaction.

Note: This feature requires the Conveyor Slack integration to be installed and configured.

---

How it works

1. A team member reacts to a Slack message with your configured emoji (e.g. 🧠).
2. ConveyorAI reads the full thread and extracts Q&A pairs from the conversation.
3. ConveyorAI checks each extracted pair against your existing Knowledge Library for potential conflicts.
4. A summary of the extracted Q&A pairs — along with any conflicts — is posted back to Slack.
5. You review, edit, and confirm which pairs to save directly from Slack.

---

Setup

Prerequisites

• The Conveyor Slack integration must be installed.
• You must be a Conveyor admin (owner, compliance owner, or compliance rooms collaborator).

Enable the Knowledge Updater

1. Navigate to Organization Preferences.
2. Under your Slack integration settings, enable KB Updates from Slack.
3. Configure the following settings:

Important: Triggering the bot in private channels is not supported.

---

Extracting Q&A pairs from a thread

To extract Q&A pairs from any Slack thread in an allowed channel, react to any message in that thread with your configured emoji.

ConveyorAI will:

1. Post a loading message to let you know it's working.
2. Read all messages in the thread.
3. Use AI to identify and extract up to 10 distinct Q&A pairs from the conversation.
4. Check against your existing Knowledge Library for conflicts.
5. Update the Slack thread with a summary of the results.

Tip: You only need to react once per thread. Reacting to any message in the thread processes the entire thread. Duplicate reactions on the same thread are automatically ignored.

---

Reviewing extracted Q&A pairs

Once extraction and conflict detection are complete, ConveyorAI presents the results in one of two formats depending on how many Q&A pairs were found.

Fewer than 4 Q&A pairs (inline review)

When ConveyorAI finds 3 or fewer Q&A pairs, they are displayed directly in the Slack message:

• Each Q&A pair is shown with its question and answer text.

• If conflicts were detected, they appear below the relevant pair with details about the conflicting Knowledge Library entry.

• Three action options are available:

  • Accept All — Save all extracted Q&A pairs to your Knowledge Library as-is.
  • Edit Q&As — Open a modal to review, edit, or deselect individual pairs before saving.
  • Ignore All (in the ... menu) — Dismiss all extracted pairs without saving.
  
  

  

4 or more Q&A pairs (summary view)

When ConveyorAI finds 4 or more Q&A pairs, a compact summary is shown:

• The message indicates how many Q&A pairs were extracted and how many have conflicts.

• Two action options are available:

  • Edit Q&As — Open a modal to review all pairs in detail.
  • Ignore All (in the ... menu) — Dismiss all extracted pairs without saving.

---

Editing Q&A pairs in the modal

Clicking Edit Q&As opens a modal where you can:

• Edit questions and answers — Modify the text of any extracted pair.
• Assign product lines — Tag each pair with one or more product lines (if configured for your organization).
• Select which pairs to save — Use the "Add this answer" checkbox to include or exclude individual pairs.
• Review conflicts — See conflict details inline for each pair, including the conflicting source and a brief explanation.
• Add new pairs — Empty slots are provided so you can manually add Q&A pairs that ConveyorAI may have missed.

When you're ready, click Save to add the selected pairs to your Knowledge Library.

---

Conflict detection

ConveyorAI automatically checks each extracted Q&A pair against your existing Knowledge Library to identify potential conflicts — cases where a new answer might contradict or overlap with existing content.

What counts as a conflict

A conflict is flagged when an extracted Q&A pair covers similar subject matter to an existing Knowledge Library entry but provides a different or potentially contradictory answer. ConveyorAI evaluates this using AI analysis of both the new and existing content.

What you'll see

For each Q&A pair with conflicts, ConveyorAI shows:

• The number of conflicts detected.
• A brief explanation of why each conflict was flagged.
• The source of the conflicting content (e.g., a curated Q&A, past answer, or document) along with a text excerpt and a link to view the original entry.

What to do about conflicts

Conflicts are informational — they don't prevent you from saving a Q&A pair. Use them to:

• Identify outdated entries in your Knowledge Library that need updating.
• Decide whether the new Q&A pair should replace, supplement, or be discarded in favor of existing content.
• Keep your Knowledge Library consistent and free of contradictions.

---

Ignoring extracted Q&A pairs

If the extracted Q&A pairs aren't useful, select Ignore All from the ... overflow menu. This dismisses the extraction without saving anything to your Knowledge Library.

After ignoring:

• The Q&A pairs remain visible in the message for reference.
• For summary views (4+ pairs), a View Q&As button lets you open the pairs in a read-only modal.
• The Accept All, Edit Q&As, and Save options are disabled — no pairs can be saved from a dismissed session.

---

After saving

Once Q&A pairs are saved, the Slack message updates to confirm what was added. For each saved pair, you'll see:

• The question title.
• A snippet of the answer.
• A View in library link that takes you directly to the entry in your Knowledge Library within Conveyor.

---

Permissions

Who can trigger the Knowledge Updater

• Standard mode (no destination channel configured): Only Conveyor admins (owner, compliance owner, or compliance rooms collaborator roles) can trigger the Knowledge Updater by reacting with the configured emoji.
• Routed mode (destination channel configured): Any Slack user can react with the emoji to trigger extraction. If the user does not have a Conveyor account, the organization's fallback user is used.

Who can review and save Q&A pairs

Only Conveyor admins can interact with the review buttons (Accept All, Edit Q&As, Ignore All) and save Q&A pairs via the modal.

---

Common questions

Can I use the Knowledge Updater with private channels?

The Knowledge Updater can only be triggered in public channels that are included in your Allowed channels list. However, you can configure a private channel as the Destination channel using the channel ID — extracted Q&A pairs will be routed there for review. To do this, make sure the Conveyor bot has been invited to the private channel using the /invite command.

I just added new knowledge, but conflict detection isn't picking it up. Why?

Newly added Knowledge Library content takes some time to be indexed. It may not surface in conflict detection right away. If you're not seeing expected conflicts, wait a bit and try again.

I triggered the Updater, but now I need to re-trigger it in the same thread. Why isn't it working?

The Knowledge Updater cannot be re-triggered on the same thread once it has already run. This prevents duplicate processing. To run the Updater again on similar content, start a new thread and trigger it there.

Can I set up separate emoji reactions for different Slack features?

The Knowledge Updater uses its own dedicated emoji configured in your Organization Preferences. This emoji is separate from other Conveyor Slack features (such as @Conveyor mentions for one-off questions). However, you cannot configure multiple emojis for different Knowledge Updater behaviors.

Do you offer limited permissions for users who only need emoji-based features?

No. There are no separate permission roles for emoji-only features at this time. Users who trigger or review Knowledge Updater results must have a Conveyor admin role (owner, compliance owner, or compliance rooms collaborator). If you need to limit who can review extracted Q&A pairs, consider using the routed mode with a dedicated destination channel.