Test Environment

Time to complete: 5 minutes

Prerequisites: At least one document uploaded to your Knowledge Library

Introduction

When adding new documents to your Knowledge Library, you may want to evaluate how they perform before using them in live customer questionnaires. Test Environment Access lets you control which documents are available in test questionnaires versus live customer questionnaires, so you can validate document performance without affecting production answers.

This is particularly useful when you're replacing critical documents like SOC 2 reports with updated versions and want to compare how ConveyorAI responds before making the switch.

How It Works

Every document in your Knowledge Library has two environment access settings:

• Live environment access: When enabled, ConveyorAI can reference this document when answering customer questionnaires.
• Test environment access: When enabled, ConveyorAI can reference this document when answering test questionnaires (marked as internal tests).

All documents have both environments enabled by default.

You can enable one, both, or neither setting depending on your use case:

Setting Document Environment Access

When you add or edit a document, you'll see the ConveyorAI Access section under "Share With." This section contains two toggles under Environments:

1. Live environment access — "For answering customer questionnaires"
2. Test environment access — "For internal testing only"

Toggle each setting on or off based on how you want the document to be used.

By default, new documents have both environments enabled. To restrict a document to test questionnaires only, turn off "Live environment access" while keeping "Test environment access" on.

Viewing Document Environment Status

In the Knowledge Library, the Shared With column shows each document's environment configuration:

• ConveyorAI — Available in both live and test environments
• ConveyorAI (Live) — Available only in live questionnaires
• ConveyorAI (Test) — Available only in test questionnaires
• Internal only — Not available to ConveyorAI in any environment

Test Questionnaires

Test questionnaires provide a safe way to validate how ConveyorAI uses your new documents before they go live. When you mark a questionnaire as an internal test, ConveyorAI only references documents with "Test environment access" enabled—your live-only documents won't be used.

Test questionnaires don't consume usage credits, so you can run as many as you need during evaluation. Answers generated in test questionnaires are isolated from your production data: they won't be saved to Past Answers or influence future customer responses.

Creating Test Questionnaires

To run a test questionnaire that uses only test-environment documents:

1. Navigate to Questionnaires and click Add Questionnaire.
2. Check the box Mark this questionnaire as an internal test.
3. Complete the remaining fields and upload your questionnaire.

Example: Testing Updated SOC Reports

A common use case is testing new versions of compliance documents before replacing the current versions. Here's how to set this up:

Scenario: You have a new SOC 2 Type II report and want to test how it performs before replacing your existing report.

1. Upload your new SOC 2 report to the Knowledge Library.
2. Edit the new document and set:
   • Live environment access: Off
   • Test environment access: On
3. Edit your existing SOC 2 report and set:
   • Live environment access: On
   • Test environment access: Off
4. Create a test questionnaire with sample security questions.
5. Review the AI-generated answers to validate the new document performs as expected.
6. Once satisfied, swap the environment settings to make the new document live.

This approach lets you compare answers side-by-side without affecting customer questionnaires during the evaluation period.

Common Questions

What happens if I disable both environments for a document?
The document remains in your Knowledge Library but ConveyorAI won't use it to answer any questionnaires. This is useful for archiving documents you want to keep but not actively use.

Can I use test environment access with Curated Q&As?
Currently, environment access settings apply only to documents. Curated Q&As are available in all questionnaires regardless of test status.

Do test questionnaires count against my credits?
No, running test questionnaires for documents do not consume credits.

How do I know which documents a test questionnaire will use?
Test questionnaires use documents with "Test environment access" enabled. Check the "Shared With" column in your Knowledge Library to see which documents show "ConveyorAI (Test)" or "ConveyorAI" (both environments).

Can I convert a test questionnaire to a live questionnaire?
No. The test designation is set when the questionnaire is created and cannot be changed. If you need live answers, create a new questionnaire without the internal test checkbox.

What's Next

• Adding new documents
• Editing documents
• Importing questionnaires
• Troubleshooting inaccurate answers

---

Need help? Visit the Troubleshooting guide or contact [email protected].