Test Cases

Test cases in Coherence represent realistic scenarios with corresponding data, forming the final output of your task.

Scenario Generation

The generation process happens in two main stages. First, the system creates human-readable scenario descriptions drawing from your defined dimensions and requirements. These scenarios can be influenced by your hints and constraints, ensuring they're distributed meaningfully across your test space.

You have several controls at your disposal when managing test cases. You can specify how many cases to generate, provide hints to guide specific scenarios, generate cases in batches or one at a time, and keep track of the generation progress.

Inputs and Outputs

Next comes data generation, where the system produces both input and output data that aligns with your schema. Each piece of generated data undergoes quality checks and validation, and the system supports generating data in batches when needed.

Throughout the generation process, quality assurance happens on two fronts. The system performs automated checks including schema validation, realism assessment, consistency verification, and edge case detection.

You can also manually review generated cases, make edits where necessary, flag cases for regeneration, and add hints to guide the system in generating better cases.

Bulk Operations

For handling multiple test cases, bulk operations are available. You can generate multiple cases at once, export them to CSV format, import modified cases back into the system, and delete or archive cases as needed.