Creating and Running Manual Tests

Sofy provides a simple way for you to perform manual tests on your apps. Once you’ve created and run a manual test, you can record it as a success or failure and view the test reports.

It’s important to understand that manual testing is different from automated testing. Manual testing is performed by a human, who runs through a test case manually step-by-step, without test scripts. Automated testing, on the other hand, is executed automatically via steps performed and recorded one time in Sofy’s Device Lab.

Before creating a manual test, you should first create a release for your app.

Creating a Manual Test

  1. Log in to your Sofy account.
  2. Select Manual Tests from the left navigation bar.
  3. Click the Add New button in the top right-hand corner.
  4. Choose how you want to create a manual test:
    1. Create New Test Case: Create a new manual test case.
      1. Enter a Case Name.
      2. Briefly describe your test case under Description.
      3. Provide the list of steps for your test case under Repro Steps.
      4. Choose a person to assign the test case to under Assigned To.
      5. Click Create.
    2. Import from Azure Devops: Import your manual test cases from your Azure DevOps account. Note: You must integrate your Azure DevOps account with Sofy to use this feature.
    3. Import from CSV: Import your manual test cases from a CSV file.
      1. Download the Sample CSV file and ensure your CSV file is formatted correctly for import.
      2. Click Upload CSV file and upload a CSV file from your device.
        If successfully uploaded, the window will close and the test cases will appear in the Test Cases table.
    4. Create test with SofySense: Create a manual test case using SofySense, Sofy’s AI-powered assistant. SofySense can review app feature info from Confluence pages and recommend test case steps, or receive general recommendations on testing your app’s security or performance. Visit Creating Test Cases Using SofySense to learn more.

Running a Manual Test

  1. Log in to your Sofy account.
  2. Click Device Lab from the left navigation bar.
  3. Acquire and launch a device.
  4. Under Manual Tests, click on the manual test you want to run on your app.
  5. Select the green Play button in the top right-hand corner.
  6. Toggle the Actions/Steps to show either the list of actions made during the test or the reproduction steps provided in the test case.
  7. Test your app as needed, following the reproduction steps provided in the test case Steps.
  8. Once you’ve finished performing a manual test, mark your test case as either failed or passed:
    1. Passed: Click the green checkmark icon in the top right-hand corner to mark your test as passed.
    2. Failed: Click the red x icon in the top right-hand corner to mark your test as failed.
      If you have an issue-tracking software integrated with Sofy (like Jira), and you’d like to add an issue to your board:
      1. Select Yes from the Manual Test Case Failed modal window.
      2. Fill out the Issue Title, Issue Type, and Description fields.
      3. Check Device Logs to include device log data in this issue.
      4. Under Push Issue to, select the desired issue-tracking software. Note: You must integrate your issue-tracking software account with Sofy to use.
      5. Click Create.

You can find the results of your manual test by going to Manual Tests > Test Runs.

You can also convert any manual test to an automated test case. Visit Converting a Manual Test into an Automated Test to learn more.

How did we do?