Mobile App Testing Frequently Asked Questions

Testing Support FAQ

Does Sofy support manual testing? 

Yes! Sofy has a lab full of real devices you can use for testing from anywhere in the world.  The only difference between our lab and you holding a real device in your hands is that your mouse becomes your finger.  

Does Sofy offer testing services? 

We understand sometimes test cases need to be rapidly onboarded and additional resources are required. Sofy does provide service engagement – for details, please reach out to sofysales@sofy.ai.

Does Sofy support load testing? 

No. Sofy operates on a shared device pool model and does not support load testing with real devices. However, similar results can be achieved using API calls. 

Does Sofy support mobile web testing?

Sofy is a no-code automation testing platform. Today, we support ad-hoc/manual and automated testing on mobile applications. We provide limited functionality for mobile web and are actively working towards improving our capabilities. Please reach out to customersupport@sofy.ai for mobile web support and we will gladly work with you to address your needs.

Does Sofy support API testing? 

Yes! API calls can be utilized to allow sending voice/biometric data that would otherwise require the device’s camera or microphone to allow further UI testing. You can also use APIs to interact with your backend and fetch data that can be used as input variables in the test. Additionally, the data captured from API calls can be used in separate API calls as part of their header or body. Visit Adding API Step to a Test to learn more.  

Does Sofy support using TestFlight?

Yes. TestFlight is a platform for distributing and testing mobile applications on iOS and is used by developers to distribute beta versions of their iOS apps for testing.

To use TestFlight

  1. Click on the Use TestFlight button at top right.
  2. Select a device of your choice.
  3. Enter your TestFlight credentials.

Now you can install the app you want to test. Once your app is installed, you can begin running manual tests.

However, if you would like to automate your no-code testing, we recommend you integrate Sofy with your Continuous Integration / Continuous Deployment (CI/CD) platform. This allows you to distribute your new builds to your QA team automatically, streamlining the testing process. Automating the testing process through CI/CD integration can help improve the overall quality of the code, as well as increase efficiency and collaboration between development and testing teams.

Does Sofy support the latest OS versions for Android and iOS?

Sofy devices and services support the latest Android 14 and iOS 17 versions. Currently, we are testing iOS 18 and Android 15 Beta to ensure your testing experience is seamless. Recent changes to iOS automation with iOS 18 require a reboot for enterprise app approval which disrupts automated testing. To ensure your testing is not disrupted, we will keep going with the latest iOS updates pre-iOS 18 until we can integrate a solution.

Running Tests FAQ

Can we use our own devices to create and run automated tests with Sofy? 

Yes, you can. You can add your own device farm onto our network of devices to use alongside Sofy’s provided devices. During your onboarding, we’ll ensure the process of adding your own devices goes as smoothly as possible.

Please contact customersupport@sofy.ai to enable this feature on your account. 

Are there any differences in the way Sofy tests Android and iOS devices? 

No, Sofy's user experience and functionality are identical for both Android and iOS apps. However, due to iOS limitations, disabling WiFi and network throttling on iOS devices is not available. 

When I create an automated test case, can I use the same test across Android and iOS devices? 

No, you should not run the same test across Android and iOS devices as the app implementation for these platforms is different. For example, there may be differences in an app's navigation between both platforms, which can result in failed tests. For that reason, we treat Android and iOS apps as separate entities for testing. 

Why do I see some latency when interacting with my mobile app in the Device Lab compared to interacting with it on my mobile device? 

When using Sofy to record a test, you are interacting with a real device through the internet, which can result in different performance compared to using a device directly. However, Sofy takes measures to reduce latency and provide a seamless experience. For instance, during manual testing, we replicate the device action on your browser within three seconds. Similarly, during recording mode, the action is mirrored to your browser within six seconds. During this time, Sofy captures the network call for the action, identifies the clicked component based on the current screen layout, and records the action in a format that can be replayed on any device, regardless of its manufacturer or operating system. 

To ensure optimal performance, the following should be considered:

  • A stable high-speed internet connection is crucial for a smooth experience when interacting with the device remotely.
  • Accessing the network through a firewall or VPN with applied restrictions can impact performance. In such cases, we recommend reviewing your network configuration and firewall settings to ensure that no restrictions are slowing down the internet connection. 
Can I install my choice of VPN on Sofy devices to test mobile apps? 

Yes. However, as VPN configurations and policies can vary across apps, we recommend that you connect with customersupport@sofy.ai to help you set up your VPN on Sofy devices. Note: You can only use your VPN with an upgraded plan that provides you with a dedicated device.

How can I use One-Time-Password (OTP) when authorizing my app on Sofy? 

Most of our customers take one of the following approaches:

  1. Setup a static value as an OTP code in the staging environment
    OR
  2. Fetch the OTP code as an API response (see here on how to save an API response as your test variable). 
Our staging environment requires whitelisting. Where can I find Sofy’s IP addresses? 

Please reach out to customersupport@sofy.ai and we will connect you with the right person for whitelisting information. 

 

How did we do?