Frequently Asked Questions (FAQs)
Here are the most frequently asked questions we hear from our customers:
Uploading an Application
Do you support both Android and iOS Apps? What file formats are supported for testing on Sofy?
Yes, we support testing for both Android and iOS devices. You can upload your APK file for Android and IPA file for iOS. Once uploaded, the process for creating a no-code automation test is the same.
How can I upload my application build to Sofy?
You can upload a build manually or via your CI/CD pipeline. Click here to see instructions for manual upload. And click here to see instructions for integrating with your CI/CD pipeline.
Can I download an iOS App from the Apple App Store, upload it to Sofy, and run it?
Due to the manner in which Apple designs its apps to operate on Apple devices, this is not possible. The best way to test an iOS app is to sign a developer provisioned build with the UDIDs of Sofy iOS Devices.
How do I get the UDIDs of specific iOS devices if I don't want Sofy to resign builds for me?
With a paid subscription, you can request iOS device UDIDs by sending an email request to the following address: support@sofy.ai
What build types are supported for distributing iOS applications?
We support the following build types: Signed Dev Provisioning builds, Ad Hoc builds, and Enterprise builds.
I don't have a signed IPA. Is that a problem?
Not at all. Sofy's automatic re-signing capability will kick in when Sofy detects an unsigned IPA. Click here to learn how to enable this feature.s
Additional Information
Does Sofy support manual testing?
Yes, we do! Sofy has a lab full of real devices that you are able to use for testing from anywhere in the world. The only difference between our lab and you holding a real device in your hands is that your mouse becomes your finger.
Does Sofy offer testing services?
We understand sometimes test cases need to be rapidly onboarded and often times additional resources are required. We do provide a services engagement, for details, please reach out to hyder@sofy.ai.
Does Sofy support load testing?
Sofy operates on a shared device pool model, and currently does not support load testing with real devices. Though similar results can be achieved via utilizing API calls.
Does Sofy support API testing?
Yes indeed! API calls can be utilized to allow sending voice / biometric data that would otherwise require the device’s camera or microphone to allow further UI testing. You can also use APIs to interact with your backend and fetch data that can be used as input variables in the test. Additionally, the data captured from API calls can be used in separate API calls as part of their header or body. For a more detailed instruction on how to use Sofy's API capabilities, please click here.
Can we use our own devices to create and run automated scenarios with Sofy?
Yes you can. You can add your own device farm onto our network of devices to use in conjunction with our devices. Our onboarding process will make sure this process goes as smoothly as possible. Please contact us (support@sofy.ai) if this is a functionality you would like to enable.
Are there any differences in the way Sofy tests Android and iOS devices?
No, Sofy's user experience and functionality are identical for both Android and iOS apps. However, due to iOS limitations, disabling wifi and network throttling on iOS devices is not available.
When I create an Automated Test Case, can I use the same test across Android and iOS devices?
No, app implementation across Android and iOS environments can be different. For example, there may be subtle differences in an app's flow across the platforms which can easily result in failed tests. For that reason, we treat Android apps and iOS apps as separate entities for testing purposes.
Can I install my choice of VPN on Sofy devices to test Mobile Apps?
Yes, however, as VPN configurations and policies can vary across Apps and your organization’s needs, we recommend that you connect with our support team (support@sofy.ai) to help you setup VPN on Sofy devices for your testing needs. Before you can use your choice of VPN, you will need to upgrade to a Sofy plan that provides you with a dedicated device and we will help you configure the device to your specific VPN requirements.
Does Sofy support mobile web testing?
Sofy is a no-code automation testing platform. Today, we support ad hoc / manual and automated testing on mobile applications. We provide limited functionality for mobile web and are actively working towards improving our capabilities. Please reach out to us (support@sofy.ai) if you need support for mobile web and we will gladly work with you to address your needs.
Does Sofy.ai support using TestFlight?
Yes. TestFlight is a platform for distributing and testing mobile applications on iOS. It is used by developers and testers to distribute beta versions of their iOS apps for testing purposes. You can click on Use TestFlight button (located on the top right of the Home tab), select a device of your choice, enter your TestFlight credentials and now you can install the App you want to test. Once the App is installed on the device, you can start performing manual testing.
However, if you would like to automate your no-code testing, we recommend you integrate Sofy with your Continuous Integration / Continuous Deployment (CI/CD) platform. This allows you to distribute your new builds to the QA team automatically, streamlining the testing process. Automating the testing process through CI/CD integration can help improve the overall quality of the code, as well as increase efficiency and collaboration between development and testing teams.
Our staging environment requires whitelisting, where can i find your IP addresses?
Please reach out to our support team at support@sofy.ai and we will be sure to connect you with the right person for whitelisting information.
Why don’t I see iOS devices during my trial subscription?
iOS devices become visible after you upload an iOS App. Please note that Sofy's iOS app testing option is not available during trial subscriptions.
I can only access one device during trial, does this change when I subscribe as a customer?
Yes, you can access multiple devices when you subscribe as a customer. The number of devices you can access will depend on your subscription plan.
How can I use One-Time-Password (OTP) when authorizing my App on Sofy?
Most of our customers take one of the following approaches, (a) setup a static value as an OTP code in the staging environment, or (b) fetch OTP code as an API response (see here on how to save an API response as your test variable).
Why do I see some latency when interacting with my mobile App in the Device Lab compared to interacting with it on my mobile device?
When using Sofy.ai to author (record) a no-code test, you are interacting with a real device through the internet, which can result in different performance compared to using a device directly. Nevertheless, Sofy.ai takes measures to reduce latency and provide a seamless experience. For instance, during manual testing, we replicate the device action on your browser within three seconds. Similarly, during recording mode, the action is mirrored to your browser within six seconds. During this time, Sofy.ai captures the network call for the action, identifies the clicked component based on the current screen layout, and records the action in a format that can be replayed on any device, regardless of its manufacturer or operating system.
To ensure optimal performance, several external factors need to be considered. Firstly, a stable high-speed internet connection is crucial for a smooth experience when interacting with the device remotely. Secondly, accessing the network through a firewall or VPN with applied restrictions can impact performance. In such cases, we recommend reviewing your network configuration and firewall settings to ensure that no restrictions are slowing down the internet connection.
SofySense
What information does SofySense use for analyzing test results?
SofySense uses an OpenAI-powered Large Language Model (LLM) to analyze test results and provide actionable insights. It condenses Sofy results, sending only the action performed, device metrics, and any errors encountered during execution to the AI model for thorough analysis, generating valuable insights and recommendations for users.
Does SofySense have access to my App's code binary?
No, SofySense does not have access to your App's code binary. The platform focuses on analyzing test results and providing insights based on data provided. As a result, your code binary is not passed to the AI model and remains secure and confidential.
What information does SofySense gather from the confluence page to create a manual test case?
SofySense retrieves content from your integrated Confluence page and uses an OpenAI-powered LLM to intelligently generate test cases based on the provided details, ensuring accuracy and efficiency. This process takes into account the context and requirements outlined on the page. Note that integration with your Atlassian account is required for SofySense to access the content from your Confluence page.
How to extend your trial
What are “device minutes”?
The amount of time user spends on any device acquired is calculated in minutes.
How are device minutes calculated?
Sofy aggregates all device minutes across sessions that user spends in each billing cycle.
What are the different types of device sessions?
a) Device Lab session
b) Schedule run
What happens if user exceeds device minutes allocated?
If user exhausts all device minutes that are allocated as per subscribed plan, then user will not be able to access any mobile devices and will get an error message “Device Hours Limit Exceeded”.
How to add more device hours?
Reach out to customersupport@sofy.ai if your devices minutes are exceeded and you would like to add additional minutes to your account.
