Appium vs. OutSystems vs. React Native

1. It's open source which supports range of languages, operating systems and languages. Well suited for Android and IOS mobile automation. Supports all kinds of apps, which makes it flexible and robust mobile testing tool 2. It is less appropriate where we need intercept network call to verify the API calls. Extensive coding experience is required to work Appium

Incentivized

Well suited for internal exposure of business processes (invoicing, API layer to other systems, customer maintenance etc), whether a UI is required or not. Not so well suited for full fledged web design. An OutSystems application must serve one particular business need, if gets too much functionalities and responsibilities it tends to get chaotic and complex.

Incentivized

We are implementing React Native framework for the development of the Front-End for the machine learning models maintenance and monitoring website. It provides meaningful error messages, and time-saving and robust tools make it a premium choice over other platforms. Moreover, it provides intelligent debugging tools and error report mechanisms. And most importantly for us, it provides the aesthetic minimal functionality to learn in order to implement it, thereby eliminating the need to work in Xcode or Android Studio for iOS or Android apps respectively.

Incentivized

• It uses WebDriver API so it makes it easy to use for former web test automation engineers.
• It can be managed via the command line via an extensive set of parameters.
• It handles implicit waits at the server side that is especially valuable in distributed infrastructure.

Incentivized

• Developing end user interfaces with ease and speed with a modern look and feel.
• First class low code development to reduce time to market with visual programming
• Their technical support team is fast and responsive. We've yet to have any issues they could not resolve.

Incentivized

• Customized Components
• State Management
• Extensibility
• Usage and Community

Incentivized

• Element browser sometimes is unreliable and has sporadic fails.
• Appium running is a bit slow, compared to tests written with Appium and with Espresso or XCTest.

Incentivized

• Price – The licensing model of OutSystems is very expensive and not suitable for small scale developments. This is offset by the time to develop and stability for larger scale developments
• Flexibility on PaaS version – The PaaS hosted version of OutSystems limits your flexibility to access the front end and backend database systems which can significantly restrict your options on high data volume developments or where anything requiring slightly out of the ordinary access is required
• Same price for PaaS and self-hosted system. Licensing model dictates that you pay the same price even when you host the system on your own hardware which effectively means you pay more to manage the infrastructure yourself

Incentivized

• Performance is still lower than native app development (Kotlin, Swift, etc.)
• Not efficient design-wise (if you are planning to implement some advanced design, then you should reconsider the approach provided by React Native)
• Issues with the update to the last release of React Native

Incentivized

I am rating 10/10 because Appium can use with multiple programming languages with multiple Test engines. Also, it works for both Android and iOS.

Incentivized

We are very happy with OutSystems and our developers deliver good work. OutSystems lets us build new software on a regulare (2 weekly) basis, which is highly flexible and adjustable. Even without very much experience, our developers manage to build usefull software, which is working a lot better than our previous (legacy) software.

I would like to give 9/10 rating to Appium because of it can easily integrate with popular frameworks and CI/CD tools, as well as it is reliable, flexible and easy to use. The setup can bit complex in initial step, but once on configured it's very easy to use and enables stable and scalable mobile automation for real and cloud devices.

Incentivized

OutSystems has a feature in which we can develop a functionality in a application and can use that functionality in another application without developing it again. That is main plus point for the development team so they can work with different functionalities rather focusing on the same thing again and again. if we want to make any change on the user side then we can make it live with just the deployment using the service center.

Incentivized

The tech support is very reachable. Usually by [email] from but also by phone if needed. We had some difficulties at the start with understanding "what our machine was doing" under high performance load. After some good sessions understanding our needs they delivered good solutions for our problems we had in the beginning.

Excellent material full of hands on that improve the understanding of the platform.

The online training material is well designed and explanations are step by step, helping trainees to understand and follow each exercise and new concept.

In a large company, patiently and consistently work the behind the scenes politics with business and IT partners across the firm.
This is transformational - you will need a solid set of key business partners to lock arms together to move forward.

Incentivized

If you're an Apple developer, you use Xcode. It's practically a forced necessity. For system testing though, it doesn't have to be. You can have your development team focus on unit and integration tests in their platform and another team automate acceptance tests with a language they are more familiar with.

Incentivized

I tried to use WordPress with some success. Also looked at Joomla. But when I saw OutSystems I knew I had been wasting my time there. It takes you longer to get going with OutSystems - but even I as a novice realized immediately that Outsystems is simply in another league. Outsystems is powerful. (Can you compare WordPress and Joomla to Outsystems - I don't think so).

Decision for React Native came mainly from the big popularity of the framework. Thus, we had a big base of resources we could come back to. We also used it because it is a javascript framework. Thus, we could utilize the already existing experience in javascript and web development to ensure a smoother implementation of the app.

Incentivized

• Appium is open source, so it's free. That's budget friendly right there.
• The ability to write mobile automation tests has saved considerable time for our manual test team, but that is true with most automation tests.
• We use Sauce Labs with our other automation, but Appium works great with Sauce Labs, as well, if I needed to run on emulators and simulators.

Incentivized

• The ease of use of the OutSystems development process has been the biggest ROI for us. We have developed our Framework product and maintained/enhanced it with only 4 workers.
• OutSystems has enhanced their product very significantly over the last 4 years. They have gone from a simple to use tool to a very simple to use sophisticated tool that covers the standard mainframe-based computing apps and the apps used on handheld mobile devices all using the same basic set of development tools.

Incentivized

• Decreased the development process time via robust and easy-to-use platform
• Easier to debug with a provided intelligent tool as well as error-prone messages, which allows developing in a paced manner for the decreased Time-To-Market
• Reusable code base can directly impact lead time and thereby on ROI in a positive manner

Incentivized