Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Appium
Score 8.8 out of 10
N/A
N/AN/A
Selenium
Score 8.4 out of 10
N/A
Selenium is open source software for browser automation, primarily used for functional, load, or performance testing of applications.N/A
Xamarin
Score 6.0 out of 10
N/A
N/AN/A
Pricing
AppiumSeleniumXamarin
Editions & Modules
No answers on this topic
No answers on this topic
Xamarin
Free
Offerings
Pricing Offerings
AppiumSeleniumXamarin
Free Trial
NoNoNo
Free/Freemium Version
NoNoYes
Premium Consulting/Integration Services
NoNoNo
Entry-level Setup FeeNo setup feeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
AppiumSeleniumXamarin
Considered Multiple Products
Appium
Chose Appium
Appium is a wrapper of selenium and is available for mobile based applications. It has also the similar features as selenium has for website automation. Together both provide a combined solution for automating web and mobile apps. Can provide end to end automation with a …
Chose Appium
Most of mobile testing tools which are available in the market are paid license tools. But Appium is Open source mobile testing tool. We can create customised automation framework using Appium. It also supports various languages such as Java, Javascript etc. And also supports …
Chose Appium
Appium is one of the most valuable fully featured open-source tools with good support for iOS and Android mobile automation which cannot be matched even by enterprise tools.
Chose Appium
Appium is comparable with Calabash because it's the only cross-platform tool like appium. Espresso is only to automate Android tests and XCTest is only for iOS. We selected Appium because it solves a lot of automation situations and gestures of the mobile apps. We've used …
Chose Appium
Hard to compare Appium to Xcode and Android sdk because Appium uses them, but those are the only comparisons I could come up with to compare Appium with another product. I'm sure there may be other mobile automation tools, but none are as mainstream as Appium or with the …
Selenium
Chose Selenium
It is one of the leading open source tools with lot of good features to go well with web automation.
Chose Selenium
Selenium supports more browsers, selenium has huge open source community, and, best of all, it's free
Xamarin

No answer on this topic

Features
AppiumSeleniumXamarin
Automation Testing
Comparison of Automation Testing features of Product A and Product B
Appium
-
Ratings
Selenium
10.0
1 Ratings
17% above category average
Xamarin
-
Ratings
Record and Automate00 Ratings10.01 Ratings00 Ratings
Multi-Browser Testing00 Ratings10.01 Ratings00 Ratings
Test Management00 Ratings10.01 Ratings00 Ratings
Integrated Version Control00 Ratings10.01 Ratings00 Ratings
Object Recognition00 Ratings10.01 Ratings00 Ratings
Data-Driven Testing00 Ratings10.01 Ratings00 Ratings
Testing Reports & Analytics00 Ratings10.01 Ratings00 Ratings
Best Alternatives
AppiumSeleniumXamarin
Small Businesses
Swiftify
Swiftify
Score 9.0 out of 10
BrowserStack
BrowserStack
Score 8.5 out of 10
Swiftify
Swiftify
Score 9.0 out of 10
Medium-sized Companies
Swiftify
Swiftify
Score 9.0 out of 10
ReadyAPI
ReadyAPI
Score 6.3 out of 10
Swiftify
Swiftify
Score 9.0 out of 10
Enterprises
Swiftify
Swiftify
Score 9.0 out of 10
ignio AIOps
ignio AIOps
Score 8.1 out of 10
Swiftify
Swiftify
Score 9.0 out of 10
All AlternativesView all alternativesView all alternativesView all alternatives
User Ratings
AppiumSeleniumXamarin
Likelihood to Recommend
9.8
(10 ratings)
9.2
(55 ratings)
7.0
(12 ratings)
Likelihood to Renew
10.0
(1 ratings)
9.2
(6 ratings)
10.0
(1 ratings)
Usability
9.0
(1 ratings)
8.8
(6 ratings)
10.0
(1 ratings)
Support Rating
-
(0 ratings)
8.3
(11 ratings)
10.0
(2 ratings)
Implementation Rating
-
(0 ratings)
9.0
(3 ratings)
10.0
(1 ratings)
User Testimonials
AppiumSeleniumXamarin
Likelihood to Recommend
JS Foundation
1. It's open source which supports range of languages, operating systems and languages. Well suited for Android and IOS mobile automation. Supports all kinds of apps, which makes it flexible and robust mobile testing tool 2. It is less appropriate where we need intercept network call to verify the API calls. Extensive coding experience is required to work Appium
Read full review
Open Source
When you have to test the UI and how it behaves when certain actions are performed, you need something that can automate the browsers. This is where Selenium comes to the rescue. If you have to test APIs and not the frontend (UI), I would recommend going with other libraries that support HTTP Requests. Selenium is good only when you have no choice but to run the steps on a browser.
Read full review
Microsoft
If you are required to develop applications that are cross-platformed, Xamarin is a great tool to use. It will help save time and effort from your development team to be able to build applications seamlessly for android, IOS, Windows, and web on a single platform instead of requiring multiple tools to get the job done.
Read full review
Pros
JS Foundation
  • It uses WebDriver API so it makes it easy to use for former web test automation engineers.
  • It can be managed via the command line via an extensive set of parameters.
  • It handles implicit waits at the server side that is especially valuable in distributed infrastructure.
Read full review
Open Source
  • For any web based UI automation, Selenium is the best tool out there to automate your tests.
  • It supports multiple coding languages like Java, Python, Ruby, C# etc.. to choose from.
  • There is a huge community of users and can get many answers on StackOverFlow.
  • It has lot of other plugins to make your tests even more efficient.
Read full review
Microsoft
  • Xamarin allows you to write cross platform code. This allows companies to build apps more quickly by writing less code. Having code abstracted and reused across multiple platforms allows for more testing and less issues overall.
  • The ability to use Visual Studio is a huge plus. Visual Studio is one of the best IDE's available and being able to write cross platforms apps while in a great IDE makes everything less painful.
  • Xamarin is now free with a large company backing. This means that bugs on the platform get fixed more quickly and there is a large community of developers.
Read full review
Cons
JS Foundation
  • Element browser sometimes is unreliable and has sporadic fails.
  • Appium running is a bit slow, compared to tests written with Appium and with Espresso or XCTest.
Read full review
Open Source
  • Selenium is pretty user-friendly but sometimes tests tend to flake out. I'd say roughly one out of twenty tests yields a false positive.
  • Selenium software cannot read images. This is a minor negative because a free plug-in is available from alternate sources.
  • Slowness may be a minor factor with Selenium, though this is an issue with basically any testing software since waiting on a site to execute JavaScript requires the browser to wait for a particular action.
Read full review
Microsoft
  • Forms - not 100% there. Still needs work but is production ready.
  • iOS - sometimes errors can be hard to understand, if they even show up.
  • Insights - Xamarin offers their own crash analytics software. However, it's not perfect and sometimes doesn't pick up crashes.
Read full review
Likelihood to Renew
JS Foundation
I am rating 10/10 because Appium can use with multiple programming languages with multiple Test engines. Also, it works for both Android and iOS.
Read full review
Open Source
We love this product mainly because of its high customization abilities and the ease of use. Moreover, its free and can be learned easily through online communities and videos. The tests are more consistent and reliable as compared to Manual tests. It has enabled us to test a large number of features all in one go, which would have impossible through manual tests. The reports generated at the end of the tests are really helpful for the QA and the development teams to get a fair view of the application.
Read full review
Microsoft
Xamarin has been great for developing different projects efficiently and effectively. It's nice to reuse the core business logic across different platforms so that there are less to maintain and little replications are needed. The biggest benefit is that C# programmers do not have to learn a different language to do mobile development.
Read full review
Usability
JS Foundation
I would like to give 9/10 rating to Appium because of it can easily integrate with popular frameworks and CI/CD tools, as well as it is reliable, flexible and easy to use. The setup can bit complex in initial step, but once on configured it's very easy to use and enables stable and scalable mobile automation for real and cloud devices.
Read full review
Open Source
For those who are unfamiliar with coding, there is a bit of a learning curve. There is plenty of helpful documentation and resources but it can take a little time to get the software up and running. Once you get the hang of how Selenium works, and what it can do, you realize how many things you can use it for, and how many processes you can automate.
Read full review
Microsoft
If you are required to develop applications that are cross-platformed, Xamarin is a great tool to use. It will help save time and efforts from your development team to be able to build applications seamlessly for android, IOS, windows, and web on a single platform instead of requiring multiple tools to get the job done
Read full review
Support Rating
JS Foundation
No answers on this topic
Open Source
The Selenium app has a pretty fat community of users. For the problems we are experiencing, we are primarily receiving support from these communities. In addition, there is widespread service support. Instant support is given to the problems we experience when we need Online support. We and our team are happy to provide this support, especially before important deployment processes
Read full review
Microsoft
I never had to contact support for any help. Most of the problems we ran into, we were able to identify and use peer support through blogs and other internet sources to resolve the problems. There are plenty of sources online which provide tutorials, discuss problems, etc. Example: StackOverflow
Read full review
Implementation Rating
JS Foundation
No answers on this topic
Open Source
We did everything we needed to use it. Now we can execute our tests on different operational systems and browsers running few tests simultaneously. We also implemented Appium framework to execute our tests on mobile devices, such as iPhones, iPads, Android phones and tablets. We use SauceLabs for our test execution and Jenkins for continuous integration.
Read full review
Microsoft
Just with any programming tasks, have a plan first. Design out the system, spend time to build it correctly the first time and have plenty of testing and user acceptance opportunities. Xamarin was easy to implement for a C# programmer. However, you need to do tutorials to realize the platform's capabilities.
Read full review
Alternatives Considered
JS Foundation
If you're an Apple developer, you use Xcode. It's practically a forced necessity. For system testing though, it doesn't have to be. You can have your development team focus on unit and integration tests in their platform and another team automate acceptance tests with a language they are more familiar with.
Read full review
Open Source
At the time of adoption, there were not many other alternatives that were even close to being competitive when it comes to browser testing. As far as I know now to this day, there is still little competition to Selenium for what it does. Any other browser-based testing still utilises Selenium to interact with the browser.
Read full review
Microsoft
Xamarin runs natively on MacOS, and the debugger and other integration and auto-complete tools are far better than Eclipse for C# .NET. It also carries much of the plugin/add-on capabilities that are so desirable on Atom. Eclipse is a better for generalized software development, provided a developer is comfortable switching between the IDE the command line for certain parts of their workflow, like building, package management, or debugging. But for C# .NET development on MacOS specifically, Xamarin is the best product I've used for the job.
Read full review
Return on Investment
JS Foundation
  • Appium is open source, so it's free. That's budget friendly right there.
  • The ability to write mobile automation tests has saved considerable time for our manual test team, but that is true with most automation tests.
  • We use Sauce Labs with our other automation, but Appium works great with Sauce Labs, as well, if I needed to run on emulators and simulators.
Read full review
Open Source
  • There hasn’t been a downside to using it yet other than we’ve got to update the programs we create for each change.
  • This has saved us hundreds of hours of manpower by allowing our automation engineer to rapid fire tests.
  • We are able to screenshot and save entire sites before and after launch with a program the automation engineer created
  • We can compare large volumes of data against data in excel docs with a program created using Selenium
Read full review
Microsoft
  • Saves development time and deliver fast.
  • Allows inhouse developers build both Android and iOS application without switching languages.
  • Allows use coding in C# in Visual studio IDE from which we can code in different languages. We don't need multiple IDEs installed
Read full review
ScreenShots