What users are saying about
11 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>Score 9 out of 100
Based on 11 reviews and ratings
Top Rated
245 Ratings
<a href='https://www.trustradius.com/static/about-trustradius-scoring' target='_blank' rel='nofollow noopener'>trScore algorithm: Learn more.</a>Score 8.7 out of 100
Based on 245 reviews and ratings
Attribute Ratings
- AWS Device Farm is rated higher in 1 area: Support Rating
- AWS Device Farm and Selenium are tied in 1 area: Likelihood to Recommend
Likelihood to Recommend
9.3
AWS Device Farm
93%
4 Ratings

9.3
Selenium
93%
55 Ratings
Likelihood to Renew
AWS Device Farm
N/A
0 Ratings

9.2
Selenium
92%
6 Ratings
Usability
AWS Device Farm
N/A
0 Ratings

8.7
Selenium
87%
6 Ratings
Support Rating
10.0
AWS Device Farm
100%
2 Ratings

8.1
Selenium
81%
19 Ratings
Implementation Rating
AWS Device Farm
N/A
0 Ratings

9.0
Selenium
90%
6 Ratings
Likelihood to Recommend
AWS Device Farm
AWS Device Farm is perfect for small teams who don't have enough resources to conduct large scale testing scenarios or even large teams who would like an easier time with testing on various devices. [AWS] Device Farm makes it very easy to interact with a multitude of devices right from the browser.

Verified User
Executive in Engineering
Medical Device Company, 1-10 employeesSelenium
Selenium is one of the few tools on the market that allows interaction with a browser that is open-source, so it would be really hard to fault/beat it. It's actually available to use in many languages (like Java, Javascript, Python, etc.), so it does cater to many out there. The use case is simple, but powerful, "to imitate a real user interacting with a webpage". This opens up so much in regards to Front end automation and will automate many of your test cases which you would normally manually perform, in a much slower and error-prone way. In addition, you could write scripts to act as tools, if say an API isn't exposed to you. For example, you could create scripts to register an account on a website with different randomised usernames each time. So not just limited to testing. The only downside is that Selenium could hit a scenario where it becomes stuck, then it will crash and require you to debug where it went wrong. But this is more down to the logic of the scripts rather than Selenium itself. You would need to know your product well to cater to these scenarios as Selenium won't handhold you to why things crash/fail.

Verified User
Professional in Quality Assurance
Gambling & Casinos Company, 51-200 employeesPros
AWS Device Farm
- Integration with CI/CD Pipeline
- Diversity in Real Devices over the Cloud
- Pay as you go option
- Reproduce Issues and easily collect all kinds of logs
Lead Quality Engineer
SumergeComputer Software, 51-200 employees
Selenium
- For any web based UI automation, Selenium is the best tool out there to automate your tests.
- It supports multiple coding languages like Java, Python, Ruby, C# etc.. to choose from.
- There is a huge community of users and can get many answers on StackOverFlow.
- It has lot of other plugins to make your tests even more efficient.

Verified User
Professional in Quality Assurance
Information Technology and Services Company, 10,001+ employeesCons
AWS Device Farm
- Interface (CLI) not very easy. Competition has better options.
- Integration with IDE for test case coding.
- Reporting for the test scripts executed.

Verified User
Executive in Information Technology
Consumer Goods Company, 10,001+ employeesSelenium
- Selenium is pretty user-friendly but sometimes tests tend to flake out. I'd say roughly one out of twenty tests yields a false positive.
- Selenium software cannot read images. This is a minor negative because a free plug-in is available from alternate sources.
- Slowness may be a minor factor with Selenium, though this is an issue with basically any testing software since waiting on a site to execute JavaScript requires the browser to wait for a particular action.

Verified User
Manager in Quality Assurance
Civil Engineering Company, 51-200 employeesPricing Details
AWS Device Farm
General
Free Trial
—Free/Freemium Version
—Premium Consulting/Integration Services
—Entry-level set up fee?
No
Starting Price
$0.005 per instance minute
AWS Device Farm Editions & Modules
Edition
Pay-As-You-Go | $0.171 |
---|---|
Unlimited Testing | $250.002 |
Private Devices | $200.002 |
Pay as You Go - Desktop Browsers | $0.0053 |
- per device minute
- per month
- per instance minute
Additional Pricing Details
—Selenium
General
Free Trial
—Free/Freemium Version
—Premium Consulting/Integration Services
—Entry-level set up fee?
No
Starting Price
—Selenium Editions & Modules
—
Additional Pricing Details
—Likelihood to Renew
AWS Device Farm
No score
No answers yet
No answers on this topic
Selenium
Selenium 9.2
Based on 6 answers
We love this product mainly because of its high customization abilities and the ease of use. Moreover, its free and can be learned easily through online communities and videos. The tests are more consistent and reliable as compared to Manual tests. It has enabled us to test a large number of features all in one go, which would have impossible through manual tests. The reports generated at the end of the tests are really helpful for the QA and the development teams to get a fair view of the application.
Test Engineer
NexJ SystemsComputer Software, 201-500 employees
Usability
AWS Device Farm
No score
No answers yet
No answers on this topic
Selenium
Selenium 8.7
Based on 6 answers
As I mentioned earlier, the reason I use Selenium is because there is a fairly widespread community of users, and user support services are at a good level. because the application is open source, it works on many platforms (Windows, Linux, IOS) without any problems. In addition, it gives us a lot of options for writing functional tests. For errors that we receive through the application, we can easily find the reasons for errors in the forums.
Business Intelligence & Database Consultant
EMO A.ŞInformation Technology & Services, 501-1000 employees
Support Rating
AWS Device Farm
AWS Device Farm 10.0
Based on 2 answers
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Verified User
Executive in Information Technology
Consumer Goods Company, 10,001+ employeesSelenium
Selenium 8.1
Based on 19 answers
Selenium does not have technical support available easily. You have to go through forums to get the information you need. However, there are excellent forums out there that make it easy to troubleshoot. The open-source flexibility makes it difficult to have dedicated support.

Verified User
Manager in Engineering
Hospitality Company, 51-200 employeesImplementation Rating
AWS Device Farm
No score
No answers yet
No answers on this topic
Selenium
Selenium 9.0
Based on 6 answers
We did everything we needed to use it.Now we can execute our tests on different operational systems and browsers running few tests simultaneously.We also implemented Appium framework to execute our tests on mobile devices, such as iPhones, iPads, Android phones and tablets.We use SauceLabs for our test execution and Jenkins for continuous integration.
Lead QA Automation Engineer
FareCompare.comMarketing and Advertising, 11-50 employees
Alternatives Considered
AWS Device Farm
I got more features and handy within AWS Device farm than AWS Cloud9
Founder & Technical Director
Essence SolusoftComputer Software, 11-50 employees
Selenium
Sikuli is a GUI automation program that offers an alternative for web based (and any other engine) programs. Sikuli's native language is Python. However, users can customize the software with add-ons similar to Selenium add-ons. These add-ons extend the use of Sikuli to languages such as Java, JavaScript, many C based languages, etc.
QA Lead
Inhance DigitalMarketing and Advertising, 51-200 employees
Return on Investment
AWS Device Farm
- Quicker testing leads to faster product to market times
- Can deploy updates much more regularly by testing across many devices quickly

Verified User
Executive in Engineering
Medical Device Company, 1-10 employeesSelenium
- There hasn’t been a downside to using it yet other than we’ve got to update the programs we create for each change.
- This has saved us hundreds of hours of manpower by allowing our automation engineer to rapid fire tests.
- We are able to screenshot and save entire sites before and after launch with a program the automation engineer created
- We can compare large volumes of data against data in excel docs with a program created using Selenium
Quality Assurance Analyst
Deltak - Wiley Education ManagementMarketing and Advertising, 501-1000 employees