TestComplete - easy to use product but needs lots of testing to produce reliable tests
December 08, 2023
TestComplete - easy to use product but needs lots of testing to produce reliable tests
Score 7 out of 10
Vetted Review
Verified User
Overall Satisfaction with TestComplete
I use TestComplete on a daily basis. For the last 3 year I have been dogged by compatibility issues, TC browser extensions issues, slowness, freezing. The product can't properly perform object recognition (if button exits then click it, if button does not exist then try.. ) Support and Account managers take a long time to respond to tickets and often the issues are blockers for me. Some of their support engineers are amazing but just take ages to get your issue to them, the phones are hardly ever answered and when they do the person can't address your issue. I find tests have to be run over 100 times to verify the results and work out any bugs to get anything stable enough to run (anything large than unit tests). I frequently get an error and the product stops error says "there has been an error" and gives not details, multiple supports ticket have been raised about this issue and they just say "it works for us" All other feature such as mobile testing (Bitbar) are additional costs - a small free amount would be nice considering the price AM just send out blanket emails to subscribers and any other emails about new products/services without any consideration to if you have the product, have already updated or are listed as the licensing contact - all other users in my licensing group regularly receive and send me the product email they get I am currently investigating alternatives as this products will if not reliable to test my WEB systems
- item highlighting in Keywords tests
- nice interface
- can call and integrate between scripting and keywords testing
- integrate to Jenkins
- Reliability - running same tests over 100 times have produced less than 80% success rate
- Support - blocker issue can wait for day and there is no phone support
- Namemapping - system tries to update name used in multiple locations
- Freezing - gets stuck in loops and and unexpected error happens like variables not available and the system won't suggest this, leaving you to debug 100+ lines of code
- frequent updates that introduce encoding and browser errors - I don't believe the properly test their own product
- Namemapping won't allow you to choose your own names when you first select them
- keep sending email about renewing subscription and that you can get a lower price without checking if they have already sent/asked and if you are the correct contact for your account - e.g. a junior user that just joined got an email about the pricing structure and what we were paying
- Recording Keyword tests
- Data integration (Data driven loops)
- Time / Stress / reliability
- Something that can be done in 3 weeks could potentially be automated an run in a day - instead I have been trying to run and rewrite this for the past 3 years without success
Do you think TestComplete delivers good value for the price?
No
Are you happy with TestComplete's feature set?
Yes
Did TestComplete live up to sales and marketing promises?
No
Did implementation of TestComplete go as expected?
Yes
Would you buy TestComplete again?
No