TrustRadius: an HG Insights company

Devin (& Devin Desktop, formerly Windsurf) vs. TestComplete

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Devin

    Score9.1 out of 10
    N/ADevin is an autonomous software engineering platform from Cognition that can plan, write, run, test, and review code for engineering teams. The current product includes cloud-based agent workflows and Devin Desktop, which Cognition describes as the new name for Windsurf and positions as an IDE for managing local and cloud agents from one editor surface.

    $20

    per month

    TestComplete

    Score8 out of 10
    N/ATestComplete is a GUI test automation tool that enables users of all skill levels to test the UI of every desktop, web, and mobile application. TestComplete is best suited for testers, automation engineers, and QA teams in any industry.

    $2,256

    per license

    Pricing
    DevinTestComplete
    Editions & Modules
    Pro
    $20
    per month
    Max
    $200
    per month
    Enterprise
    Contact Sales
    Node-Locked Base
    2,256
    per license
    Node-Locked Pro
    3,950
    per license
    Float - Base
    5,077
    per license
    Float - Pro
    7,901
    per license
    Offerings
    Pricing Offerings
    DevinTestComplete
    Free Trial
    YesYes
    Free/Freemium Version
    YesNo
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details—Pay for only the modules needed. TestComplete Pro includes all three modules: desktop, web, and mobile, at a bundled price point, as well as access to the parallel testing engine, TestExecute. TestComplete has additional add-ons, including TestExecute and the Intelligent Quality Add-On.
    More Pricing Information
    Community Pulse
    DevinTestComplete
    Considered Both Products
    Cognition AI, Inc.
    No answer on this topic
    SmartBear
    No answer on this topic
    Key User Insights
    Would buy again
    No answers on this topic
    93%
    Would buy again
    25 Answers
    Delivers good value for the price
    No answers on this topic
    88%
    Delivers good value for the price
    22 Answers
    Happy with the feature set
    No answers on this topic
    93%
    Happy with the feature set
    25 Answers
    Lived up to sales and marketing promises
    No answers on this topic
    85%
    Lived up to sales and marketing promises
    22 Answers
    Implementation went as expected
    No answers on this topic
    85%
    Implementation went as expected
    22 Answers
    Best Alternatives
    DevinTestComplete
    Small Businesses
    No answers on this topic
    No answers on this topic
    Medium-sized Companies
    No answers on this topic
    OpenText UFT One
    Score8 out of 10
    Enterprises
    No answers on this topic
    SoapUI Open Source
    Score8.3 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    DevinTestComplete
    Likelihood to Recommend
    8.0
    (1 ratings)
    7.0
    (88 ratings)
    Likelihood to Renew
    -
    (0 ratings)
    8.1
    (6 ratings)
    Usability
    8.0
    (1 ratings)
    7.8
    (7 ratings)
    Support Rating
    -
    (0 ratings)
    6.6
    (7 ratings)
    Implementation Rating
    -
    (0 ratings)
    6.7
    (4 ratings)
    User Testimonials
    DevinTestComplete
    Likelihood to Recommend
    Cognition AI, Inc.
    If you already have technical knowledge and understanding of coding, Windsurf could be a valuable platform to debug and rewrite code. It was helpful to me to expand coding, since I am not a traditionally programmer. I was able to enhance my base code and functionality much quicker than manually trying.
    Incentivized
    Read full review
    SmartBear
    Best suited to smaller unit test or tests broken up, couple of forms at a time Not suited - larger regressions test involving multiple systems. - my main regression involving payments has been unsuccessful for the last 3 years despite all working fine separately and while being watched
    Read full review
    Pros
    Cognition AI, Inc.
    • Quick code isolation of sytax errors
    • quick suggestions on how to correct coding error
    Incentivized
    Read full review
    SmartBear
    • Identifying UI objects and application structure
    • Expandability of tests through scripts and script extensions/plugins
    • low barrier of entry (you can get started quickly, and other's don't need much explanation to contribute on a basic level)
    • Possibility of Jira integration for reporting
    • Relatively few (and usually easy to solve) git conflicts when working simultaneously
    • easy handling of test data, also for iterative tests
    Incentivized
    Read full review
    Cons
    Cognition AI, Inc.
    • Windsurf is target to more medium to advanced users
    • Windsurf does fast debugging, but technical skills are needed.
    • Windsurf is not as intuitive as I initially thought.
    Incentivized
    Read full review
    SmartBear
    • TestComplete could stand to have a simplified view for different types of users. For instance, as a manager/architecture guy, I'm not so interested in getting into the code and am more interested in file-based interactions.
    • TestComplete could use more integration with reporting for things like TeamCity to improve test status visibility.
    Incentivized
    Read full review
    Likelihood to Renew
    Cognition AI, Inc.
    No answers on this topic
    SmartBear
    We have bigger test automation pack using test complete at the same time we also think this is not good performing tool for large number of test automation scripts.
    Incentivized
    Read full review
    Usability
    Cognition AI, Inc.
    Windsurf is a good tool for developers with more than basic coding skills. I would recommend it as a tool to quickly mitigate coding errors and issues. I did not take a deeper dive into the integrated extensions, but the library of extensions appear to be solid. An experience developer could quickly launch this platform, scan and test coding, and resolve issues quickly. I did not test this for larger code sets.
    Incentivized
    Read full review
    SmartBear
    It is usable when you become accustomed to its quirks. Not using it for two months and then you need to re-learn the quirks for some features (but some quirks are so awful that they will never fade from your memory). So, when using it regularly, it is possible to be quite productive, if no big correction in name mapping is needed.
    Incentivized
    Read full review
    Support Rating
    Cognition AI, Inc.
    No answers on this topic
    SmartBear
    Some bugs were quickly resolved, but most UX quirks of the tool are just marked "as designed". No follow up for enhancement request.
    Incentivized
    Read full review
    Implementation Rating
    Cognition AI, Inc.
    No answers on this topic
    SmartBear
    If you develop a mobile application and your testing process goes in cloud, probably you will face a problem - how to implement a stable connection between your mobile devices and testing servers
    Incentivized
    Read full review
    Alternatives Considered
    Cognition AI, Inc.
    Windsurf would be more comparable to GitHub Copilot or Perplexity to me. I think it's more of a pure code debugging line by line than some of the other tools listed above, however, they all have some capabilities to rewrite and test new coding. It boils down to what toolset you are most comfortable with. I typically will work with two platforms with the same issue to see how it is approached and the differences.
    Incentivized
    Read full review
    SmartBear
    TestComplete stacks up against them in terms of GUI and seamless performance. It records each and every step and action been performed in the application and produces a detailed report in a well-structured manner. It can connect and access seamlessly among various databases directly to speed up the testing process.
    Incentivized
    Read full review
    Return on Investment
    Cognition AI, Inc.
    • ROI is significant time saved from debugging, rewriting code, and testing
    • AI generated development can test executable code in a controlled environment
    Incentivized
    Read full review
    SmartBear
    • Saves hundreds of man-hours with either QA testing or data entry
    • With the small cost of the product, it has saved the company money with both employee costs as well as the cost of mistakes made by human error or software bugs
    Incentivized
    Read full review
    ScreenShots