In our program when we decided to reduce time to market a major roadblock identified was long regression cycles. All regression suites were manually executed which makes it impossible to increase production deployments, ultimately impacting time to market. So the decision was made to automate the regression and functional test cases using HP UFT. The decision regarding the tool was made considering three factors:
1) Skill level of existing QA team, no knowledge of JAVA scripting but fair knowledge of VB scripting.
2) The regression did not involve only UI testing but back-end (Oracle, Greenplum) & web service testing as well. HP UFT supports all of them.
3) We were using HP ALM for project management and obviously, UFT is very compatible with ALM in several ways.
Also, HP UFT was quite easy to learn and the QA team got proficient in UFT pretty quickly. We were able to automate 2000+ regression test cases in 4 months. Automation not only helped in reducing time to market but also helps in increasing the delivery quality.
- Integration & Support: a) The way tool integrates with other platforms like .net, mainframe is amazing. It Supports new and legacy web technologies, terminal emulators, and Windows thick client applications. b) It Supports Continuous integration by integrating with Jenkins, Git etc. c) UFT supports cross browser testing & it supports all main browsers like IE, Firefox, Chrome and Apple Safari. d)It’s compatibility with ALM can help store automation execution results back in ALM & even allows us to schedule the automation execution at required date/time.
- Amazing Features: UFT has so many features but at the same time, it is quite easy to learn & it doesn’t take long to train staff on it. Few amazing features which adds lot of value while scripting are:
- a) Test Combinations Generator (TCG) - It helps to create test configurations by using the parameters in tests and their possible values to create multiple possible data combinations.
- b) Insight Recording – It recognizes controls based on their appearance and not their native properties. This can be useful to test controls from an environment that UFT does not support or even from a remote computer running a non-Windows operating system. When UFT runs the test or component, it recognizes the controls in the application by matching them to the images saved with each of the Insight test objects.
- c) UFT has built in reporting features as well as allowing for customized output files showing exactly where a test step failed along with the timestamp.
- UFT supports BPT (Business Process Testing), a component-based testing framework which provides strong and efficient platform to test complete business process manually and automatically combines manual and automation tests with less duplication and its component reusability feature makes the testing process very fast.
- It helps improving efficiency in regression testing and functional testing, in that we automate a lot of repeatable tasks.
- Organization doesn’t need to have a skilled coder to write a basic automation script with UFT.
- Its licensing cost is very high making it a very expensive tool. due to this many organisations are exploring options of license free tools like Selenium for automation. Though learning curve is large in case of Selenium but it is very cost effective & you an get lot of support online for Selenium.
- Though the scripting time is less since its easy to create automation scripts, the execution time is relatively higher as it takes the lot of CPU & RAM.
- Though UFT is quite stable but during long execution cycles we do get frequent browser crashing issues.
- In terms of costing TestComplete is also one option which is not free but comes with modular pricing. You can buy what you need, when you need.
- Supports multiple technologies.
- Extensive forum, multiple sources of assistance, help and guidance.
- Flexible in terms of test script design
- Can be easily integrated with widely used test management tool, HP-ALM.
- Maintenance of Test script is a pain.
- Not futuristic. Not many innovative features have been added.
- Not lightweight; consumes lots of memory.
If the application is based on Legacy platforms like Siebel or Mainframe, UFT fares quite well.
For low cost web-based projects, there are other cheap and open source tools available.
If it is about API testing or Mobile Testing, it is better to use other tools like TOSCA.
- The simple front end will allow novice users to easily grasp the basics of automation and give them confidence to try things for themselves.
- UFT can scale up and run across multiple machines from a single controller, such as ALM, enabling hundreds of tests to be executed overnight.
- There is an active support community out there, both official HPE based and independent users. This means if you do encounter a problem there is always someone out there to help you.
- The later versions have many add-ins to plug in to other tools within the QA world.
- Expert users are able to utilise the many native functions and also build their own to get the most out of the tool and impress people as they walk past and see the magic happening on the screen.
- UFT also has LeanFT bundled with it, allowing automated testing at the api level - if you can convince the developers to let you in there.
- It is expensive, though different license offerings can help negate some cost.
- Don’t be fooled by the simplicity of record and playback because it will break and may cause you to lose heart and the standard HP guides only hit the basics.
- It is based on VBscript and so the language and underpinning tech is slightly dated but still works fine.
- UFT is used for automation across the entire organization across different projects.
- It is used for continuous integration.
- It is also used for different types of testing, ex: desktop application testing, cross browser testing, API testing etc.
- One automation tool is capable of handling different types of testing, ex: API testing, desktop application testing, browser testing, Mobile testing etc.
- NO other tools in the market currently support everything in one tool, ex: detailed results, screenshots, and saving and forwarding the execution result.
- UFT is easily integrated with other continuous integration tools like ALM, Jenkins, TeamCity etc.
- Very expensive tool for startup or small organization. HP should offer different payment plans and different package.
- UFT should improve more in the cross browser compatibility side and different OS platform.
- Should improve in supporting MAC OS system
- Built in object repository and storing elements.
- Reporting dashboards.
- Continuous integration is possible with QC and Jenkins.
- Supports desktop, web and mobile product automation.
- Various formats of reporting support should be possible. Right now UFT supports exporting reports in either HTML or PDF in short or detailed format. If exporting reports could be extended to Excel, CSV, XML, XSLT, MHT formats that would be greatly appreciated.
- They should improve performance. There will be performance degradation on the test environment due to long continuous executions of automation scripts which leads to inconsistency of results, a better way to resolve this problem should be addressed at some point.
- Consistency during execution should be maintained.
Also, as it integrates with the HP ALM product line (we are using it to store requirements), we connect to the requirements and the defects encountered for each of the JIRA cards. It also allows the users to work with databases and execute against web services and REST services, along with the usual UI tests for web. Integration with HP Loadrunner makes it possible to run performance tests also, which are valuable for the client and the services they have on offer. Integration with these other tools allows us to maintain a specific stack and lower the TCO across the organization and bring in a valuation and Agile practises across to all the teams involved. We have even started working on the concept of having a central team to work across all the projects.
- Testing both GUI and backend processes in conjunction with other tools in the HP Toolset, i.e. Loadrunner & HP ALM.
- Integration points with agile tools like JIRA, Bamboo, TeamCity; which allows for continuous integration to be executed and set up quickly.
- Using REST & web services (XML, SOAP), is relatively easier when you can scan in the WSDL files.
- Unable to build tests using programming languages like Java or C#.
- Lock-in access with ALM licenses can create a problem and hinders users who are working only on testing to not be able to use the tool.
- If the organization does not have an experienced HP Toolset user, things can get messy quite fast and It creates confusion for users who come in later.
- Organization within the ALM tool and the UTF tool to work in a Agile centric environment are lacking. Too much of customization needs to be carried out for it to work properly.
- Uses VB script, which is a very simple programming language to use and follow
- It integrates well with ALM, we used the BPT model for our automation
- UFT has GUI and API testing both in it, so you can use one tool for GUI and Web services testing
- UFT integrates with ALM, and the tests run efficiently on IE, but running on other browsers is not that effective.
- Mobile testing enhancement - it needs to support mobile testing. We had to use another tool for mobile testing
- Maintaining the licenses - very expensive and not very easy to get support from HP
U have used QTP by it self, and have used UFT for many years for doing GUI and API testing. Since both types of these tests are combined in one tool, it is easier to run them.
UFT is excellent for nightly regression of Web based applications. Our applications were Java applications, and we used UFT to run our automation scripts.
It is not a great tool for a quick performance test. Would like to see some basic features of Load Runner in UFT for a quick performance test
- HP UFT is probably the best tool to do test automation. The support for multiple platforms and how easy it is to learn and use it make it one of the top choices when it comes to automating tests.
- For data driven testing of business processes or test scenarios that require multiple executions but with the use of different sets of data for each execution, HP UFT is one of the best choices because the handling of data tables.
- The record and play feature is really good, where testers can just start recording on HP UFT and execute the business process or test scenario while HP UFT records all the actions, those tests can be further enhanced by "parameterization" of inputs and outputs and the use of multiple rows of data for each test execution.
- The main complaint for companies when adopting the use of HP UFT is the pricing. Yes, HP UFT has never been a cheap tool and it was the go-to solution for test automation for years, however there are now multiple tools now that do automation that are much cheaper or even free.
- While the record and replay feature is really good and keeps getting smarter, in some cases the created tests need to be manually modified with the use of VBscript, new applications and platforms introduce new object definitions or types that sometimes HP UFT cannot natively support
- Although HP UFT works flawlessly in conjunction with HP ALM, it would be good to have a more open architecture in order to integrate HP UFT with other tools or applications to organize tests and track execution besides HP ALM, though integration is possible, sometimes is not as easy to integrate.
UFT Scorecard Summary
UFT Technical Details