Overall Satisfaction with SiteSpect
- It is able to intercept the code from your server, inject your code and then it continues on to the end-user's computer with virtually no speed interruptions.
- It has several different options for performing A/B tests from regular factors to client-side factors, and origin experiments.
- It is extremely flexible and configurable for the needs of your company or organization.
- SiteSpect has a number of areas that are a bit difficult for users to understand, the main one being traffic allocation. Without getting into a long example the basic fact is that if you have 10 experiments running, it is very possible to have a very difficult time understanding how much traffic is going to each test, which is obviously not ideal for A/B testing. This problem is being addressed and hopefully will be fixed before 2017.
- The workflow of setting up experiments in Sitespect is also a little counter-intuitive. This is being addressed and fixed, but as it sits currently it does take some getting used to.
- SiteSpect has had a huge impact on this business, being in the online retail market A/B testing can have enormous impacts especially when you are using it on a website that has millions of visitors a day.
- SiteSpect has also allowed us to rapidly implement hotfixes on several occasions where we had a known problem and fixing the problem on the production environment would take time, this gave us a kind of quick fix until we could implement the permanent solution.
Most of these other tools do not really have a direct comparison. Optimizely and Visual Website Optimizer (VWO) are both A/B testing tools that are similar in nature to SiteSpect. Both Optimizely and VWO are good tools and have their place, but they are not as flexible or as configurable as SiteSpect is. They are considerably easier to learn so it really comes down to what is the end goal, do you want a product that is relatively easy to use and can do a lot of things, or do you want a toold that is much more difficult to use but gives you complete flexibility to design your tests and implement them any way that you want? For this reason I would recommend Sitespect for people at large companies who have a team devoted to testing, and for most small/mid size companies who will not have testing be a dedicated part of their progress then maybe use something more like Optimizely or VWO instead.
SiteSpect is kind of the difference between the space shuttle and a bicycle. They will both get you places. However Sitespect is considerably more complex and more configurable than most other options that I have seen and used (Optimizely, Visual Website Optimizer, etc.). But those other solutions also have a much lower learning curve and [users] are able to do a lot of things with relatively no coding experience or skill, where SiteSpect really does need capable developers to be utilized well.