3 Replies Latest reply on Nov 17, 2014 1:16 PM by Carl.Simpson

    New Version Testing Questions

    Expert

      In the past I was required to test every new version of Service Desk.  Ok, that's normal.  I had to test every action of every process.  I have 108 Incident actions in 4 active processes and 81 Change actions in 2 active processes.  I then had to test all of those actions and processes on the console, in Internet Explorer 9, Firefox, Self Service, and Mobile.  I am re-evaluation our testing standards. 

       

      Since console never changes do I even need to test it?

      Is it necessary to test IE, Mozilla, and Self Service?

      Is it necessary to test every action of every process I have?

       

      How much testing do you do?

       

      My standard process is to use a test environment, copy my live database to the test SQL server, and then do a standard upgrade of the server and the database.  I then do the exhaustive testing as outlined above.  I am currently on 7.7.0 and trying to decide if I should upgrade to 7.7.3 or 7.8.  I use a second test environment to test beta versions.

       

      Any thoughts of what version to upgrade to, go to 7.7.3 or wait for 7.8?

        • 1. Re: New Version Testing Questions
          Jenny.Lardh SupportEmployee

          Hi,

           

          7.8 is released at the beginning of next year which is only 7 weeks away so it's up to you if you want to wait for this.

          7.8 does have a few new features and a lot of development has taken place for Fuse.

           

          When it comes to your testing it seems like a lot of testing. The actions and processes themselves wouldn't have change to the degree that they would need to be retested. I would suggest you test to log in as sa, an analyst and an end user. Test to log in to Console, Web Desk and Self Service. Test a few actions in a couple of processes and make sure that everything is running smoothly. Any major errors would have appeared with this testing.

           

          I hope this helps,

          Kind Regards,

          Jenny

          • 2. Re: New Version Testing Questions
            dmshimself ITSMMVPGroup

            I've been burned too many times in the past with issues resulting from upgrades that I am probably wayyyyy to conservative when asking people to test.  Releases are much better now and release management is cleaner, but old habits die hard :-)

             

            The main things I look for when asking customers to go through a UAT on an in-place upgrade are unexpected side effects (unexpected to them) that have come through as part of a new release. If people are going through a point release, it's fairly easy to give them a list of what has changed since the release they were on and specifically look at those areas.  I also recommend like for like upgrades and leave new fancy features to be put in once the upgrade has bedded in.

             

            Sometimes bugs are fixed which change some functionality which people got used to or even relied on and these are not always easy to spot without testing.

             

            I also look for areas where the LD developers put things back 'as they should be' when running an upgrade/MDM.  This can trip people up when they have been legitimately changed.  There are far less of these than there used to be, but you do still need to be careful and keep lists and test.

             

            If a customer is moving from an elderly release (say 7.4) to a recent one, then they will see a lot of differences and people need to work through that beforehand and not on the day of going live!  Our customers are likely to have a UAT test script so it's fairly easy to pick a few willing volunteers and run through that, plus introduce test for any new areas of the product that need exercising.

             

            But if this is not an inplace upgrade, then a whole new vista of opportunities for small irritations can creep in if the new environment isn't set up the way the old environment way.  How may people keep their as-built documentation up to date?  So test reports to make sure UNCs work and shares with privileges, test knowledge base to make sure Lucene has been set up/works, integrated login, links to images for business object reports and so on.

             

            I'd certainly make sure you can go through all the actions as a non-administrator that are used on a daily basis.  Its quick and easy to do and sometime people find actions they didn't even know they had!

             

            I'm reminded of y2K (yes I am that old and cranky).  Across the board the general public wondered what all the fuss was about as nothing really went wrong.  That's because there was a lot of testing done to make sure.

             

            One interesting and quite common view with large corporates is they sometimes want to be be 1 release behind the latest so that any unexpected side effects or patches can be well understood because lots of other people have already used that version previously.  With the current more rapid release time that LD have, that is quite easy to do.  It's a bit conservative, but understandable when IS resources are limited.

            • 3. Re: New Version Testing Questions
              Expert

              I appreciate both your responses.  Seems I may be doing a bit too much which is what I thought.  I wish I could stay up with just 1 version behind, seems to always be 3 or more