Test Automation for Agile - A different strategy



Test Automation has always been a challenge when it comes to running your suites within the time frame especially in an Agile mode with more builds coming the testing way.

So here is a quick strategy that we tried and seems to be working well for now:

What it used to be:
  • Entire test automation runs for 8-10 hours
  • One big test suite or a few smaller test suites
  • Reusable code being used a lot (which was good , but also had a repercussion of redundant flows)
  • Robust suites which broke less but after complete runs the failures where not always application bugs but automation errors.
  • The whole idea was how much test coverage do we have
  • Metrics were based on number of tests run/passed/coverage and so on..

What it is now:
  • Continuous Integration Builds
  • Test suites do not run that long instead there are dedicated 1 hour suites (To keep the suite below the 60 minute time frame and also have the apt coverage , these would be targeted suites for a particular functionality/stories and not cover anything that the previous suite did)
  • The idea is that these one hour suites would be targeted suites and at any cost will not run over an hour on a single automation box
  • The one hour suites will not have any redundant flows nor will there be at any time more than 5 such suites in our latest test set.
  • The one hour suites will have less than 5% automation defects and should be minimized to almost zilch.
  • Metrics are much better now and the tests actually fail only when there is a genuine defect and not an automation failure.

Comments and suggestions are always welcome , until then Happy testing!



Comments

  1. Anonymous16/6/13

    Thanks for your personаl maгvelous posting!
    I truly enjoyеd reading it, уou could bе
    a great author.I ωill ensure that I bookmaгk youг blog аnd ωіll often come back
    from now оn. Ӏ ωant to еncourage уou to ultimately continue yοur great posts, have а nice
    weekend!

    mу page linkеd internet site *http://Cchubnigeria.com*

    ReplyDelete
  2. Anonymous16/6/13

    Heya i'm for the primary time here. I found this board and I to find It truly helpful & it helped me out much. I am hoping to provide one thing again and help others such as you aided me.

    Feel free to visit my web-site ... Visit Website ()

    ReplyDelete
  3. Anonymous19/6/13

    It's an remarkable paragraph in favor of all the web viewers; they will get benefit from it I am sure.

    Also visit my web page - Going At this website

    ReplyDelete
  4. Anonymous22/6/13

    Superb post but I was wanting to know if you could write a litte more on this subject?

    I'd be very thankful if you could elaborate a little bit further. Bless you!

    My web site: finsnation.com ()

    ReplyDelete
  5. Anonymous24/6/13

    I do not know if it's just me or if everyone else encountering issues with your site. It seems like some of the written text within your posts are running off the screen. Can someone else please provide feedback and let me know if this is happening to them too? This could be a issue with my browser because I've had
    this happen before. Appreciate it

    Feel free to visit my web page; trading in chicago :: wiki.gilug.org :
    :

    ReplyDelete
  6. Anonymous27/6/13

    Having read this I thought it was extremely enlightening.
    I appreciate you spending some time and effort to put this article together.

    I once again find myself spending a significant amount
    of time both reading and leaving comments. But so what,
    it was still worthwhile!

    Feel free to surf to my homepage - dating advice for women

    ReplyDelete
  7. Anonymous28/6/13

    After looking over a number of the blog articles on your
    web page, I really appreciate your technique of writing a blog.
    I book-marked it to my bookmark site list and
    will be checking back soon. Please visit my web site as well and let me know your opinion.


    My blog :: penis enlargement *meine-handtasche.de*

    ReplyDelete
  8. Anonymous30/6/13

    You really make it seem so easy with your presentation but I find this matter to be really
    something that I think I would never understand.
    It seems too complicated and extremely broad for me.
    I am looking forward for your next post, I'll try to get the hang of it!

    Also visit my webpage :: relationship tips for men ()

    ReplyDelete
  9. Anonymous1/7/13

    It's remarkable in support of me to have a website, which is helpful in support of my knowledge. thanks admin

    Also visit my web blog ... This Site

    ReplyDelete
  10. Anonymous2/7/13

    Sweet blog! I found it while browsing on Yahoo News. Do you have any
    suggestions on how to get listed in Yahoo News?
    I've been trying for a while but I never seem to get there! Cheers

    Here is my webpage: dating relationships (77.221.149.53)

    ReplyDelete
  11. Ruby28/3/19

    I was very interested in the article , it’s quite inspiring I should admit. I like visiting your site since I always come across interesting articles like this one. Keep sharing! Regards. Read more about Software Testing Services

    ReplyDelete

Post a Comment

Popular posts from this blog

Software Testing @ Microsoft

Image
In continuation from my previous  series of posts  targeting testing in top few companies from the technology space. After  Software Testing @Facebook  and @Google  we shall now look at Microsoft: Testing@Microsoft Software Development Engineers in Test (SDETs) are usually just called Test and sometimes Software Testing. SDETs are responsible for maintaining high testing and qualityassurance standards for all Microsoft products. Software Development Engineers (SDEs) are often referred to as Software Development. SDEs write the code that drives Microsoft products and upgrades. Very few teams in Microsoft are still using SDETs to do significant amount of manual testing. Manual testing is mainly outsourced. Actually, as early as in 2004, for example, most of the manual testing of MSN Explorer was outsourced. Think about it this way: it just doesn't make sense for test manager to spend their headcount (SDETs) on something can be easily outsourced.  Until 2005, Microso
Read more

Trim / Remove spaces in Xpath?

Image
If you are wondering how you can trim the spaces in your xpath, this is how: The normalize-space function strips leading and trailing white-space from a string, replaces sequences of white-space characters by a single space, and returns the resulting string. Example : Which one is better? //td[starts-with(normalize-space(),'Text to Trim')] //td[starts-with(normalize-space(text()),' Text to Trim ')] The second option is better as it targets at the specific nodes More string functions in XPATH: Functions Description starts-with( string1 ,  string2 ) Returns true if the first string starts with the second string. contains( string1 ,  string2 ) Returns true if the first string contains the second string. substring( string offset length ) Returns a section of the string. The section starts at  offset (which is a number), and is as long as the value provided at  length. substring-before( string1 ,  string2 ) Returns the part of  string1  up unti
Read more