Test Automation Anti-Patterns


Test Automation Anti-patterns:

There is enough data out there which explains what testing anti-patterns are, we will look at some of the most interesting test automation anti-patterns here:

The first one and the most important one is the right amount of UI testing in the testing pyramid:


  • Whenever we talk to most stakeholders about test automation, they think about UI automation.
  • "A team is doing too much UI automation when they are finding NPEs (Null pointer exceptions) via their UI automated tests."
  • Manual Session based testing is a fancy way of saying exploratory testing
  • Automated API tests are the best bang for the buck wrt tests that are easy to write and stable and a reliable signal.
  • Integration Tests are always valuable; but we need to ration the number of integration tests one writes as they can be more difficult to debug and have a high noise factor due to all the moving pieces
  • Automated component testing allows one to test a particular component (server) in isolation. you mock everything else out and ensure this component behaves as intended
For more anti patterns in the testing pyramid like the ICE-CREAM CONE, CUPCAKE PATTERN , HOURGLASS, DUAL PYRAMID read this:


A similar catalog has been created for anti-patterns in unit testing

Some other classic test automation anti-patterns:
  1. Including business logic at the test case level instead of building a business layer. Existing pattern: Page Object Pattern
  2. Declaring page elements inline in test cases with locator information instead of in the business layer. Existing pattern: Page Object Pattern
  3. Sleeping for arbitrary amounts of time. Existing pattern: polling, explicit/implicit waits.
  4. Assertions as part of PageObject class Existing pattern:  PageObject just provides status of the element to the caller. The caller itself will verify the status
  5. Different Stack The automated tests (also test frameworks) are implemented using a different software stack than the SUT uses.
Good read: http://qabok.com/tdd-patterns-and-anti-patterns/

Source: 
https://docs.google.com/presentation/d/15gNk21rjer3xo-b1ZqyQVGebOp_aPvHU3YH7YnOMxtE/edit#slide=id.g437663ce1_53_98
http://sqa.stackexchange.com/questions/8508/what-are-anti-patterns-in-test-automation



Comments

  1. Mirnalini Sathya17/4/18

    Very true and inspiring article, I strongly believe all your points. I also learnt a lot from your post. Cheers and thank you for the clear path.
    Selenium Training Chennai
    software testing selenium training

    ReplyDelete

Post a Comment

Popular posts from this blog

Software Testing @ Microsoft

Image
In continuation from my previous  series of posts  targeting testing in top few companies from the technology space. After  Software Testing @Facebook  and @Google  we shall now look at Microsoft: Testing@Microsoft Software Development Engineers in Test (SDETs) are usually just called Test and sometimes Software Testing. SDETs are responsible for maintaining high testing and qualityassurance standards for all Microsoft products. Software Development Engineers (SDEs) are often referred to as Software Development. SDEs write the code that drives Microsoft products and upgrades. Very few teams in Microsoft are still using SDETs to do significant amount of manual testing. Manual testing is mainly outsourced. Actually, as early as in 2004, for example, most of the manual testing of MSN Explorer was outsourced. Think about it this way: it just doesn't make sense for test manager to spend their headcount (SDETs) on something can be easily outsourced.  Until 2005, Microso
Read more

Trim / Remove spaces in Xpath?

Image
If you are wondering how you can trim the spaces in your xpath, this is how: The normalize-space function strips leading and trailing white-space from a string, replaces sequences of white-space characters by a single space, and returns the resulting string. Example : Which one is better? //td[starts-with(normalize-space(),'Text to Trim')] //td[starts-with(normalize-space(text()),' Text to Trim ')] The second option is better as it targets at the specific nodes More string functions in XPATH: Functions Description starts-with( string1 ,  string2 ) Returns true if the first string starts with the second string. contains( string1 ,  string2 ) Returns true if the first string contains the second string. substring( string offset length ) Returns a section of the string. The section starts at  offset (which is a number), and is as long as the value provided at  length. substring-before( string1 ,  string2 ) Returns the part of  string1  up unti
Read more