Test Impact Analysis - My story so far


It's been three months now that I have started my journey in a new working environment to implement a flavor of the Test Impact Analysis.

Being a fan of ThoughtWorks and following Martin Fowler's blog I was impressed about reading an article that spoke about the rise of TIA(Test Impact Analysis)

The definition of TIA from martin fowler "Test Impact Analysis (TIA) is a modern way of speeding up the test automation phase of a build. It works by analyzing the call-graph of the source code to work out which tests should be run after a change to production code. Microsoft has done some extensive work on this approach, but it's also possible for development teams to implement something useful quite cheaply."

Problems to solve:

  1. Let's run all tests every time a change is pushed
  2. Tests that run late in the integration cycle - Implicitly Shifting right 
  3. Number of tests that run in the pipeline 
  4. The number of tests in the regression suite
  5. What shape is the testing pyramid?
  6. Where are the requirements covered for each slice of the pyramid?
  7. Everything that you test pre-integrate should immediately be tested post-integrate in the Continuous Integration (CI) infrastructure
  8. Deployment pipeline to run slower tests later.
  9. Tagging tests - how do we understand and track the domain knowledge? (Bird's eye view)
  10. Tests with their notional 'size' designations (execution time)
  11. Automated subsetting of tests to run per commit based on this baked-in intelligence.
  12. TIA support in IDEs - Microsoft also has a powerful Live Unit Testing[4] feature in Visual Studio that, if enabled, automatically runs impacted unit tests even as you edit the code.
  13. TIA is all about incremental validation by automatic test selection. 


Comments

  1. Keerthi4/9/17

    Article is really interesting, as it mainly focuses on testing and help the students to learn more and apply in real-life applications. Thanks for sharing this post buddy...! :)


    Digital Marketing company in Chennai

    ReplyDelete
  2. Ramakrishna15/10/19

    RPA Blue Prism Online Training
    RPA Blue Prism Training
    RPA Blue Prism Online Training in Hyderabad
    RPA Blue Prism Training in Ameerpet

    ReplyDelete

Post a Comment

Popular posts from this blog

Software Testing @ Microsoft

Image
In continuation from my previous  series of posts  targeting testing in top few companies from the technology space. After  Software Testing @Facebook  and @Google  we shall now look at Microsoft: Testing@Microsoft Software Development Engineers in Test (SDETs) are usually just called Test and sometimes Software Testing. SDETs are responsible for maintaining high testing and qualityassurance standards for all Microsoft products. Software Development Engineers (SDEs) are often referred to as Software Development. SDEs write the code that drives Microsoft products and upgrades. Very few teams in Microsoft are still using SDETs to do significant amount of manual testing. Manual testing is mainly outsourced. Actually, as early as in 2004, for example, most of the manual testing of MSN Explorer was outsourced. Think about it this way: it just doesn't make sense for test manager to spend their headcount (SDETs) on something can be easily outsourced.  Until 2005, Microso
Read more

Trim / Remove spaces in Xpath?

Image
If you are wondering how you can trim the spaces in your xpath, this is how: The normalize-space function strips leading and trailing white-space from a string, replaces sequences of white-space characters by a single space, and returns the resulting string. Example : Which one is better? //td[starts-with(normalize-space(),'Text to Trim')] //td[starts-with(normalize-space(text()),' Text to Trim ')] The second option is better as it targets at the specific nodes More string functions in XPATH: Functions Description starts-with( string1 ,  string2 ) Returns true if the first string starts with the second string. contains( string1 ,  string2 ) Returns true if the first string contains the second string. substring( string offset length ) Returns a section of the string. The section starts at  offset (which is a number), and is as long as the value provided at  length. substring-before( string1 ,  string2 ) Returns the part of  string1  up unti
Read more