Wednesday

Test Management tool for JIRA - Xray



In an attempt to use JIRA as the test management tool with BDD  using add-ons. Here is a comparison that might help:

Exploring JIRA plugin test management tools
Xray for JIRA
Zephyr for JIRA
Behave PRO for JIRA
Cheaper
Expensive
Expensive
Supports manual test running
Not in BDD format
Supports manual test running
Not in BDD format
Does not support manual test running
Supports writing test cases in Gherkin with auto text formatting
Does not support Gherkin language for test cases
Supports writing test cases in Gherkin with auto text formatting
JIRA REST API to automatically import/export feature files and import/export automation results
ZAPI add-on for RESTful API to JIRA
Supports automated cucumber/specflow/behat test cases, exported to feature files
Supports automated cucumber test cases, exported to a feature file and results imported back into JIRA
Plan and execute test cycles with tracking
Does not support requirements and defect linking isn't very mature
Separate requirements and defects, can associate either or both to test cases to provide test coverage
Mature tracking of test quality metrics for every project, more focused on cycles and executions
No test sets to group test cases
Test sets to group test cases
Attachment of defects to test or test steps
Add multiple scenarios to individual user stories as Acceptance tests
Supports pre-conditions for test cases
Link JIRA issues to steps/stories
Ability to import cucumber features
Export to different formats/templates

Link JIRA issues to scenarios
Link JIRA issues to steps/scenarios

Maven integration for automated tests

Decided to go with Xray since it was more aligned with the BDD theme we had. Here are a few YouTube videos that might help:

Xray YouTube videos:

Xporter YouTube videos:


More about Xray:

XRAY documentation:

Here are some advantages that the team from Xray claims to have over Zephyr:
  • Automated Tests: Xray supports automated Tests (Cucumber and Other) to be defined in JIRA and provides, in the same add-on, REST services for exporting Test definitions and importing execution results to JIRA.
  • Editing and visualising manual Tests and steps is much more user friendly than other competitors. Xray supports the JIRA wiki notation in several fields like Test Steps, Pre-Conditions and execution comments. It also allows you to include attachments in Test step definitions.
  • Xray for JIRA is aware of two common concepts in test management: requirements and defects. It can generate Requirement Coverage charts based on the Requirement - Test Issue links.
  • Xray integrates seamlessly with JIRA. It takes most advantage of JIRA entities like Issue Types, Custom Fields, Issue Link Types and Screens to provide an intuitive and easy to use interface. 
  • Xray for JIRA has the concept of test sets used to group test cases. 
  • Xray for JIRA supports definition of pre-conditions for test cases. 
  • In Xray for JIRA, changing a test definition does not affect past executions. Past executions remain with the initial test definition. 
  • Xray provides integration with Xporter to export test, test sets and test executions to DOCX and PDF reports, based on customizable templates. 
  • Price
  • REST API included
Happy Testing!

LeanFT = QTP/UFT + Continuous Integration + Agile + Opensource in the HP world


Can you believe that HP has come up with this new tool/plugins that they call LeanFT, obviously the name suggests that it's the lean way of doing functional testing. Let's see what they claim:

Key Highlights and what's good:


  1. Automation in Java or C# - definitely something that most automation folks were looking forward to
  2. Compatible with UFT's object Identification engine- hmm :)
  3. Continuous Integration - Has integration with Jenkins 
  4. Supports BDD tools like Cucumber/Jbehave
  5. Integration with SCM tools like Git/SVN
  6. IDE would be your standard Eclipse / TFS
  7. Same reporting as before but with all of the above
  8. Unit testing frameworks like JUnit/ Nunit
  9. Integration with other HP tools -  HP Application Lifecycle Management, HP Quality Center, and HP Mobile Center.
Interesting fun facts:
  • QTP's Object spy from Visual studio/Eclipse
  • Free license if you already have the UFT 12.5 license
  • customized html reports
Release Date: July 2015 along with UFT 12.5 and BPT 12.5

Source : HP Discover























Friday

Testing Reports - Infographics



I was trying to create this report that could dynamically fetch data from different projects and have something like: an exec level report giving the business confidence in the testing that was being completed

Did a little bit of research and found that there was something called the infographics -
  1. Information graphics or infographics are graphic visual representations of information, data or knowledge intended to present information quickly and clearly.
That's the site that gives you the 10 free tools for creating infographics, but Piktochart is my favorite!