Test Management tool for JIRA - Xray
In an attempt to use JIRA as the test management tool with BDD using add-ons. Here is a comparison that might help:
Exploring
JIRA plugin test management tools
|
||
Xray for JIRA
|
Zephyr for
JIRA
|
Behave PRO
for JIRA
|
Cheaper
|
Expensive
|
Expensive
|
Supports
manual test running
Not in BDD format |
Supports
manual test running
Not in BDD format |
Does
not support manual test running
|
Supports
writing test cases in Gherkin with auto text formatting
|
Does
not support Gherkin language for test cases
|
Supports
writing test cases in Gherkin with auto text formatting
|
JIRA
REST API to automatically import/export feature files and import/export
automation results
|
ZAPI
add-on for RESTful API to JIRA
|
Supports
automated cucumber/specflow/behat test cases, exported to feature files
|
Supports
automated cucumber test cases, exported to a feature file and results
imported back into JIRA
|
Plan
and execute test cycles with tracking
|
Does
not support requirements and defect linking isn't very mature
|
Separate
requirements and defects, can associate either or both to test cases to
provide test coverage
|
Mature
tracking of test quality metrics for every project, more focused on cycles
and executions
|
No
test sets to group test cases
|
Test
sets to group test cases
|
Attachment
of defects to test or test steps
|
Add
multiple scenarios to individual user stories as Acceptance tests
|
Supports
pre-conditions for test cases
|
Link
JIRA issues to steps/stories
|
Ability
to import cucumber features
|
Export
to different formats/templates
|
|
Link
JIRA issues to scenarios
|
Link
JIRA issues to steps/scenarios
|
|
Maven
integration for automated tests
|
Decided to go with Xray since it was more aligned with the BDD theme we had. Here are a few YouTube videos that might help:
Xray YouTube videos:
Xporter YouTube videos:
More about Xray:
XRAY documentation:
Here are some
advantages that the team from Xray claims to have over Zephyr:
- Automated Tests: Xray supports automated Tests
(Cucumber and Other) to be defined in JIRA and provides, in the same
add-on, REST services for exporting Test definitions and importing
execution results to JIRA.
- Editing and visualising manual Tests and steps is
much more user friendly than other competitors. Xray supports the JIRA
wiki notation in several fields like Test Steps, Pre-Conditions and
execution comments. It also allows you to include attachments in Test step
definitions.
- Xray for JIRA is aware of two common concepts in
test management: requirements and defects. It can generate Requirement
Coverage charts based on the Requirement - Test Issue links.
- Xray integrates seamlessly with JIRA. It takes most
advantage of JIRA entities like Issue Types, Custom Fields, Issue Link
Types and Screens to provide an intuitive and easy to use interface.
- Xray for JIRA has the concept of test sets used to
group test cases.
- Xray for JIRA supports definition of pre-conditions
for test cases.
- In Xray for JIRA, changing a test definition does
not affect past executions. Past executions remain with the initial test
definition.
- Xray provides integration with Xporter to export
test, test sets and test executions to DOCX and PDF reports, based on
customizable templates.
- Price
- REST API included
Happy Testing!
This comment has been removed by the author.
ReplyDeleteHow to configure selenium with xray or zephyr? Does it support any?
DeleteHi Asha, we are using Zephyr at our work and you can write your feature files and then export the results back into xray once the tests are complete. Let me know if you need details
DeleteThis comment has been removed by the author.
DeleteIs it possible to configure CI Tools like Jenkins or Automation Tools like Selenium with Xray? I know it's possible with Zephyr using Zapi but not sure bout Xray.
DeleteHi Abdul, You can integrate any BDD tool like Cucumber/Specflow which will then call your underlying tool for automation. This video might give you an idea: https://www.youtube.com/watch?v=kigz-xF2-9g
DeleteThanks alot for your reply,
DeleteDo you have any sample that helps in integrating other automation tools like selenium etc??
DeleteThis will help in deciding if to go with this tool
I am evaluating Test management tool (a Jira Add-On) which can used to store Requirements, Manual Test Cases as well as Cucumber feature file for automation.
ReplyDeleteI have evaluated Xray and it looks promising but i want to play with more such tools before i show a presentation to client. Zephyr, TestRail and HipTest are others in the list to be evaluated. Can you suggest a good tool which i can dig into.
Thanks.
If you need to compare Xray and Zephyr, you may want to give a look at http://www.xpand-addons.com/xray/xrayvszephyr/
DeleteWhats the exact difference between JIRA Zephyr and JIRA XRay?
ReplyDeleteHey we have written our features files within behave pro for jira ,can we import those features into x-ray??please suggest
ReplyDeleteHi, Xray supports both cucumber and behave syntax.
ReplyDeleteThat's right we have integrated it with both spec-flow and Cucumber.
DeleteThat's right. We have integrated it with both Spec-flow and Cucumber.
DeleteDoes Xray support integrating with JIRA Cloud instance?
ReplyDeleteAFAIK it isn't there yet but the next release has plans: http://confluence.xpand-addons.com/dosearchsite.action?queryString=jira+cloud
Deletethey don't have Cloud yet but maybe this year. Also they have a new release, version 2.1: http://confluence.xpand-addons.com/display/XRAY/Xray+2.1.0+Release+Notes
ReplyDeletethe website: http://www.xpand-addons.com/
DeleteDoes xray supports behat, its integration and reports?
ReplyDeleteHi, Does Xray integrate with Specflow? We run our Selenium tests on Specflow and is in search of a tool that can helps to see the automation test execution results also. I watched the video that shows integration with Cucumber. I would be really interested to know if similar feature is available for specflow. Thanks
ReplyDeleteThank you for your great information it is useful . Angularjs Online Training
ReplyDeleteI have read your blog its very attractive and impressive. I like your blog
ReplyDeleteselenium Online Course
supreme outlet
ReplyDeleteoff white x jordan 1
yeezy shoes
ralph lauren uk
supreme hoodie
jordan shoes
michael kors outlet online
nike air max
kd 11
balenciaga shoes
steph curry shoes
ReplyDeletesteph curry shoes
goyard
yeezy boost 350 v2
kd shoes
supreme new york
stephen curry shoes
kyrie 5 shoes
supreme clothing
longchamp handbags
replica bags pakistan gucci fake b6j13p7v16 replica bags australia replica bags wholesale mumbai discover this info here w5r95q0n46 replica bags paypal navigate here j4z06h6w52 replica louis vuitton replica radley bags
ReplyDelete