Wednesday, August 11, 2010

QA/Testing Team’s Goal

A: stands for Objectives
B: stands for Measurement Criteria


1. Work Delivery and Process Compliance

A: Maintaining productivity
B: x% increase in productivity for the whole year
A: Delivering on or before the scheduled date with high quality.
B: # of instances not meetingQuality : less than x% Sev 1 & Sev2 defects from TS / customer.
A: Adherance to process laid down in the team
B: # of instances of not following
A: Timely escalation of Project specific issues.
B: # of instances done
A: Quality of Test Plan and Test Cases -
B: # of defects found in Test Plan & Test Cases.
A: Test Case writing
B: Number of test cases written per week
A: Test case execution
B: Number of test cases Executed per week
A: Defect Validation
B: Number of defects validated per week
A: Proactively add test cases wherever gap is found.
B: # of instances done
A: Updating test cases end of every day after the execution
B: # of instances found not updated
A: 100% coverage of requirements in Test cases
B: # of instances found not done
A: Number of defects filed - Quality Quotient (# of Sev1 * 4 + # of Sev2 * 3 + # of Sev3 * 2 + # of Sev4 * 1)
B: Rating obtained
A: Invalid defects should not be more
B: Among the raised defects not more than x % should be invalid (Duplicate, Not a Bug, User Misunderstanding/Working as designed)
A: Clarity of the defects logged which should include clear description, steps to reproduce and appropriately filled other relevant details.
B: Query raised by Dev team
A: Timely review of the docs.
B: Number of instances not giving review comments
A: Status report should reach in time without follow up
B: # of instances required follow up
A: Action item needs to be tracked and completed in stipulated time
B: # of instances not done
A: Shows flexibility to work (willing to work on different workstream, different kind of testing)
B: # of instances done

2. Test Environment Creation

A: Take backup once the test environment is ready
B: Time taken to backup the environment
A: Ability to restore the backedup environment at any point of time
B: Time taken to restore the environment
A: Contributes to intranet and the information are up to date
B: Number of contribution and quality of the contribution
A: Optimally use of Software and Hardware resources
B: Report on effective use of resources

3. Product Knowledge

A: Ability to simulate close to the production environment as possible with the available software and hardware resources
B: Time taken to set up the environment
A: Ability to set up the end to end environment for testing and deploy the components
B: Time taken to set up the environment
A: Ability to diagnosis the customer issues and thus helps customer support people
B: # of times helped to diagnosis the customer issues
A: Ability to draw a comparison of the product feature against the competitor's product on the same line
B: Depth of value added
A: Document the steps of installation with the screenshot and a document on how to configure, how to overcome the problems faced during installation and configuration and thus create a knowledge base
B: # of documents prepared
A: Ability to make judgments on adequacy of testing coverage and quality of defects
B: Reports on testing coverage
A: Ability to prioritize the test cases, identify blocking issues which is must fix before the product goes live
B: Reports on this and # instances done
A: Ability to optimize decisions pertaining to test execution based on the areas needing focus and available timelines, identifying areas needing improved test coverage
B: # of instances done
A: Ability to strategizing the test automation
B: # no of times taken the initiative to automate
A: Keep a track of own learning about the Product knowledge gain. Must increase in every quarter
B: Progressive increase in product knowledge

4. Domain Knowledge

A: Ability in writing test scenarios in line with the business work flows
B: # of instances done
A: Read online resources and come up with presentation
B: # of instances done
A: Ability to suggest new functionality which will help the end user
B: Suggestion made v/s accepted
A: Be aware of the upcoming functionality/technology on domain front
B: Shares knowledge among team members
A: Ability to understand the entire business workflow , not only about the functional knowledge
of products owned by the team
B: Clarifying queries
A: Ensure that QA team analyze the defects filed by customer for the previous releases and make sure that same scenarios are converted to test cases for the upcoming release and gain domain knowledge on how the customer are actually expecting out of the product.
B: # of instances done

5. Communication & Team Player

A: Communications should be timely, clear, concise and readily understood by intended recipient
B: No further clarification required
A: Clear and concise status reporting
B: No further clarification required
A: Timely escalation of issues / problems
B: # instances done
A: Maintaining good relationship with team members
B: Complaints from team members
A: Proactively helping the team members/cross team members in Project related activities.
B: Feedback needs to be taken from the cross team members
A: Activley participate in the meetings and contribute.
B: # of instances done
A: Not disclosing confidential information (salary and appriasal rating etc)
B: # of instances done
A: Extending help to other teams in need within team / organization level.
B: Feedback from others
A: Number of presentation given within Team/organization
B: # of instances done
A: Knowledge sharing and mentoring new joiners
B: Feedback needs to be taken from the person mentored

6. Training and Knowledge Sharing

A: Giving detailed trainings to new joinees by scheduled date.
B: Feedback Mechanism
A: Training on tool/Technology
B: Feedback Mechanism
A: Attend trainings as per the identified training need
B: Shows increase in productivity/understanding on the related fields after attending the training
A: Participates in knowledge sharing session in team level
B: Feedback Mechanism

7. Ownership and Commitment

A: Showing a sense of ownership, takes complete ownership of the tasks given
B: # of instances done
A: Have a can do attitude, if can not be done in certain way suggests alternatives
B: Suggestions made
A: Come out with some constructive ideas which can be achieved in the period while waiting for the dependent task to be completed and thus add value by utilizing the time effectively
B: # of instances done
A: Proactively acts on tasks, informes about the advanced leave plan, Takes responsibility to to educate the team members to handle in case of his/her absence
B: # of instances not done

8. Innovation

A: Exploring Innovative ways to accomlish work. Come up with innovation/improvement areas
B: Number of suggestion made vs Accepted
A: Helps to define new process and putting the process in place. Tries to improve the process efficiency
B: Number of suggestions given
A: Publish white papers on areas of interest
B: # instances done

9. Client Management

A: Client satisfaction
B: Accolades from client
A: Client communications and relationship
B: Bonding with client
A: Client negotiation
B: Negotiating effectively with client for win-win relationship
A: Awareness of client roadmap and strategy
B: Project planning and risk planning