Quality House Ltd.
  • Course Calendar
  • info@qualityhouse.com
  • +359 2 958 33 06
  • About Us
      • Company Overview (3)
      • What We Do
      • Team Power
      • Careers
      • Stay Updated (2)
      • News
      • FAQ
      • Business Relationships (3)
      • Customers
      • Partners
      • Testimonials
  • QA Profiles
      • Available QA Profiles (2)
      • Software Technologies & Platforms
      • Project Experience
      • Delivery (3)
      • On-site
      • Off-site
      • Hybrid
      • Pricing (2)
      • Dedicated Team
      • Time & Materials
  • Testing Services
      • By App Type (3)
      • Mobile
      • Web
      • Desktop
      • By Testing Type (6)
      • Functional
      • Test Automation
      • Security
      • Regression & Retesting
      • Load & Performance
      • Acceptance
      • By Industry (6)
      • Software
      • Telecom
      • E-Commerce
      • Media & Entertainment
      • Finance
      • Automotive
      • By Company Size (3)
      • Start ups
      • SME
      • Enterprises
  • Professional Courses
      • Overview (3)
      • Introduction
      • Our Trainers
      • Course Calendar
      • ISTQB FL (1)
      • Foundation Level
      • ISTQB AGILE (1)
      • Agile Tester Foundation
      • ISTQB AL (3)
      • Test Manager
      • Technical Test Analyst
      • Test Analyst
      • ISTQB SPEC. (2)
      • Test Automation Eng
      • Security Tester
      • Other Courses (2)
      • IREB® CPRE FL
      • Scrum Master
  • Knowledge Hub
      • Case Studies (11)
      • Long-term Functional Testing & Automation Project
      • Bringing Mobile Technologies to School
      • Process Workflow by the Book
      • Rapid Fire, High Intensity Quality Assurance...
      • Deliver a Swift, Structure Testing Solution...
      • Integration with Systems & People
      • MORE...
      • Videos (5)
      • Webinars
      • Training
      • Test Outsourcing in Eastern Europe
      • Acceptance Testing
      • 10 Signs Your Testing is Not Enough
      • Articles (27)
      • Introducing: The Future QA (Part 5)
      • Even More Trends (Part 4)
      • Artificial Intelligence and Machine Learning: I’ll Be Back…But Not Yet (Part 3)
      • Some Trend Analysis (Part 2)
      • Testing is dead. Long live the Testing (Part 1)
      • Striking The Balance: Is DevOps Going To Kill QA? (Part 5)
      • MORE...
  • Contact Us
    • Bulgaria
    • Serbia
    • Romania

10 Signs Testing is Not Enough (Part 3)


What Are the Next Three Signs That Strike Us Most That There Is Something Not “Quite Enough"?

Sign 3: Bug Counts Grow

Well, it may seem strange and yet, there are projects where after each build of the product the number of bugs encountered continues to grow. If that happens to you, do not just continue the testing.

There is a high probability that the number of bugs you are going to find in the next and the next build will continue to grow. As soon as you notice this tendency, you must sit and analyze why this is happening, outline the reasons and find solutions. Otherwise, not taking the preventive measure, your software product is highly possible to go in a Death Spiral.

“We cannot control what we cannot measure”

For the QA Lead/ Manager the controlling phase means that you have a view on your project and you could quickly respond to any deviations from the initially set goals. So, to have a clear view, it is good to also bear in mind and use the metrics. Good software testing metrics are really important as they encapsulate metrics that measure the effectiveness of the project and help gauge its progress, quality, and health of the testing effort.
Moreover, the carefully chosen and defined metrics can aid in improving the testing and testing process within the organization and also help track its status from time to time. It is quite common practice today, for test vendors, to share with the client metrics that exemplify productivity, efficiency and effectiveness in conjunction with the business benefits of the software projects. Never forget that without metrics it will be almost impossible to quantify, explain, or even demonstrate software quality. They also easily provide a quick insight of the status of the testing effort, thus influencing smart decisions (if taken seriously and into account).
Never forget that without metrics it will be almost impossible to quantify, explain, or even demonstrate software quality. They also easily provide a quick insight of the status of the testing effort, thus influencing smart decisions (if taken seriously and into account).

The basic metrics are quite popular and easy to be applied and they are really great for analyzing the trends in your project. So, there are several layer of metrics and we can offer you to use these ones:

  • Project Level Metrics – Requirements and Requirement Coverage and Defect Open and Close Rates. These two metrics are often used to measure the state of development of the project – in the beginning, in the middle or ending and what is the state of the fulfillment of the requirements of the business.
Here, you can see the simple formula to measure the requirements coverage and the defect open and close rates:
  • Department Level Metrics– the Meantime to Detect (MTTD) and Meantime to Repair (MTTR). MTTD measures how long it takes the QA professionals to find a problem, while the MTTR demonstrates the amount of time needed to effectively address it. As you can see, even the way and the velocity with which the QAs work can be measured and then, if there are any problems met, they should be carefully addressed to the people who are working slowly and there is no reason for this. That metric can also show that your product is quite complicated and a lot of time takes to discover a bug. Or even, maybe, that the testing done (if the metric is applied at a late stage in the software testing project) is quite enough and sufficient.
So, here you can see how to apply those metrics:
  • Company Level Metrics – Number of Issues reported by Customers – this is the metric by which you can measure the “done” you have succeeded in testing.
The metrics above are useful for the assessment of the stage of the software testing you are doing. You should apply them at every stage of the project as you have to make sure that everything is going as planned and there are no deviations from your expected results. They will show you clearly and in a statistical manner if there is something wrong with the project. And thus, you can take the necessary actions.

Sign 4: Not Investing Enough

Just look at your competitors and the investment in testing they are doing. If your investment is less, then you probably are out of date with the latest tendencies and quite soon enough it will turn out that your testing and the way you are doing it is not enough and will not satisfy the needs of the client.

Sign 5: No Clear Criteria

This is quite easy to imagine. If you have no criteria for the coverage (test or code), the execution of the test cases – their priority and set deadlines, the acceptable level of defects and the plan for fixing the defects found, it will be quite difficult for you to assure proper testing. The lack of everything above brings an almost disastrous situation to you and your team and even if one element is missing, the process will become more difficult. So, before starting the test process, why don’t you and your team go through the criteria you have on the table, see what else you need and after you are provided with all possible criteria on behalf of the business, start testing. Otherwise, if you assume you can manage with only partial criteria, then you will find yourself in a middle of an unclear testing phase with unclear requirements regarding the testing and for sure, delay or a serious pitfall.

Now, you are half way or more through our topic. Stay tuned, so you don’t miss the next remaining 5 signs helping you understand how much testing is enough.

Quality House Team

Knowledge Hub

  • Case Studies (11)
    • Long-term Functional Testing & Automation Project
    • Bringing Mobile Technologies to School
    • Process Workflow by the Book
    • Rapid Fire, High Intensity Quality Assurance...
    • Deliver a Swift, Structure Testing Solution...
    • Integration with Systems & People
    • Manual Testing for Website...
    • Specific Test Automation for Hardware Devices
    • Long-term Partnership and Collaboration
    • Quality Assurance & Validation...
    • Synchronized Back & Front-End Performance...
  • Videos (5)
    • Webinars
    • Training
    • Test Outsourcing in Eastern Europe
    • Acceptance Testing
    • 10 Signs Your Testing is Not Enough
  • Articles (27)
    • Introducing: The Future QA (Part 5)
    • Even More Trends (Part 4)
    • Artificial Intelligence and Machine Learning: I’ll Be Back…But Not Yet (Part 3)
    • Some Trend Analysis (Part 2)
    • Testing is dead. Long live the Testing (Part 1)
    • Striking The Balance: Is DevOps Going To Kill QA? (Part 5)
    • Even More Fails (Part 4)
    • The Factors for Success & A Little Bit of Fail History (Part 3)
    • What Did I Miss This Time? (Part 2)
    • A Bug's Life: The Basics (Part 1)
    • 10 Signs Testing is Not Enough (Part 5)
    • 10 Signs Testing is Not Enough (Part 4)
    • 10 Signs Testing is Not Enough (Part 3)
    • 10 Signs Testing is Not Enough (Part 2)
    • 10 Signs Testing Is Not Enough (Part 1)
    • How to Succeed in the Outsourcing Industry?
    • Future Trends in Outsourcing
    • Main Reasons Outsourcing Projects Fail
    • Marketplace of Eastern Europe
    • Top Outsourcing Destinations in 2016
    • The Outsourcing Market: Facts & Figures
    • What is Outsourcing?
    • Measure Twice, Accept Once (Part 4)
    • Measure Twice, Accept Once (Part 3)
    • Measure Twice, Accept Once (Part 2)
    • Measure Twice, Accept Once (Part 1)
    • Software Testing As a Key Factor For Startups to Build Trust in Their Product

Contact Us

    I accept GDPR Тerms & Conditions

 
No matter what software product you’re developing, testing and quality assurance are crucial and inseparable parts of the development cycle. Quality House oversees your final product fits your technical requirements like a glove.

Take the first step!

Give us a call at +359 2 958 33 06 or email us at sales@qualityhouse.com.

About Us

In all we do, from testing, consulting and assessing to outsourcing services and doing the research to recommend automated tools, we add value to the business development process through understanding your business and providing metrics to prove the effectiveness of our service. Quality House is here for you for the long run!
GDPR Terms & Conditions
ISO 9001:2015 certified
 Company

Useful Links

Testing ServicesBy App Type
By Testing Type
By Industry
By Company Size

QA ProfilesAvailable QA Profiles
Delivery
Pricing
Professional CoursesISTQB Foundation Level
ISTQB Agile Tester Foundation
ISTQB Advanced Level
ISTQB Specialist Level
Other Courses
Course Calendar

Knowledge HubCase Studies
Videos
Articles



Contact Us

  • Ivan Vazov district, 1 Balsha str., Fl. 3, 1408 Sofia, Bulgaria

  • +359 2 958 33 06

  • info@qualityhouse.com

Follow Us

GDPR Terms and Conditions
© Copyright 2023 Quality House Ltd. All Rights Reserved.