D365 QA For A UK Facilities Management Company

Testhouse was invited by a UK-based facilities management company during its mid-D365 implementation, due to testing delays, lack of dedicated QA functions with D365 knowledge and high defect leakage. Our solution included establishing a federated QE structure, optimizing the regression pack and customizing our open-source automation framework. This resulted in significant savings, increased release frequency and reduced defect leakage.

• Late Involvement in Implementation: Testhouse (TH) was invited to join in the middle of the implementation due to delays in testing.
• Lack of Dedicated QA with D365 Expertise: Absence of a dedicated Quality Assurance (QA) function with knowledge and experience in Dynamics 365 (D365).
• Resource-Intensive Manual Testing: Complete manual regression testing required 8 resources and took 4 weeks to complete.
• High Defect Leakage: Notable defect leakage, with 14% to User Acceptance Testing (UAT) and 7% to production.
• Limited Test Coverage: Insufficient test coverage at integration points between modules.
• Manual Role-Based Testing: The process of role-based testing was manually intensive and time-consuming.

• Federated QE Structure: Established a federated Quality Engineering (QE) structure, incorporating functional and technical consultants with direct links to Testhouse’s specialized Centers of Excellence (CoEs).
• Everyday Life Scenarios for Testing: Engaged with Business Stakeholders to identify everyday life scenarios for effective testing.
• Optimization of Regression Pack: Classified test cases into various packs for optimized regression testing.
• Customization of Frameium: Adapted Testhouse’s open-source automation framework, Frameium, to validate end-to-end business processes, achieving 80% regression test automation coverage.
• Development of Reusable Functions: Developed functions that enable in-sprint automation levels of 40%.

• Yearly Savings: Achieved $2 million USD in annual savings through automation.
• Increased Release Frequency: Improved release frequency from quarterly to fortnightly.
• Reduced Defect Leakage: Achieved a 60% reduction in defect leakage to UAT.