Salesforce Testing For A US Media Company

For our client, a Large Media Company, we tackled the challenge of implementing Salesforce for their sales and customer services. They have been struggling with inadequate test coverage and high defect leakage due to the lack of formal testing practices. We addressed these issues by setting up Azure DevOps, creating a regression suite, integrating continuous testing and establishing a robust reporting mechanism. These improvements significantly reduced the defect leakage, test cycle time and release cycles, improving on-time delivery and overall customer satisfaction.

Our customer, a global media leader, embarked on a Salesforce implementation for their sales and customer services functions. The initial challenge was the absence of a formal testing practice, with business users conducting testing. This resulted in inadequate test coverage, especially for Lightning updates, leading to a high defect leakage rate of 30% into production. The extended test cycle time of 3 weeks impacted business productivity. The lack of testing processes and quality gates led to late-stage issue identification, causing higher rework costs and schedule impacts.

Our solution began with a comprehensive assessment of Salesforce implementation and configurations. We reviewed existing test artefacts, providing gap analysis and a recommendation roadmap. The implemented solutions included:

• ALM Tool Setup: Introduced Azure DevOps (ADO) to manage test artefacts, user stories, and reporting. Established traceability between user stories and tests to measure test coverage.
• Regression Suite and Test Automation: Created a comprehensive regression suite covering end-to-end business flows across the client landscape. Automated key business workflows using an open-source Selenium-based framework called Frameium.
• Continuous Testing Integration: Integrated tests with Azure Pipeline and established agents for unmanned parallel test execution daily.
• Non-Functional Requirements Validation: Captured non-functional requirements and defined strategies for performance, security, and accessibility testing. Validated non-functional requirements using tools like JMeter (for performance), Burpsuite, ZAP (for security), and Deque (for Accessibility).
• Robust Reporting Mechanism: Customized ADO widgets to establish a robust reporting mechanism, providing insights on test executions.

The outcomes of our engagement were transformative, bringing substantial benefits to their Salesforce implementation:

• Defect Leakage Reduction: Achieved a remarkable 90% reduction in defect leakage to production, enhancing product quality.
• Test Cycle Time Reduction: Realized an 80% reduction in test cycle time, moving from 3 weeks to just 2 days through test automation and continuous testing practices.
• Release Cycle Improvement: Significantly reduced rework efforts, enabling release cycles to transition from quarterly to fortnightly.
• On-Time Delivery: Achieved 100% on-time delivery, ensuring timely releases and enhancing overall project efficiency.
• Enhanced Customer Satisfaction: Delivered improved product quality, leading to heightened customer satisfaction.