case study in software testing

Article & Observations About Diverse Teams Working Better Together

Software Testing Client Project Case Study

Apr 21 • Case Studies

We are often asked what software testing is . The video below shares a solid definition of the term.

But we thought a software testing project case study might be helpful to better understand what software testers do on a typical day. This includes testing software, writing requirement documents for our clients, and creating user guides to ensure compliance for our clients to use for quality assurance and auditing purposes.

Iterators LLC was hired to complete accessibility testing for a few projects for the Library of Congress (LOC). Accessibility testing is required on all government websites, with Section 508 and WCAG 2.2 requirements used. To become a Trusted Tester an employee must complete the DHS Trusted Tester online training course requirements and pass the DHS Section 508 Trusted Tester Certification Exam of Homeland Security in Accessibility, and we are in a unique position to help on this project. We cross-train all our employees so that we can work on several projects at one time or several different aspects of a project to complete the work and reduce the cost to our clients.

Our first project assigned by LOC was testing their new braille feature on BARD Mobile for Android. We were tasked with testing the braille feature with several refreshable braille displays.

During our testing, we used the Orbit Reader 20 , and two different braille displays from Freedom Focus 14 and Freedom Focus 40 . There are plans to use other refreshable displays such as Humanware, but this testing has not occurred yet. We needed to test refreshable braille displays and their use in tandem with Google BrailleBack and Google TalkBack .

This work was to ensure that all hardware worked as expected with the apps we were testing. For this testing, we had to complete functional testing, smoke testing, exploratory testing and had a user panel to ensure we caught all issues that a visually impaired individual might experience while using the app.

Initially, our client was unsure if we would find any bugs and hesitant to have us enter bugs into Bugzilla as they stated the software was “complicated”. Bugzilla is a web-based general-purpose bug tracking system and not unlike other bug tracking systems we use every day such as Jira, TestRails, PractiTest, and Click-Up.

Testing was completed over several agile sprints with many significant software testing bugs found. Our testing had us test against the National Library Service requirements document. Next, we had to create an up-to-date user manual. While the manual had been updated several times, the testing had not been.

For example, when downloading a book or magazine from the Now Reading section of the mobile app, the download would end up at the bottom of the page. For years, the user guide had listed the download being at the top of the page once the document was downloaded.

Our testing team, on several occasions, said this was an error in the documentation and that the download ends up at the bottom of the page. This was corrected in the user document and sent to the development team to fix per the requirement document.

Over the next several months, we reported 30 high-priority bugs with about half fixed at this point. We have encouraged our client to test in an agile fashion because once the development team is finished, it’s harder to get these bugs fixed.

Our bugs were reported and based on the requirement document used to create the software. Lastly, the user guide had to be rewritten to reflect the app's behavior and general updates.

Once the app was tested and created, the user guide was sent to Communication Services to ensure the style used per other requirement documentation. This document had to be approved before being disseminated to the public. For example, how does the library determine what the Most Popular Books are, and over what period.

Once the document was returned from COS, this PDF document had to be remediated . The process of remediation is to make a PDF, create the heading for the document, alt text added to meaningful images, and decorative images either ignored or taken out of the digital document altogether.

Once the remediation process is complete and validated, the document becomes ADA-compliant. We then provide an accessible PDF that can be read with the use of a screen reader and create the HTML output so that the document can be added to the Library of Congress website.

You can find the current user guide we completed here: https://www.loc.gov/nls/braille-audio-reading-materials/bard-access/bard-mobile-android/#creatingfolders3.3

Case studies can be a great learning tool in software testing and project management. By looking at project case study examples, you can see how the project was planned and executed, as well as how certain tasks were managed. This can give a better understanding of what software testing involves on a daily basis. With the right software testing case studies example, software testers can hone their skills, improve project performance, and ultimately deliver better software testing results.

Related Resources:

Crafting an Effective Test Plan: A Step-by-Step Guide
Top Test Management Tools
Mobile Application Functional and Performance Testing

About the Author

Jill Willcox has worked on accessibility issues for most of her professional career. Iterators is an inclusive women-owned small business (WOSB) certified by the Small Business Administration and WBENC. We provide software testing services for websites, mobile apps, enterprise software, and PDF remediation services, rendering PDFs ADA compliant.

Jill Willcox

Clutch names iterators llc as a top certified women-owned business for 2022.

Iterators LLC named Top Certified Women0owned Business Again 2022

Test Strategy vs Test Plan: What’s the Difference?

What is the difference between a test strategy and a test plan? Read this article to b...

May 05 • Reference

Case Studies

Discover our software testing case studies that show how we've helped top brands achieve their business and software development goals..

Mobile Testing
Performance Testing
Software Testing
Test Automation
Tool Development
AI Development

We innovatively crafted an AI copilot for Bantotal, named Bantotal Copilot.

We helped Shutterfly to maintain its site's competitive advantage of delivering a superior customer experience.

We conducted performance engineering for BBVA's e-commerce system, reducing response times by 80%.

We enhanced Singularity University's digital journey with specialized web and mobile testing.

Our experts developed scalable, resilient frameworks that ensured high-performance native apps.

We partnered with Threads to launch a high-quality communication platform from product development to delivery.

We amplified the streaming experience for 85,000 concurrent viewers in Asia.

We optimized Pronto+'s software development processes with automated performance testing.

AIA benefited from our optimized testing, improved platform stability, and quality recommendations.

GeneXus accelerated its software cycle with GXtest, our specialized automation tool that halved regression testing time.

We helped Marine Credit Union to strengthen their system's robustness and prepared them for self-sustained maintenance.

We supported and empowered GO’s engineering team with the design and implementation of a mobile app delivery pipeline.

We Enhanced EsSalud's IT System for Peak Performance.

We assisted Keeeb in scaling up quality control efforts and accelerating its digital transformation.

We have helped ANEP-DGEIP to enhance its software development and quality through the implementation of test methodologies and DevOps strategies.

COVID-19: Collaborating to Develop Life-Saving Software.

We facilitated Mosca Hnos.' smooth transition to advanced systems while maintaining uninterrupted service.

We streamlined Macromercado's system transition with GeneXus platform testing.

We refined a banking application for a client with a rich history spanning over 150 years.

Our experts implemented a testing strategy from scratch in a new Scrum team to enhance their AI-based web and mobile apps.

What Others Say...

"Abstracta is an excellent Quality Assurance partner, focused, motivated and skilled within their area of expertise. They delivered as expected and proposed organizational and process improvements which makes them a good long-term partner. Excellent job, thanks!"

Johan Frentz

"We were very impressed with Abstracta’s contractor and she seemed like a very good fit for what we had been looking for this project. I also wanted to commend and thank you for the quality of requested."

Steve Reichgut

VP of Engineering Benefit Cosmetics

"Abstracta management understood our unique testing needs and matched us up with a talented engineer who was quick to get up to speed with Gatling and our test environment. He asked apt questions, gave excellent status reports, and was overall a pleasure to work with. We look forward to continuing to work with Abstracta as the need arises."

Melissa Chawla

SR Manager Performance Engineering Shutterfly

Ready to improve the quality of your software? Our experienced team has helped startups to Fortune 500 companies. Fill out the form below and let's get started!

or email us at [email protected]

Top 20 Automation Testing Case Studies in 2024

Cem is the principal analyst at AIMultiple since 2017. AIMultiple informs hundreds of thousands of businesses (as per Similarweb) including 60% of Fortune 500 every month.

Cem's work has been cited by leading global publications including Business Insider, Forbes, Washington Post, global firms like Deloitte, HPE, NGOs like World Economic Forum and supranational organizations like European Commission. You can see more reputable companies and media that referenced AIMultiple.

Transitioning to automated testing is the top priority in the software testing environment because of Its benefits , such as:

Testing time reduction
Increase testing coverage
Higher feedback speed
Quality improvement

In this article, we will review 20 case studies from different vendors and companies and explore the challenges or goals that they had before implementing test automation. Lastly, we will cover the effect of test automation on their business to guide QA executives regarding their investments in testing automation.

Examples of test automation case studies

The following table has 20 case studies gathered from different companies and vendors. The first company listed is an AIMultiple sponsor.

As you observe, automation testing can have substantial positive impacts on a company’s QA process and is used by companies in different industries.

Selenium is an open-source tool for test automation. A common characteristic we noticed in 50% of the case studies mentioned is that the companies initially used or experimented with Selenium. However, companies opted for a different test automation provider because they found out Selenium was either too complicated to use or inefficient for their needs.

We will focus on the common problems observed in the case studies, which were solved by automation testing.

According to our observation, developers tend to skip or reduce testing if a company has a hard-to-use or ineffective testing system because it increases the effort required without a clear benefit. An ineffective testing system can harm a company substantially by allowing bugs to reach later development stages which can result in:

Higher cost of bug fixing
Lower product quality
Loss of customers

Automation testing effect : Test automation can reduce the effort required by manual testing. It is reported that in 46% of the cases where test automation was implemented, 50% or more of the manual testing was replaced. Additionally, 55% of companies seeking test automation mention quality improvement as their main strategic driver.

Slow testing

Slow testing is a significant hurdle in the age of agile development and CI/CD. It is estimated that 35% of the testing cycle is spent on manual testing. Slow testing increases the development time and reduces the feedback available for each build of a design.

Automation testing effect : Test automation can significantly increase the number of tests that can be run in a time period. 30% of companies that are pursuing test automation indicate time to market as their main driver.

Workforce with different skill levels

Each company’s testing workforce is different. Within a team, skill levels can be drastically different among members; some can be professional testers with advanced programming knowledge, while others might not know how to program.

Automation testing effect : Test automation tools can provide no/low-code solutions that can benefit non-technical users.

To learn more about software testing best practices, you can read our Top 10 Best Practices for Software Testing .

Next to Read

6 static code analysis best practices in 2024, transitioning from manual to automation testing in 2024, rest api testing in 2024: definition & challenges.

Your email address will not be published. All fields are required.

QA outsourcing
Managed testing
Dedicated QA Team
QA Staffing
DevOps Testing
Software Product Testing
Healthcare Software Testing
Banking Application Testing
Hire QA Engineer
--> --> -->