Introduction Performance Testing is Non-Functional testing performed to evaluate application performance under some load and stress conditions. It is generally measured in terms of speed, scalability & stability for the user activity. This is to verify the behaviour of an application under load and to avoid business loss. Many complex systems have to undergo a performance test…More
Build an QA Platform’s Frontend with Ant Design Pro
Background: In the past two years QA team growth rapidly, more and more new hires joined our team. In order the improve management efficiency for our daily work we designed a platform called QA Platform, the main features includes Task Management, Personal Performance Management, Live Bug Management and corresponding Approve&Request workflow, Permission Control and Role…More
Mitigate Golang Flaky Testing Pain with Rerun Support
Background ● In software API automation testing, users will often encounter issues when conducting automation testing in a heterogeneous environment such as: ○ intermittent unstable network ○ 3rd party API temporary outage ○ temporary OS environment issues ● Test cases failures in such situations do not truly represent product code failure. Triaging these kinds of…More
Integrate Automated Testing Into SDLC to Empower a Better Regression Testing Productivity
Background Before going into the main dish, let’s clarify the regression requirement.Our team is aim to do business functional testing and use grey-box to design test cases. Thus if the requirement satisfies the following principles, it will be considered into a regression requirement: Pure technical improvement like code refactoring, adding monitoring, etc. Low impact on…More
Chaos Engineering Introduction
Introduction Chaos Engineering is the discipline of experimenting on a system in order to build confidence in the system’s capability to withstand turbulent conditions in production. To build a more resilient system by deliberate destruction. Roadmap 2010: Netflix Eng Tools team create Chaos Monkey. was created in response to Netflix’s move from physical infrastructure to…More
Redis Performance Test
Introduction Redis is an open source (BSD licensed), in-memory data structure store, used as a database, cache, and message broker. Redis provides data structures such as strings, hashes, lists, sets, sorted sets with range queries, bitmaps, hyperloglogs, geospatial indexes, and streams. For some cases, we need to know the performance benchmark of redis sentinel and…More
Android UI Espresso Testing – Featuring Code Coverage Analysis
Google Test Lab “Firebase Test Lab is a cloud based app-testing infrastructure. With one operation, you can test your android or iOS app across a wide variety of devices and device configurations, and see the results—including logs, videos, and screenshots—in the Firebase console” – https://firebase.google.com/docs/test-lab/ Test Matrix Key capabilities Google Test Lab – Robo Testing Robo test is a test tool that is…More
QA Test Execution Maturity Model
Background Definition: Testing a ticket is comprised of two processes, namely, designing test cases followed by executing them. Disclaimer This page focuses on defining the growth stages of a QA’s capability to perform the second process (i.e. executing test cases) via a Test Execution Maturity Model. Definition: A Test Execution Maturity Model (TEMM) is a roadmap for a feature QA in their journey of acquiring…More
Build an Event-Driven Streaming Test Execution Monitoring Platform for Better Observability
Background One of the most essential key metrics we use to evaluate the ROI of test automation is test stability. Currently all of the test reports/tools/plugins in the test community calculate the test pass rate based on the latest test result. However test stability should be an overall test pass rate which needs to be…More
Web App Testing with Cypress
A brief introduction into the world of Web app E2E testing. Oftentimes, people forsake end-to-end testing as it can be cumbersome, expensive, and annoying to do. This is all very true. However when shit hits the fan and regression testing is needed, a comprehensive automated test suite is a godsend, saving time and resources for…More