Code Coverage – Part III: Statement coverage and some myths

This post is part of a four-part series on code coverage: Part I: An Introduction Part II: A short example Part III: Statement coverage and some myths Part IV: Honest Coverage Consider the following scenario: After running your tests, you find that Service A has 100% statement coverage Service B has 80% statement coverage Service…More

Code Coverage – Part II: A short example

This post is part of a four-part series on code coverage: Part I: An Introduction Part II: A short example Part III: Statement coverage and some myths Part IV: Honest Coverage Golang is an excellent language that supports great tooling, by design (read more here). There are other languages that support coverage analysis natively, but for…More

Code Coverage – Part I: An Introduction

This post is part of a four-part series on code coverage: Part I: An Introduction Part II: A short example Part III: Statement coverage and some myths Part IV: Honest Coverage So, you’ve written some automation tests. Congratulations! Maybe you’ve been writing your test cases treating the system under test as a black box, or…More

Getting Started – Performance Testing

Introduction  Performance Testing is Non-Functional testing performed to evaluate application performance under some load and stress conditions. It is generally measured in terms of speed, scalability & stability for the user activity. This is to verify the behaviour of an application under load and to avoid business loss. Many complex systems have to undergo a performance test…More

Build an QA Platform’s Frontend with Ant Design Pro

Background: In the past two years QA team growth rapidly, more and more new hires joined our team. In order the improve management efficiency for our daily work we designed a platform called QA Platform, the main features includes Task Management, Personal Performance Management, Live Bug Management and corresponding Approve&Request workflow, Permission Control and Role…More

Mitigate Golang Flaky Testing Pain with Rerun Support

Background ● In software API automation testing, users will often encounter issues when conducting automation testing in a heterogeneous environment such as:  ○ intermittent unstable network  ○ 3rd party API temporary outage  ○ temporary OS environment issues  ● Test cases failures in such situations do not truly represent product code failure. Triaging these kinds of…More

Integrate Automated Testing Into SDLC to Empower a Better Regression Testing Productivity

Background Before going into the main dish, let’s clarify the regression requirement.Our team is aim to do business functional testing and use grey-box to design test cases. Thus if the requirement satisfies the following principles, it will be considered into a regression requirement: Pure technical improvement like code refactoring, adding monitoring, etc. Low impact on…More

Chaos Engineering Introduction

Introduction Chaos Engineering is the discipline of experimenting on a system in order to build confidence in the system’s capability to withstand turbulent conditions in production. To build a more resilient system by deliberate destruction. Roadmap 2010: Netflix Eng Tools team create Chaos Monkey. was created in response to Netflix’s move from physical infrastructure to…More

Redis Performance Test

Introduction Redis is an open source (BSD licensed), in-memory data structure store, used as a database, cache, and message broker. Redis provides data structures such as strings, hashes, lists, sets, sorted sets with range queries, bitmaps, hyperloglogs, geospatial indexes, and streams.  For some cases, we need to know the performance benchmark of redis sentinel and…More