Home
/
Blog
/
Hiring Tools
/
How to be a badass ninja QA tester

How to be a badass ninja QA tester

Author
Ajay George
Calendar Icon
May 5, 2017
Timer Icon
3 min read
Share

Explore this post with:

Quality Assurance is more than just finding bugs in an application. The QA team focuses on delivering a quality product that is developed by a developer,within a deadline. The QA team’s primary task is to eliminate the issues that may affect the way the product works and thereby hampering the user experience.

When we approach testing in a project, irrespective of how small or big a project is, we always strive to achieve the testing pyramid. If you have never come across this model then go and look it up, it’s on the list of being a badass!

“Quality is not an act, it is a habit.”— Aristotle

Here is the pyramid,

Why Quality Assurance (QA) is a must in software development?

The longer a bug goes undetected, more expensive it is to fix. A simple cost vs. benefits analysis overwhelmingly shows that the benefits of employing a QA test engineer to validate the code far outweighs the costs.Most importantly, it also influences your product’s reputation!

Here is why the QA process is important in software development:

  • An extensive QA process is performed to eliminate avoidable defects or bugs before a site is made live.
  • QA is done to make the website credible and easy to operate.
  • What if the search button of a search engine like Google, which is used by millions of people every single day, doesn’t work? It might require a simple fix, which can be done by a developer in a jiffy. However,this defect will encourage users to use a different search engine,which leads to a loss in users
  • A proper QA process will help you find defects that can be fixed before the website goes live.
  • When a product is launched, it is a must for the product to have undergone the complete QA process. What if the product is launched and the users find that something is not working as expected? The company will lose its credibility, reputation, and resolving the issue will become expensive and time-consuming
  • The QA process is not just for delivering stable products there is a higher purpose. The purpose is to make users and customers believe that the company is credible, retain the number of users, provide the users a great experience.

If you are still skeptical, look at these stats!

  • In April 26 1994, China Airlines Airbus A300 crashed due to a software bug killing 264 passengers.
  • In April 1999, a software bug caused the failure of a $1.2 billion military satellite launch, one of the most expensive accidents in history.
  • In May 1996, a software bug caused the bank accounts of 823 customers of a major U.S. bank to be credited with 920 million US dollars.

The QA process can be a lifesaver sometimes, can’t it?

How is the QA process performed?

Method

Courtesy:Jack Sheppard

The QA should be aware of the stack, the frameworks, the business purpose of the feature, and most importantly understand the customer’s and user’s pain! This is where the QA process starts and this is where you should begin!

We believe that the QA then enters into the Design Phase and starts its transformation from then on. Having a pre-design QA assessment is even better. Once the company decides to build a product, the PM schedules a meeting with the developers, QA engineers, and designers.

During this meeting, the PM explains the purpose, need, and user requirements that will be used when the product is built.This clarifies information about design, engineering, stack, and other engineering requirements. During this time the QA engineer will understand and clarify information about the origination of the requirement.From there on, QA becomes an integral part of every process till and after the delivery of the product

The following processes must be followed for an effective QA process:

Design QA

Once the design is completed, there should obviously be the obvious design QA. The QA engineer has a discussion with all the members of the software development team.

In this informal discussion table,the features in the product would be explained to the entire team,which they will soon be starting to develop.Then we start the design QA, in which the QA team will go through the entire design to check about functionality, feature, enhancements, user requirements, business purpose validation, potential issues, foresee complexities that may exist and are briefly made aware on the drawing board to the devs during the design QA process.

Create the test scenario document

After the design QA is done, the QA team starts designing a test scenario document (sample template), which is a hybrid of use case and test case documents.

This document will be used throughout the testing phase. It contains a list of all the possible scenarios that are identified for testing in the product based on the design. Once the testing begins, the scenarios will be iteratively added during the Executing phase.

Documentation review

Documentation review is a critical step in the QA process.This review decides the direction of the testing process and direction is very important.

This review is done by developers or the PM before the execution phase starts. In this step, either the developer or the PM goes through the test scenario document that was created by the QA team and checks whether all the scenarios have been covered.

If a scenario is missing, it is the shared responsibility of the PM, developers, and QA engineer to ensure that it is added. It is recommended that you do not start testing until all the scenarios have been added to the document.

Execution

Execution is the phase where the real testing happens. The testing process is started when 75% of the product has been developed thus avoiding rework by the time the development reaches 95%.

Rework is mitigated by the test scenario document which was created during the test scenario phase. If you take up QA earlier, then you will not have the appropriate QA and test coverage. If you do QA after the product or feature has been fully developed, then you will have to deal with a lot of demotivation among the developers due to rework.

You must test all the scenarios which are covered in the test scenario document along with the scenarios which you come across while testing the actual product. Add the new scenarios to the document while testing.

The execution phase takes its own time.There will not be any compromise on the time for QA. The results of the execution will be noted in the test scenario document and the same will be shared with the developers who have developed the product.

During the execution phase, not only the scenarios are just covered but the user experience would be tested too.The way the product behaves,all the functionalities,features,UI would also be tested.If a scenario fails.We would add the explanation of it along with the screenshot,URL,steps to reproduce.

Defect reporting

As Joel says in his blog,

“A great tester gives programmers immediate feedback on what they did right and what they did wrong. Believe it or not, one of the most valuable features of a tester is providing positive reinforcement. There is no better way to improve a programmer’s morale, happiness, and subjective sense of well-being than a La Marzocco Linea espresso machine to have dedicated testers who get frequent releases from the developers, try them out, and give negative and positive feedback. Otherwise it’s depressing to be a programmer.”

During a sprint ,the defects that are found should be noted in the a defect summary sheet (sample defect summary) of a test scenario document (sample template).This helps the developer to view the defect along with the explanation, screenshot, URL, and steps to reproduce the defect.

The developer then fixes the defects. If a defect is not valid, then it will be classified as one of the following:

  • Feature
  • Bug that cannot be fixed for various reasons or requires a design change.

Otherwise, the defect is marked as fixed in the relevant column of the test scenario document and also updates the Maniphest log. The defects can be related to the functionality, features, UI, or anything that affects the way the product works.

Maniphest

Maniphest is one of the defect-management tools that is used during the QA process. It helps to manage the entire bug life-cycle. As tests are executed, you may find bugs in the existing flow or may feel there is scope for a few enhancements. You should immediately, create a task in Maniphest and assign it to the relevant developer.

Based on the priority, bugs will be fixed. Once the bug is fixed, the author of the bug i.e. the relevant QA engineer will receive an email notification.This helps the QA engineer to retest the bug and change the status accordingly.

Retesting

Once the issue is marked as fixed by the developer in the test scenario document, the retesting of the specific defect is the responsibility of the QA engineer who reported the issue. The results of the retesting should also be recorded in the test scenario document.

The Testing phase ends with this step. Retesting will be done at the end of the Execution phase because execution is usually done on a fully developed product—the most stable version of the product.

Test closure

This is the step where the QA team prepares the release notes of the testing process.

Release notes contain the following information:

  • Description of the product that was tested
  • Time taken
  • Approach followed
  • Reference links
  • Test results
  • Type of testing that was done

After the release notes are sent to the whole team, the QA process ends.

Types of testing at HackerEarth

Automation testing

While there is plenty of room for improving the QA process at HackerEarth, we are now trying to put an emphasis on building automated tests so that we can let people do what people are good at and have computers do what computers are good at. That doesn’t mean that we never do manual testing or drop out of the pyramid. Instead we do the “right” amount of manual testing with more human-oriented focus (e.g. exploratory testing) and try to ensure that we never do repetitive manual testing.

Performance testing

Performance testing is an important type of testing which is a must before deploying any new change. Performance testing is performed to determine the behavior of a system under both normal and expected peak-load conditions. It helps to identify the maximum operating capacity of an application.We use New Relic for the performance testing.

“An application can work fine for a single user but may break when multiple users use it simultaneously.”

We use JMeter to perform load testing.

JMeter creates realistic & accurate scenarios, sends requests to appropriate servers which show the performance of an appropriate server/application via tables, graphs etc.

Environments used for testing

We have an environment that is a replica of the production environment. It is called the ‘staging environment’.We use this staging environment for the testing process.

The developers develop an application in their local environment and push it to staging where the QA engineer will test the application. All the testing takes place in the staging environment.

We would never have been able to get this far and achieve an effective QA process without a dedicated grassroots effort from everyone in the team. This effort would have failed if it hadn’t been combined with huge improvements in our testing tool, processes, and mind shift along with the business and developers.

“QA is hard!! If it was easy, anyone could have done it. The ‘hard’ part is what makes QA important!”

We have taken a serious and pragmatic approach to establish a definite QA process. The important thing about this process is that QA at HackerEarth has evolved into a multi-dimensional process. We have formulated this QA process collaboratively and improved it over time.

Wondering what is the best way to introduce QA process in your team? Just get started! Good luck!

Subscribe to The HackerEarth Blog

Get expert tips, hacks, and how-tos from the world of tech recruiting to stay on top of your hiring!

Author
Ajay George
Calendar Icon
May 5, 2017
Timer Icon
3 min read
Share

Hire top tech talent with our recruitment platform

Access Free Demo
Related reads

Discover more articles

Gain insights to optimize your developer recruitment process.

How I used VibeCode Arena platform to build code using AI and leant how to improve it

I Used AI to Build a "Simple Image Carousel" at VibeCodeArena. It Found 15+ Issues and Taught Me How to Fix Them.

My Learning Journey

I wanted to understand what separates working code from good code. So I used VibeCodeArena.ai to pick a problem statement where different LLMs produce code for the same prompt. Upon landing on the main page of VibeCodeArena, I could see different challenges. Since I was interested in an Image carousal application, I picked the challenge with the prompt "Make a simple image carousel that lets users click 'next' and 'previous' buttons to cycle through images."

Within seconds, I had code from multiple LLMs, including DeepSeek, Mistral, GPT, and Llama. Each code sample also had an objective evaluation score. I was pleasantly surprised to see so many solutions for the same problem. I picked gpt-oss-20b model from OpenAI. For this experiment, I wanted to focus on learning how to code better so either one of the LLMs could have worked. But VibeCodeArena can also be used to evaluate different LLMs to help make a decision about which model to use for what problem statement.

The model had produced a clean HTML, CSS, and JavaScript. The code looked professional. I could see the preview of the code by clicking on the render icon. It worked perfectly in my browser. The carousel was smooth, and the images loaded beautifully.

But was it actually good code?

I had no idea. That's when I decided to look at the evaluation metrics

What I Thought Was "Good Code"

A working image carousel with:

  • Clean, semantic HTML
  • Smooth CSS transitions
  • Keyboard navigation support
  • ARIA labels for accessibility
  • Error handling for failed images

It looked like something a senior developer would write. But I had questions:

Was it secure? Was it optimized? Would it scale? Were there better ways to structure it?

Without objective evaluation, I had no answers. So, I proceeded to look at the detailed evaluation metrics for this code

What VibeCodeArena's Evaluation Showed

The platform's objective evaluation revealed issues I never would have spotted:

Security Vulnerabilities (The Scary Ones)

No Content Security Policy (CSP): My carousel was wide open to XSS attacks. Anyone could inject malicious scripts through the image URLs or manipulate the DOM. VibeCodeArena flagged this immediately and recommended implementing CSP headers.

Missing Input Validation: The platform pointed out that while the code handles image errors, it doesn't validate or sanitize the image sources. A malicious actor could potentially exploit this.

Hardcoded Configuration: Image URLs and settings were hardcoded directly in the code. The platform recommended using environment variables instead - a best practice I completely overlooked.

SQL Injection Vulnerability Patterns: Even though this carousel doesn't use a database, the platform flagged coding patterns that could lead to SQL injection in similar contexts. This kind of forward-thinking analysis helps prevent copy-paste security disasters.

Performance Problems (The Silent Killers)

DOM Structure Depth (15 levels): VibeCodeArena measured my DOM at 15 levels deep. I had no idea. This creates unnecessary rendering overhead that would get worse as the carousel scales.

Expensive DOM Queries: The JavaScript was repeatedly querying the DOM without caching results. Under load, this would create performance bottlenecks I'd never notice in local testing.

Missing Performance Optimizations: The platform provided a checklist of optimizations I didn't even know existed:

  • No DNS-prefetch hints for external image domains
  • Missing width/height attributes causing layout shift
  • No preload directives for critical resources
  • Missing CSS containment properties
  • No will-change property for animated elements

Each of these seems minor, but together they compound into a poor user experience.

Code Quality Issues (The Technical Debt)

High Nesting Depth (4 levels): My JavaScript had logic nested 4 levels deep. VibeCodeArena flagged this as a maintainability concern and suggested flattening the logic.

Overly Specific CSS Selectors (depth: 9): My CSS had selectors 9 levels deep, making it brittle and hard to refactor. I thought I was being thorough; I was actually creating maintenance nightmares.

Code Duplication (7.9%): The platform detected nearly 8% code duplication across files. That's technical debt accumulating from day one.

Moderate Maintainability Index (67.5): While not terrible, the platform showed there's significant room for improvement in code maintainability.

Missing Best Practices (The Professional Touches)

The platform also flagged missing elements that separate hobby projects from professional code:

  • No 'use strict' directive in JavaScript
  • Missing package.json for dependency management
  • No test files
  • Missing README documentation
  • No .gitignore or version control setup
  • Could use functional array methods for cleaner code
  • Missing CSS animations for enhanced UX

The "Aha" Moment

Here's what hit me: I had no framework for evaluating code quality beyond "does it work?"

The carousel functioned. It was accessible. It had error handling. But I couldn't tell you if it was secure, optimized, or maintainable.

VibeCodeArena gave me that framework. It didn't just point out problems, it taught me what production-ready code looks like.

My New Workflow: The Learning Loop

This is when I discovered the real power of the platform. Here's my process now:

Step 1: Generate Code Using VibeCodeArena

I start with a prompt and let the AI generate the initial solution. This gives me a working baseline.

Step 2: Analyze Across Several Metrics

I can get comprehensive analysis across:

  • Security vulnerabilities
  • Performance/Efficiency issues
  • Performance optimization opportunities
  • Code Quality improvements

This is where I learn. Each issue includes explanation of why it matters and how to fix it.

Step 3: Click "Challenge" and Improve

Here's the game-changer: I click the "Challenge" button and start fixing the issues based on the suggestions. This turns passive reading into active learning.

Do I implement CSP headers correctly? Does flattening the nested logic actually improve readability? What happens when I add dns-prefetch hints?

I can even use AI to help improve my code. For this action, I can use from a list of several available models that don't need to be the same one that generated the code. This helps me to explore which models are good at what kind of tasks.

For my experiment, I decided to work on two suggestions provided by VibeCodeArena by preloading critical CSS/JS resources with <link rel="preload"> for faster rendering in index.html and by adding explicit width and height attributes to images to prevent layout shift in index.html. The code editor gave me change summary before I submitted by code for evaluation.

Step 4: Submit for Evaluation

After making improvements, I submit my code for evaluation. Now I see:

  • What actually improved (and by how much)
  • What new issues I might have introduced
  • Where I still have room to grow

Step 5: Hey, I Can Beat AI

My changes helped improve the performance metric of this simple code from 82% to 83% - Yay! But this was just one small change. I now believe that by acting upon multiple suggestions, I can easily improve the quality of the code that I write versus just relying on prompts.

Each improvement can move me up the leaderboard. I'm not just learning in isolation—I'm seeing how my solutions compare to other developers and AI models.

So, this is the loop: Generate → Analyze → Challenge → Improve → Measure → Repeat.

Every iteration makes me better at both evaluating AI code and writing better prompts.

What This Means for Learning to Code with AI

This experience taught me three critical lessons:

1. Working ≠ Good Code

AI models are incredible at generating code that functions. But "it works" tells you nothing about security, performance, or maintainability.

The gap between "functional" and "production-ready" is where real learning happens. VibeCodeArena makes that gap visible and teachable.

2. Improvement Requires Measurement

I used to iterate on code blindly: "This seems better... I think?"

Now I know exactly what improved. When I flatten nested logic, I see the maintainability index go up. When I add CSP headers, I see security scores improve. When I optimize selectors, I see performance gains.

Measurement transforms vague improvement into concrete progress.

3. Competition Accelerates Learning

The leaderboard changed everything for me. I'm not just trying to write "good enough" code—I'm trying to climb past other developers and even beat the AI models.

This competitive element keeps me pushing to learn one more optimization, fix one more issue, implement one more best practice.

How the Platform Helps Me Become A Better Programmer

VibeCodeArena isn't just an evaluation tool—it's a structured learning environment. Here's what makes it effective:

Immediate Feedback: I see issues the moment I submit code, not weeks later in code review.

Contextual Education: Each issue comes with explanation and guidance. I learn why something matters, not just that it's wrong.

Iterative Improvement: The "Challenge" button transforms evaluation into action. I learn by doing, not just reading.

Measurable Progress: I can track my improvement over time—both in code quality scores and leaderboard position.

Comparative Learning: Seeing how my solutions stack up against others shows me what's possible and motivates me to reach higher.

What I've Learned So Far

Through this iterative process, I've gained practical knowledge I never would have developed just reading documentation:

  • How to implement Content Security Policy correctly
  • Why DOM depth matters for rendering performance
  • What CSS containment does and when to use it
  • How to structure code for better maintainability
  • Which performance optimizations actually make a difference

Each "Challenge" cycle teaches me something new. And because I'm measuring the impact, I know what actually works.

The Bottom Line

AI coding tools are incredible for generating starting points. But they don't produce high quality code and can't teach you what good code looks like or how to improve it.

VibeCodeArena bridges that gap by providing:

✓ Objective analysis that shows you what's actually wrong
✓ Educational feedback that explains why it matters
✓ A "Challenge" system that turns learning into action
✓ Measurable improvement tracking so you know what works
✓ Competitive motivation through leaderboards

My "simple image carousel" taught me an important lesson: The real skill isn't generating code with AI. It's knowing how to evaluate it, improve it, and learn from the process.

The future of AI-assisted development isn't just about prompting better. It's about developing the judgment to make AI-generated code production-ready. That requires structured learning, objective feedback, and iterative improvement. And that's exactly what VibeCodeArena delivers.

Here is a link to the code for the image carousal I used for my learning journey

#AIcoding #WebDevelopment #CodeQuality #VibeCoding #SoftwareEngineering #LearningToCode

The Mobile Dev Hiring Landscape Just Changed

Revolutionizing Mobile Talent Hiring: The HackerEarth Advantage

The demand for mobile applications is exploding, but finding and verifying developers with proven, real-world skills is more difficult than ever. Traditional assessment methods often fall short, failing to replicate the complexities of modern mobile development.

Introducing a New Era in Mobile Assessment

At HackerEarth, we're closing this critical gap with two groundbreaking features, seamlessly integrated into our Full Stack IDE:

Article content

Now, assess mobile developers in their true native environment. Our enhanced Full Stack questions now offer full support for both Java and Kotlin, the core languages powering the Android ecosystem. This allows you to evaluate candidates on authentic, real-world app development skills, moving beyond theoretical knowledge to practical application.

Article content

Say goodbye to setup drama and tool-switching. Candidates can now build, test, and debug Android and React Native applications directly within the browser-based IDE. This seamless, in-browser experience provides a true-to-life evaluation, saving valuable time for both candidates and your hiring team.

Assess the Skills That Truly Matter

With native Android support, your assessments can now delve into a candidate's ability to write clean, efficient, and functional code in the languages professional developers use daily. Kotlin's rapid adoption makes proficiency in it a key indicator of a forward-thinking candidate ready for modern mobile development.

Breakup of Mobile development skills ~95% of mobile app dev happens through Java and Kotlin
This chart illustrates the importance of assessing proficiency in both modern (Kotlin) and established (Java) codebases.

Streamlining Your Assessment Workflow

The integrated mobile emulator fundamentally transforms the assessment process. By eliminating the friction of fragmented toolchains and complex local setups, we enable a faster, more effective evaluation and a superior candidate experience.

Old Fragmented Way vs. The New, Integrated Way
Visualize the stark difference: Our streamlined workflow removes technical hurdles, allowing candidates to focus purely on demonstrating their coding and problem-solving abilities.

Quantifiable Impact on Hiring Success

A seamless and authentic assessment environment isn't just a convenience, it's a powerful catalyst for efficiency and better hiring outcomes. By removing technical barriers, candidates can focus entirely on demonstrating their skills, leading to faster submissions and higher-quality signals for your recruiters and hiring managers.

A Better Experience for Everyone

Our new features are meticulously designed to benefit the entire hiring ecosystem:

For Recruiters & Hiring Managers:

  • Accurately assess real-world development skills.
  • Gain deeper insights into candidate proficiency.
  • Hire with greater confidence and speed.
  • Reduce candidate drop-off from technical friction.

For Candidates:

  • Enjoy a seamless, efficient assessment experience.
  • No need to switch between different tools or manage complex setups.
  • Focus purely on showcasing skills, not environment configurations.
  • Work in a powerful, professional-grade IDE.

Unlock a New Era of Mobile Talent Assessment

Stop guessing and start hiring the best mobile developers with confidence. Explore how HackerEarth can transform your tech recruiting.

Vibe Coding: Shaping the Future of Software

A New Era of Code

Vibe coding is a new method of using natural language prompts and AI tools to generate code. I have seen firsthand that this change makes software more accessible to everyone. In the past, being able to produce functional code was a strong advantage for developers. Today, when code is produced quickly through AI, the true value lies in designing, refining, and optimizing systems. Our role now goes beyond writing code; we must also ensure that our systems remain efficient and reliable.

From Machine Language to Natural Language

I recall the early days when every line of code was written manually. We progressed from machine language to high-level programming, and now we are beginning to interact with our tools using natural language. This development does not only increase speed but also changes how we approach problem solving. Product managers can now create working demos in hours instead of weeks, and founders have a clearer way of pitching their ideas with functional prototypes. It is important for us to rethink our role as developers and focus on architecture and system design rather than simply on typing c

Vibe Coding Difference

The Promise and the Pitfalls

I have experienced both sides of vibe coding. In cases where the goal was to build a quick prototype or a simple internal tool, AI-generated code provided impressive results. Teams have been able to test new ideas and validate concepts much faster. However, when it comes to more complex systems that require careful planning and attention to detail, the output from AI can be problematic. I have seen situations where AI produces large volumes of code that become difficult to manage without significant human intervention.

AI-powered coding tools like GitHub Copilot and AWS’s Q Developer have demonstrated significant productivity gains. For instance, at the National Australia Bank, it’s reported that half of the production code is generated by Q Developer, allowing developers to focus on higher-level problem-solving . Similarly, platforms like Lovable or Hostinger Horizons enable non-coders to build viable tech businesses using natural language prompts, contributing to a shift where AI-generated code reduces the need for large engineering teams. However, there are challenges. AI-generated code can sometimes be verbose or lack the architectural discipline required for complex systems. While AI can rapidly produce prototypes or simple utilities, building large-scale systems still necessitates experienced engineers to refine and optimize the code.​

The Economic Impact

The democratization of code generation is altering the economic landscape of software development. As AI tools become more prevalent, the value of average coding skills may diminish, potentially affecting salaries for entry-level positions. Conversely, developers who excel in system design, architecture, and optimization are likely to see increased demand and compensation.​
Seizing the Opportunity

Vibe coding is most beneficial in areas such as rapid prototyping and building simple applications or internal tools. It frees up valuable time that we can then invest in higher-level tasks such as system architecture, security, and user experience. When used in the right context, AI becomes a helpful partner that accelerates the development process without replacing the need for skilled engineers.

This is revolutionizing our craft, much like the shift from machine language to assembly to high-level languages did in the past. AI can churn out code at lightning speed, but remember, “Any fool can write code that a computer can understand. Good programmers write code that humans can understand.” Use AI for rapid prototyping, but it’s your expertise that transforms raw output into robust, scalable software. By honing our skills in design and architecture, we ensure our work remains impactful and enduring. Let’s continue to learn, adapt, and build software that stands the test of time.​

Ready to streamline your recruitment process? Get a free demo to explore cutting-edge solutions and resources for your hiring needs.

Top Products

Explore HackerEarth’s top products for Hiring & Innovation

Discover powerful tools designed to streamline hiring, assess talent efficiently, and run seamless hackathons. Explore HackerEarth’s top products that help businesses innovate and grow.
Frame
Hackathons
Engage global developers through innovation
Arrow
Frame 2
Assessments
AI-driven advanced coding assessments
Arrow
Frame 3
FaceCode
Real-time code editor for effective coding interviews
Arrow
Frame 4
L & D
Tailored learning paths for continuous assessments
Arrow
Get A Free Demo