Nitin Kumar

@tiwari28nitin_caavj

AI QA Engineerat IBM

Open to work

34 followers·10 following

AI QA Engineer with 10 years of experience in QA Automation and 2 years of hands-on experience in Generative AI, LLM and AI application testing. Experienced in designing and executing AI quality strategies covering LLM evaluation, RAG testing, prompt testing, hallucination detection, response validation, responsible AI and AI regression testing. Strong expertise in UI and API automation using Playwright, TypeScript, Java, Selenium and Python, with experience in Page Object Model, automation framework design, CI/CD, Git, Jenkins and GitLab. Hands-on understanding of RAG architecture, embeddings, vector databases, chunking, retrieval evaluation, Context Precision, Context Recall, Faithfulness, Answer Relevancy and LLM-as-a-Judge. Experienced in AI evaluation using Golden Datasets, automated evaluation metrics, model/prompt comparison and regression testing. Familiar with DeepEval, RAGAS, LangSmith and AI testing approaches for prompt injection, jailbreaks, bias, safety, PII leakage and

Bangalore India

Joined Sep 18, 2026

Level

Bug Squasher

463 XP · 37 to Lv 3

Reputation

Streak

Followers

Following

Reputation breakdown

testathon+10

Total10

Overview Badges3 Activity Followers34 Following10

Recent activity

View all

Quiz: RAG Evaluation

just now

+48 XP

Quiz: Agentic Testing Workflows (18-09-26)

just now

+80 XP

ISTQB Foundation Level Certification

just now

+10 XP

Claude Certified Developer-Foundations

just now

+10 XP

Badges

In the Arena

Complete Profile

Welcome Aboard

Skills & Endorsements

Agentic AI

—

Playwright

—

Playwright MCP

—

Python

—

RAG

—

RAGAS

—

ScaleAI

—

Selenium

—

TypeScript

—

PARITY

—

LLM-as-a-judge Evals

—

API

—

BIAS

—

GenAI

—

Hallucination

—

Java

—

javascript

—

langchain

—

LangGraph

—

Vector DB

—

Certifications

Anthropic Claude Certified Architect-Professional

Anthropic

Claude Certified Developer-Foundations

Anthropic

ISTQB Foundation Level Certification

ISTQB