Nitin Kumar
@tiwari28nitin_caavj
AI QA Engineerat IBM
Open to work34 followers·10 following
AI QA Engineer with 10 years of experience in QA Automation and 2 years of hands-on experience in Generative AI, LLM and AI application testing. Experienced in designing and executing AI quality strategies covering LLM evaluation, RAG testing, prompt testing, hallucination detection, response validation, responsible AI and AI regression testing. Strong expertise in UI and API automation using Playwright, TypeScript, Java, Selenium and Python, with experience in Page Object Model, automation framework design, CI/CD, Git, Jenkins and GitLab. Hands-on understanding of RAG architecture, embeddings, vector databases, chunking, retrieval evaluation, Context Precision, Context Recall, Faithfulness, Answer Relevancy and LLM-as-a-Judge. Experienced in AI evaluation using Golden Datasets, automated evaluation metrics, model/prompt comparison and regression testing. Familiar with DeepEval, RAGAS, LangSmith and AI testing approaches for prompt injection, jailbreaks, bias, safety, PII leakage and
Bangalore India
Joined Sep 18, 2026
