Testing Lead-QA

Telradsol | Full time Testing Lead-QA Bangalore North, India | Posted on 07/14/2026 I'm interested Share job via email Share this job with your network Job listing Job details Job Information Industry Health Care Date Opened 07/14/2026 Job Type Full time Work Experience 4-5 years City Bangalore North State/Province Karnataka Country India Zip/Postal Code 560048 Job Description Job Title: Testing Lead – Deep Learning / LLM / VLMLocationRemote / Hybrid / On-siteExperience3–4 years (hands-on ownership in DL / LLM / GenAI testing)Employment TypeFull-timeRole OverviewWe are seeking a hands-on Testing Lead to own quality and documentation for our Deep Learning, LLM, and Vision-Language Model (VLM) products. You will define how we test, measure, document, and communicate AI quality—working closely with ML, Engineering, and Product teams in a fast-paced startup environment.This role is ideal for someone who believes clear documentation is as critical as good testing, especially for non-deterministic AI systems.What You’ll DoOwn Quality & Documentation End-to-EndDefine testing strategy for LLMs, VLMs, and DL pipelines.Create and maintain clear, lightweight documentation covering:Model testing strategies and assumptionsEvaluation metrics and acceptance criteriaKnown limitations, risks, and failure modesRelease readiness and quality sign-offEnsure documentation evolves with models, data, and prompts.LLM / GenAI TestingDesign tests for:Prompt templates and prompt changesRAG pipelines (retrieval quality, grounding, hallucination control)Multi-turn conversations and long-context behaviourMaintain golden datasets, regression test suites, and test result summaries.Document prompt behaviour, edge cases, and known model quirks.Vision & Multimodal TestingTest VLMs for image-text alignment, OCR, captioning, and reasoning.Document model performance across different image types, quality levels, and domains.Track and publish model behaviour changes between versions.Automation, MLOps & ReportingBuild Python-based automation for evaluation and regression testing.Integrate tests into CI/CD and MLOps pipelines.Produce readable quality reports and dashboards for engineers and leadership.Monitor and document production issues such as model/data drift and degradation.Build a Quality-First CultureEstablish QA and documentation standards that scale with a startup.Mentor engineers on writing testable code and meaningful documentation.Act as the single source of truth for AI quality, testing, and known risks.What we’re looking ForMust-HaveStrong background in software testing with lead or ownership experience.Hands-on experience testing LLMs, DL models, or GenAI systems.Strong Python skills for test automation and data validation.Proven ability to write clear, structured technical documentation.Understanding of:Transformer-based models and DL workflowsModel evaluation metrics and non-deterministic system testingComfortable working in ambiguity and moving fast in a startup.Nice-to-HaveExperience with VLMs, multimodal models, or computer vision.Exposure to RAG architectures, vector databases, and embeddings.Familiarity with tools like LangChain, LlamaIndex, MLflow, or similar.Experience documenting AI risks, limitations, or compliance requirements.  I'm interested