Program Analyst Sr – Generative AI, Prompt Engineering & Validation

Skip to main contentOur CompanyOur BusinessSearch for JobsJoin Talent NetworkFAQsProfileEnglishSign InSingle PositionView All JobsProgram Analyst Sr – Generative AI, Prompt Engineering & ValidationBangalore, IndiaApply NowAdd to Job CartFind out how well you match with this jobUpload your resumeJob descriptionCompany and benefitsJob ID3093813Company:Qualcomm India Private LimitedJob Area:Operations Group, Operations Group > Program AnalystGeneral Summary:Assists with program development and implementation through managing processes, procedures, and tools that improve efficiencies. A Program Analyst coordinates across teams and monitors timelines, budgets, risks, and priorities to achieve program progress. Typically, a program needing a Program Analyst will be of significant size and will require expertise related to the development of project management mechanisms.Minimum Qualifications:• Associate's degree in Business Administration, Management, Computer Science, Engineering, Computer Science, or related field. ORHigh School Diploma or equivalent and 2+ years of relevant work experience.Job Title: Program Analyst Sr – Generative AI, Prompt Engineering & ValidationLocation: BangaloreExperience: 2–6 yearsEmployment Type: Full-timeAbout the RoleWe are looking for a proactive and detail-oriented Program Analyst to support Generative AI initiatives focused on prompt engineering, feature validation, test execution, output quality evaluation, and program tracking. The role will support internal GenAI platforms and tools, including search, summarization, RAG-based workflows, analytical agents, and domain-specific AI assistants.The ideal candidate should combine strong program coordination skills with a practical understanding of GenAI systems, structured prompt-based testing, multi-source data validation, and clear reporting for engineering and leadership stakeholders.Key Responsibilities1. GenAI Program Tracking & CoordinationTrack GenAI feature validation plans, deliverables, owners, dependencies, and closure status across teams.Maintain dashboards, trackers, action item logs, risk registers, and validation status reports.Coordinate with engineering, product, platform, and domain expert teams to drive timely completion of testing and feedback cycles.Consolidate weekly progress updates, blockers, risks, and recommendations for program reviews.Ensure validation documentation, prompt libraries, and issue logs are accurate, current, and accessible.2. Prompt Engineering & Prompt Test DesignCreate, refine, and maintain prompts for GenAI features, search workflows, summarization use cases, and analytical agents.Develop zero-shot, few-shot, role-based, multi-turn, edge-case, and negative test prompts.Build reusable prompt templates and feature-wise prompt libraries.Compare prompt variants and document impact on accuracy, relevance, completeness, consistency, and latency.Translate domain expert feedback into improved prompts and updated test scenarios.3. Feature Validation & Test ExecutionDesign and execute structured test cases for GenAI features, including functional, sanity, regression, negative, and exploratory testing.Validate end-to-end behavior from user prompt to retrieved context, generated response, and final output format.Map feature requirements to prompts, expected outputs, acceptance criteria, and validation evidence.Identify defects, usability gaps, hallucinations, incomplete answers, inconsistent responses, and low-confidence outputs.Support release readiness assessment using clear status indicators such as Go / Watch / Risk.4. Data, Search & RAG ValidationValidate AI outputs against structured, semi-structured, and unstructured data sources such as SharePoint, Confluence, Jira, documents, JSON/XML, and internal knowledge bases.Check search relevance, context quality, source completeness, and data freshness before summarization.Support validation of RAG-based workflows, semantic search, keyword search, global filters, and...