Content Engineer, Meta Superintelligence Labs

**Summary:** Content Engineering is a horizontal function in the Muse Product Post Training org within Meta Superintelligence Labs (MSL) that shapes AI product experiences by aligning models to be helpful in new product experience through productizing prompt engineering, frontier evaluations, and quality frameworks. Sitting at the intersection of user experience and large-language model behavior, content engineers partner closely with research science, engineering, product and design teams to build and ship AI experiences from lab to production, across modalities and surfaces.Great Content Engineers have the aesthetic taste to notice what makes a model output great, the technical prompting expertise to align models to consistently provide great responses, experience at building auto-gradeable frontier evals for new capabilities, and the experience delivering high scale datasets via human annotators and synthetic data. This role goes beyond shaping how the model communicates — it owns the quality bar. This person defines what "great" looks like across product capabilities, builds the evaluation infrastructure (human and automated) to measure it, and runs the feedback loops that turn qualitative insight into model improvement. They operate as a cross-functional bridge between research science, engineering, product, and policy, translating user-facing quality problems into structured priorities and actionable fixes. They serve as a point of contact for internal stakeholders across AI on priority product and model initiatives, and aim to build experiences that entertain, inform, and delight. **Required Skills:** Content Engineer, Meta Superintelligence Labs Responsibilities: 1. Quality Definition & Frameworks: Define what "great" looks like for AI product capabilities — build guidelines, golden response sets, and frontier evals that set the quality bar across features and surfaces. Develop failure mode taxonomies that give engineering teams a structured, prioritized view of what's breaking and why. 2. Evaluation & Measurement: Own the full human evaluation pipeline — design rubrics, guide contractor annotator teams, build calibration processes, and deliver data analysis on results. Partner with Research Science to build and validate auto-judges aligned with human raters 3. define the methodology for measuring alignment drift. Construct and run large-scale evals to track quality metrics across product capabilities over time. 4. Testing & Iteration: Lead structured dogfooding and testing programs — design test plans targeting specific failure modes, run testing rounds, triage and categorize results, and deliver prioritized summaries to product and engineering. Operate at speed to unblock fast iteration — turn around quality assessments quickly enough to inform the current dev cycle, not the next one. Identify emerging quality issues before they reach external users. Craft and tune system prompts and agentic behavior to support product vision and model outcomes. 5. Cross-Functional Leadership: Serve as a key member of the cross-functional team across the product capabilities you work on— aligning engineering, research science, product, policy, and design on quality standards and priorities. Lead through influence and collaboration across teams 6. make quality legible and actionable for technical partners. 7. Agentic workflows: Leverage AI-native tools to replace manual workflows with scalable, repeatable processes across evaluation design, data analysis, visual development and cross-functional comms. Continuously evaluate and adopt emerging tools that allow the team to operate at speed. This is a role where experimentation is key, and a willingness to experiment, learn new tools, and build solutions hands-on is valued. **Minimum Qualifications:** Minimum Qualifications: 8. Bachelor's degree or equivalent experience with 5+ years of experience in digital content strategy, user experience, technical writing, journalism, production, or related fields 9. Experience designing and running human evaluation pipelines at scale — including annotator management, rubric design, golden set construction, and calibration 10. Experience translating ambiguous "it doesn't feel right" feedback into structured, objective, fixable categories 11. Experience defining and operationalizing subjective quality dimensions into measurable benchmarks 12. Experience running structured software testing/qa programs — designing test plans, triaging results, and delivering actionable analysis to engineering teams fast enough to matter in the current dev cycle 13. Experience making editorial and content quality decisions in a fast-paced environment, communicating complex technical concepts to cross-functional partners, and leading through influence across teams without direct reporting lines **Preferred Qualifications:** Preferred Qualifications: 14. Experience with AI-native tooling (LLM-based development tools, annotation platforms, prototyping environments) and a bias toward using them to move faster 15. Experience with LLM-as-judge development — building automated quality signals aligned with human judgment, and validating that alignment over time 16. Experience working with product teams or programs (or other equivalent fields) from roadmapping through delivery 17. Experience working in prompt engineering and agentic workflows **Public Compensation:** $162,000/year to $227,000/year + bonus + equity + benefits **Industry:** Internet **Equal Opportunity:** Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment. Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.