Research Scientist Intern, 3D Vision & World Simulation (PhD)

**Summary:** Reality Labs Research is seeking a Research Scientist Intern to help develop the next generation of assistance systems that guide users in contextual and adaptive environments. We welcome candidates with expertise in AI-driven 3D spatial understanding and generative modeling, building and iterating on deep learning systems, with specific experience at the intersection of generative AI (e.g., diffusion models), world simulation (predicting physics and future states), and 3D computer vision (reconstruction, camera geometry, depth estimation, motion/trajectory forecasting).Our internship is for Fall 2026 and is twelve (12) to twenty-four (24) weeks long. **Required Skills:** Research Scientist Intern, 3D Vision & World Simulation (PhD) Responsibilities: 1. Develop, implement, and evaluate methods for improving the performance and interpretability of VLMs and related AI/ML models. 2. Write modular, reusable research code and utilize Meta’s large infrastructure to scale experimentation. 3. Collaborate cross-functionally with researchers and engineers to prototype and test models at scale. 4. Deliver clear, compelling, and creative solutions to challenging problems. 5. Work should result in publishable research in top-tier journals or conferences (e.g., NeurIPS, ICLR, CVPR, ECCV, ICML, ICCV, AAAI, IJCAI, ICRA, IEEE T-PAMI, IJCV, IEEE RA-L etc.). 6. Design and develop generative AI models (e.g., diffusion models) to learn environment dynamics, predict future states, and simulate physical interactions within world modeling frameworks. 7. Build and advance 3D computer vision and reconstruction pipelines, leveraging camera geometry, depth estimation, and related techniques to create accurate representations of real-world environments. 8. Research and implement methods for 3D spatial understanding, including motion forecasting and trajectory prediction, to enable intelligent reasoning about how objects and agents move through space. **Minimum Qualifications:** Minimum Qualifications: 9. Currently has, or is in the process of obtaining, a PhD in Computer Science, Artificial Intelligence, Robotics, or related field 10. Strong programming proficiency in Python and extensive hands-on experience building, training, and debugging deep learning models using PyTorch 11. Experience with generative AI architectures (e.g., diffusion models) and world modeling concepts (e.g., learning environment dynamics, predicting future states, or simulating physical interactions) 12. Solid foundation in 3D computer vision and 3D reconstruction, including core concepts like camera geometry and depth estimation 13. Experience working with 3D spatial data, motion forecasting, or trajectory prediction **Preferred Qualifications:** Preferred Qualifications: 14. Practical experience with advanced generative frameworks, specifically flow-matching or Diffusion Transformers (DiTs) 15. Hands-on experience with modern 3D representations like 3D Gaussian Splatting (3DGS) and forecasting dense 3D point trajectories in physical world coordinates 16. Background in robotics planning and manipulation, with experience transferring learned representations to downstream tasks like closed-loop pick-and-place or real-world robot control 17. Familiarity with large Vision-Language Models (VLMs) and their application in object grounding, understanding natural language instructions, and processing multi-modal tokens 18. Knowledge of extending world models to physical applications, such as latent-action world models or trajectory-conditioned video generation 19. A proven track record of academic research, demonstrated by publications in top-tier conferences (e.g., CVPR, ICCV, ECCV, ICLR, NeurIPS, ICRA, RSS) in areas related to 3D vision, generative modeling, or robot learning **Public Compensation:** $7,650/month to $12,134/month + benefits **Industry:** Internet **Equal Opportunity:** Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment. Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.