Role responsibilities
The AI Data Engineer will design, develop, and maintain scalable ETL/ELT pipelines and data platforms for advanced analytics and AI solutions. Responsibilities include integrating AI/ML capabilities and ensuring data quality within enterprise data ecosystems.
Requirements
Candidates should have over 15 years of experience in data engineering, with strong technical skills in Python, SQL, and various data technologies. Familiarity with machine learning fundamentals and AI integration is also required.
Key skills
Python, SQL, PySpark, ETL/ELT Development, Data Modeling, Apache Spark, Databricks, Airflow, Dataflow, Informatica, ADF, Synapse, Relational Databases, NoSQL Databases, Machine Learning, Vector Databases
Keywords
AI, Data Engineer, Data Platforms, Advanced Analytics, Machine Learning, Generative AI, Data Pipelines, Data Lakes, Data Warehouses, Cloud-native Technologies, Data Governance, Data Quality, Large Language Models, Vector Databases, RAG Architecture, Embeddings, Semantic Search, Prompt Engineering, ETL, ELT, Apache Spark, Databricks, Airflow, Informatica, ADF, Synapse, Relational Databases, NoSQL Databases, REST APIs, Microservices