This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Sr. Data Engineer based in India.
We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms that support analytics, AI/ML initiatives, and enterprise reporting.
This role offers the opportunity to take ownership of modern cloud data ecosystems and develop production-grade pipelines in a fast-growing technology environment.
You will work across data engineering, product, analytics, and machine learning teams to transform complex data challenges into reliable solutions.
The ideal candidate is a hands-on expert in AWS and modern cloud data platforms, with strong experience in Snowflake or Databricks.
You will play a key role in improving data quality, enabling real-time insights, and building foundations for innovative AI-driven capabilities.
This position combines technical leadership, engineering excellence, and autonomy within a remote-first, globally collaborative environment.
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Sr. Data Engineer based in India.
We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms that support analytics, AI/ML initiatives, and enterprise reporting.
This role offers the opportunity to take ownership of modern cloud data ecosystems and develop production-grade pipelines in a fast-growing technology environment.
You will work across data engineering, product, analytics, and machine learning teams to transform complex data challenges into reliable solutions.
The ideal candidate is a hands-on expert in AWS and modern cloud data platforms, with strong experience in Snowflake or Databricks.
You will play a key role in improving data quality, enabling real-time insights, and building foundations for innovative AI-driven capabilities.
This position combines technical leadership, engineering excellence, and autonomy within a remote-first, globally collaborative environment.
Accountabilities:
- Build, optimize, and maintain complex data pipelines using AWS Glue, Step Functions, Databricks Workflows, and related technologies.
- Design scalable data architectures using advanced modeling approaches such as Medallion Architecture and Dimensional Modeling.
- Manage cloud-based data storage solutions using AWS S3 and optimize formats such as Delta, Iceberg, and Parquet for efficient processing.
- Develop real-time ingestion and streaming solutions using technologies such as AWS Kinesis and Kafka.
- Implement Change Data Capture (CDC) solutions using tools such as Debezium or Fivetran to support low-latency analytics.
- Own data quality and validation processes by integrating automated testing, monitoring, and observability into ETL/ELT workflows.
- Establish data contracts, schema evolution practices, and proactive alerting mechanisms to maintain trusted data assets.
- Build ML-ready datasets and support machine learning workflows through feature engineering and operationalization.
- Collaborate with Product, Engineering, Analytics, and ML teams to translate technical requirements into scalable solutions.
- Mentor junior engineers and promote best practices in SQL optimization, Python development, documentation, and engineering discipline.
- 6–8+ years of experience in data engineering, with a focus on large-scale distributed systems and production data environments.
- Expert-level proficiency in Python, PySpark, and strong SQL skills.
- Hands-on experience building data solutions using Snowflake or Databricks within an AWS ecosystem.
- Proven experience developing streaming applications using AWS Kinesis, Kafka, or similar technologies.
- Strong knowledge of data modeling, data lake architectures, ETL/ELT processes, and cloud-native engineering practices.
- Experience implementing automated data validation frameworks, profiling solutions, and pipeline quality controls.
- Familiarity with ML data workflows, feature stores, and AI/ML platform integrations is a plus.
- Strong documentation skills with experience creating technical specifications, playbooks, and operational guidelines.
- Excellent communication skills with the ability to explain complex technical concepts to both technical and non-technical stakeholders.
- Ownership mindset with a focus on quality, maintainability, performance, and continuous improvement.
- Relevant certifications such as SnowPro Core, Databricks Certified Data Engineer Professional, or AWS Certified Data Engineer are considered a plus.
- Competitive compensation package of 4,200,000 INR annually.
- Fully remote work environment with flexibility and autonomy.
- Opportunity to build and scale modern data foundations supporting analytics, AI, and product innovation.
- Collaboration with global teams across Data, Product, Engineering, Analytics, and business functions.
- High-impact role contributing to measurable business outcomes through trusted data solutions.
- Culture focused on accountability, ownership, innovation, and engineering excellence.
- Flexible working hours with dedicated collaboration time aligned with U.S.-based teams.
The Senior Data Engineer will be responsible for designing, developing, and maintaining robust data infrastructure while ensuring scalability, reliability, and performance across data systems. The role requires strong ownership of data pipelines, cloud architecture, and engineering best practices.
Requirements:
The ideal candidate brings extensive experience in data engineering, cloud technologies, and distributed systems, along with the ability to collaborate effectively across technical and business teams.