This role is for one of the Weekday's clients
Salary range: Rs 1300000 - Rs 2600000 (ie INR 13-26 LPA)
Experience: 5+ yrs
Location: Pune, Maharashtra, India
Job Type: Full-Time
We are seeking an experienced Azure Databricks Engineer to design, develop, and optimize scalable cloud-based data engineering solutions. This role is ideal for professionals with strong expertise in Azure Databricks, SQL, and ETL development, who are passionate about building high-performance data pipelines and enabling data-driven business decisions.
As an Azure Databricks Engineer, you will work closely with data architects, analysts, and cross-functional teams to develop robust ETL workflows, optimize data processing, and ensure reliable data availability for analytics and reporting. You will play a key role in modernizing data platforms, improving pipeline performance, and implementing best practices for cloud-based data engineering.
Requirements
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and cloud-native technologies.
- Build and optimize data ingestion, transformation, and processing workflows for structured and semi-structured data.
- Develop complex SQL queries, stored procedures, and data transformation logic to support reporting and analytics.
- Collaborate with business stakeholders, data architects, and analytics teams to understand data requirements and deliver scalable solutions.
- Optimize Azure Databricks workloads for performance, scalability, and cost efficiency.
- Implement data quality checks, validation processes, and monitoring to ensure data accuracy and reliability.
- Troubleshoot data pipeline failures, resolve performance bottlenecks, and support production environments.
- Integrate data from multiple sources while ensuring consistency, governance, and security standards.
- Participate in data modeling, documentation, and continuous improvement initiatives across the data platform.
- Follow best practices for version control, deployment, testing, and cloud-based data engineering.
What Makes You a Great Fit
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Strong hands-on experience with Azure Databricks, SQL, and ETL development.
- Experience designing and developing cloud-based data pipelines and large-scale data processing solutions.
- Proficiency in writing and optimizing complex SQL queries for high-performance data processing.
- Strong understanding of data warehousing concepts, data modeling, and ETL/ELT best practices.
- Experience working with Azure cloud services and modern data engineering architectures.
- Knowledge of data integration, workflow orchestration, and cloud storage solutions.
- Strong analytical, troubleshooting, and performance optimization skills.
- Experience implementing data quality, governance, and security best practices.
- Excellent communication and collaboration skills with the ability to work effectively across cross-functional teams.
- A proactive mindset with a passion for building scalable, reliable, and efficient cloud data solutions while continuously improving engineering processes.