Senior Data Engineer

Skip to main content Senior Data Engineer Aviso AI India Apply Senior Data Engineer Aviso AI India 5 hours ago Over 200 applicants See who Aviso AI has hired for this role Apply Save Report this job Direct message the job poster from Aviso AI Shweta Karad Shweta Karad Lead Recruiter at Aviso AI About the Role:We are looking for a data craftsman who thrives at the intersection of engineering, analytics, and operations. As a Data Engineer on our team, you will design and scale pipelines that transform raw information into business-ready insights. You’ll work across ecosystems like Python, Spark, Kubeflow, Jenkins, and GitHub to ensure our data platforms are reliable, secure, and future-ready.This is a hands-on role where you’ll build, automate, and optimize — not just keep the lights on. If you enjoy solving complex problems, designing scalable systems, and collaborating across teams, this role is for you.What You’ll Do:Engineer scalable data pipelines using Python and Spark, integrating structured and unstructured sources (MongoDB, SQL, APIs).Design and evolve Kubeflow workflows to automate and scale end-to-end data processes.Enhance team productivity by leveraging Jenkins for automation and GitHub for version control, branching, and peer collaboration.Debug and optimize workflows using logs and metrics from Splunk, ensuring resilience and performance.Work securely and efficiently by navigating bastion hosts and shell environments (including the Python interactive shell) for quick experimentation and fixes.Collaborate across teams to ensure that data solutions are clean, reliable, and aligned with business needs.Optimize at scale — tune Spark jobs, SQL queries, and schema designs for high-performance data systems.Develop with modern tools — whether PyCharm, VS Code, or CLI, bring your best workflow to the team.What You Bring: Strong experience building ETL/ELT pipelines in Python and Spark.Proficiency in MongoDB and SQL, with a focus on performance tuning and complex transformations.Knowledge of data modeling, governance, and lineage best practices.Experience with cloud platforms (AWS, GCP, or Azure) and modern data stacks (Snowflake, data lakes).Familiarity with streaming frameworks like Kafka or Spark Streaming.Bonus points for: Designing or scaling workflows with Kubeflow.Using Jenkins for workflow automation and orchestration.Leveraging Splunk for troubleshooting and performance tuning.Hands-on work with bastion hosts, shell scripting, and interactive Python shells. ○ Collaborating via GitHub (branching strategies, pull requests, CI/CD).Experience with Python IDEs like PyCharm or VS Code. Show more Show less Seniority level Mid-Senior level Employment type Full-time Job function Information Technology and Engineering Industries Software Development Referrals increase your chances of interviewing at Aviso AI by 2x See who you know Get notified about new Senior Data Engineer jobs in India. Sign in to create job alert Similar jobs ...