Databricks Data Engineer

Google Chrome Microsoft Edge Apple Safari Mozilla Firefox Databricks Data EngineerFull-timeTag: DATABRICKSCompany DescriptionHiflylabs is a Budapest-based company. We have 250+ employees at this moment and we are constantly thriving. Our application development team and business intelligence experts work to provide effective solutions to business problems.Our professional team has proved its expertise through 10 years of experience, participating in multiple Business Intelligence projects - both Hungarian and international - in various industries, such as the financial, telecommunication and energy sectors.We deliver a wide portfolio of innovative business solutions that include Data Warehouses, Business Intelligence, Data Analytics. In the last few years we have acquired a high level of competence in Application Development.Hiflylabs is committed to innovation, and encourages the realization of innovative initiatives in the form of independent startups.Get an insight on how we work and check out our Website, LinkedIn page and YouTube channel!Job DescriptionResponsibilitiesData Solution Design and DevelopmentDesign, develop, and implement complex, scalable Lakehouse solutions on the Databricks platform across major cloud environments (Azure, AWS, or GCP).Design, build, and optimize modular data pipelines using Delta Lake to ensure data efficiency, reliability, and quality.Implement data governance and secure data access layers utilizing Databricks Unity Catalog.Programming & ScriptingWrite clean, efficient, and maintainable SQL and Python code within Databricks Notebooks and IDEs.Develop automation scripts leveraging the Databricks CLI and REST APIs to manage workspace assets and configurations.DevOps & AutomationEstablish, maintain, and optimize CI/CD pipelines (e.g., GitHub Actions, GitLab CI/CD) leveraging Declarative Automation Bundles (DABs) as the primary mechanism for rapid, reliable, and software-defined project deployments.Automate and orchestrate data pipeline processes using Databricks Workflows or Spark Declarative Pipelines (formerly DLT) Cloud Data ServicesDeliver solutions centered on the Databricks ecosystem, integrating seamlessly with cloud-native storage and security services (e.g., AWS S3/IAM, Azure ADLS/Entra ID, or Google Cloud Storage/IAM).Design and implement modern data modeling and data warehousing solutions using Databricks SQL Warehouses.Project and Team ManagementOwn and manage the technical aspects of deliveries (at least at  component level).Participate in project planning, task estimation, testing, and liaising with business stakeholders.Create comprehensive technical documentation.QualificationsRequirementsProgramming & ScriptingMust have proficiency in both SQL and Python, emphasizing clean, efficient, and maintainable code optimized for cloud data platforms.Hands-on experience utilizing AI coding tools and agents (e.g., Databricks Assistant in Chat/Agent mode, GitHub Copilot, Cursor, or Claude Code) to augment programming workflows, generate boilerplate code, and resolve errors.Experience with API integration and scripting for platform automation.DevOps & AutomationHands-on experience using Declarative Automation Bundles (DABs) to manage, bundle, and deploy Databricks resources as code.Solid understanding of standard CI/CD tools (e.g., GitHub Actions, GitLab CI/CD) and version control (Git/Databricks Repos) to streamline development lifecycles.Cloud Data ServicesA 3-5 years of hands-on experience in data engineering, with a strong focus on Databricks Lakehouse architecture.Proven track record of delivering at least one complex, scalable data solution utilizing core Databricks features (Unity Catalog, Delta Lake, Databricks SQL).Strong experience operating Databricks within at least one major cloud environment (AWS, Azure, or GCP).Bonus Points if you have:Experience working with dbt (specifically dbt-databricks).Knowledge of Databricks AI/ML and GenAI capabilities (e.g.,...