Lead Data Engineer

Skip to main content Lead Data Engineer hackajob Swansea, Wales, United Kingdom Apply Join or sign in to find your next job Join to apply for the Lead Data Engineer role at hackajob Email or phone Password Show Forgot password? Sign in Sign in with Email or New to LinkedIn? Join now By clicking Continue to join or sign in, you agree to LinkedIn’s User Agreement, Privacy Policy, and Cookie Policy. Lead Data Engineer hackajob Swansea, Wales, United Kingdom 6 days ago Be among the first 25 applicants See who hackajob has hired for this role Apply Join or sign in to find your next job Join to apply for the Lead Data Engineer role at hackajob Email or phone Password Show Forgot password? Sign in Sign in with Email or New to LinkedIn? Join now By clicking Continue to join or sign in, you agree to LinkedIn’s User Agreement, Privacy Policy, and Cookie Policy. Save Report this job hackajob is collaborating with Made Tech to connect them with exceptional professionals for this role.DescriptionAs a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage.Key ResponsibilitiesDefine, shape and perfect data strategies in central and local government.Help public sector teams understand the value of their data, and make the most of it.Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP.As employee growth is a huge focus here, we would expect you to contribute to our recruitment efforts and take on line management responsibilities.Skills, Knowledge & ExpertiseWe are looking for candidates with a range of skills and experience, please apply even if you don’t meet all the criteria as if unsuccessful we can provide you with feedback.Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies.Strong experience in IaC and able to guide how one could deploy infrastructure into different environments.Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop.Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines.You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines.Able to document and present end-to-end diagrams to explain a data processing system on a cloud...