Principal Data Engineer

Google Chrome Microsoft Edge Apple Safari Mozilla Firefox Principal Data EngineerFull-timeCareer Site Team: Technology Compensation: MXN 80000 - MXN 94000 - monthlyCompany DescriptionNielsenIQ (NIQ) is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior. With operations in more than 90 countries, NIQ provides manufacturers and retailers with accurate, actionable insights to innovate and grow.Job DescriptionNIQ is looking for a Senior Data Platform Engineer to join our Financial Services Engineering team.At NIQ, the Financial Services team uses alternative datasets to help global public equity investors (hedge funds, mutual funds, pension funds) make better investment decisions. We work with some of the largest hedge funds in the world. As a Principal Data Platform Engineer, you will be at the cutting edge of the alternative data space where you will help maintain and improve our data platform, which enables us to develop market research products and delivery data to our customers. In this role, you would also get the opportunity to work with world-class big data and cloud services, such as: AWS, Azure, Snowflake, Databricks, DBT, Airflow, and Looker. Apply now to start taking your career to the next level.Who we are looking for:You have a strong entrepreneurial spirit and a thirst to solve difficult challenges through innovation and creativity with a strong focus on resultsYou have a passion for data and the insights it can deliverYou are intellectually curious with a broad range of interests and hobbiesYou take ownership of your deliverablesYou have excellent analytical communication and interpersonal skillsYou have excellent communication skills with both technical and non-technical audiencesYou can work with distributed teams situated globally in different geographiesYou want to work in a small team with a start-up mentalityYou can work well under pressure, prioritize work and be well organized. Relish tackling new challenges, paying attention to details, and, ultimately, growing professionally.Responsibilities:Design, develop, and maintain robust and scalable data pipelines that support the extraction, transformation, and loading of data from various sources into our data platform.Build and extend our automation tools for infrastructure provisioning, auto-scaling, code deployment, monitoring, alerting, reporting, and failover.Collaborate with the engineering team to build and maintain a resilient data platform, ensuring high availability, reliability, and performance.Leverage your expertise in Apache Airflow to orchestrate and manage complex ETL workflows efficiently.Optimize data pipeline performance, troubleshoot issues, and ensure data quality and accuracy through monitoring, testing, and validation.Keep up to date with the latest trends in data engineering and evaluate and introduce new technologies and tools to improve our data infrastructure.Drive the design and implementation of data security and access control policies to protect sensitive information.Collaborate with the DevOps team to ensure seamless deployment and monitoring of data pipelines and workflows.QualificationsBachelor's or Master's degree in Computer Science, Data Engineering, or a related field.7+ years of experience as a Data Engineer with a strong background in ETL processes and data warehousing.4+ years of experience with Apache Airflow for orchestrating data pipelines.Proficiency in using ETL tools and frameworks such as Apache Spark, Matillion.Strong software engineering fundamentals, including proficiency in Python, Java, or other relevant languages.Knowledge of data modeling, data warehousing, and SQL.Expertise in working with both structured and unstructured data.Experience with cloud-based data solutions, such as AWS, GCP, or Azure.Solid understanding of data storage, data transformation, and data integration concepts.Excellent problem-solving skills...