Lead Software Engineer (Data)-7999
Job Summary
Job Description
DUTIES: Provide technical leadership to a team responsible for developing data processing software using Apache Flink; design extract transform-load (ETL) data pipelines based on company’s proprietary ETL development library, using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow; store structured data using Hbase; develop business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting; develop streaming data pipelines using Apache Kafka; store data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM; automate tasks in a Unix environment using Linux Command Line Interface (“CLI”) and Bash scripting; support applications under development and customize current applications; assist with the software update process for existing applications, and roll-outs of software releases; analyze, test, and assist with the integration of new applications; document all development activity; research, write, and edit documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals, and formal recommendations and reports; monitor and evaluate competitive applications and products; review literature, patents, and current practices relevant to the solution of assigned projects; collaborate with project stakeholders to identify product and technical requirements; conduct analysis to determine integration needs; work with the Quality Assurance team to determine if applications fit specification and technical requirements; and guide and mentor junior-level engineers. Position is eligible to work remotely one or more days per week, per company policy.
REQUIREMENTS: Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related technical field, and seven (7) years of experience developing data processing software using Apache Flink; of which five (5) years of experience include designing extract transform-load (ETL) data pipelines using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow; storing structured data using Hbase; and developing business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting; of which three (3) years include developing streaming data pipelines using Apache Kafka; storing data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM; and automating tasks in a Unix environment using Linux Command Line Interface (“CLI”) and Bash scripting.
Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Skills
Apache Flink, Apache Kafka, HBaseWe believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools that are personalized to meet the needs of your reality—to help support you physically, financially and emotionally through the big milestones and in your everyday life.
Please visit the benefits summary on our careers site for more details.