Senior Data Engineer — Data Platform

Cyera   All Jobs Senior Data Engineer — Data Platform R&D Tel Aviv Full-time Description About CyeraCome join the company building the security operating model for the age of AI. AI has changed how data is used — and security must change with it. Cyera's mission is to empower businesses to accelerate AI adoption by defining a holistic approach to securing AI — from data to access to model. Instead of perimeter controls and static policies, Cyera provides a unified control plane that understands relationships between data, access, and behaviors across humans, systems, and AI. Backed by the world's leading investors and working with a large and growing list of Fortune 1000 companies, we are looking for world-class talent to join us as we usher in the new era of data and AI security.About the RoleWe're looking for a Senior Data Engineer to help build Cyera's next-generation data platform — the lakehouse foundation that will power data processing across the entire product. This is not a "write pipelines on top of someone else's platform" role, and it's not a pure infrastructure role either. It's both, deliberately.You'll own the platform end to end: the infrastructure it runs on (Spark on Kubernetes, Apache Iceberg, AWS Glue, Airflow), the frameworks and tooling that let dozens of other engineers build on it without reinventing the wheel, and the design of the data pipelines themselves. Everything you build becomes leverage for the teams around you — your abstractions, base images, CI/CD flows, and operational patterns are what make the platform usable at scale.You'll also own one of the hardest ongoing trade-offs in a high-scale data platform: balancing cost and performance. Compute sizing, storage layout, partitioning and compaction strategy, job scheduling — every decision has a price tag and a latency profile, and you'll be the one making those calls with data.This role is ideal for an engineer who is equally comfortable debugging a Spark executor OOM on Kubernetes at 10am, designing a clean Python framework API at noon, and modeling the cost impact of a table layout change in the afternoon.What You'll DoPlatform & Infrastructure- Design, deploy, and operate our Spark-on-Kubernetes compute platform, including autoscaling, resource tuning, and multi-tenancy considerations.- Own the lakehouse storage layer built on Apache Iceberg and AWS Glue catalog — table design, partitioning, compaction, schema evolution, and retention.- Build and operate orchestration on Airflow: DAG standards, deployment flows, environment promotion, and reliability.- Own production operations of the platform: monitoring, alerting, incident response, and continuous hardening.Frameworks & Developer Enablement- Build the code frameworks, libraries, and templates that other engineers use to write pipelines — so that spinning up a new production-grade Spark job is measured in hours, not weeks.- Define and enforce standards for pipeline structure, testing, observability, and deployment across teams.- Own CI/CD for data workloads: image builds, artifact promotion, and GitOps-based delivery.- Act as a technical partner to product and research teams building on the platform — your customers are other engineers.Data Pipelines & Architecture- Design and build scalable batch and streaming pipelines processing complex, high-volume datasets from diverse sources.- Lead large-scale backfills and migration initiatives, ensuring data consistency and integrity across evolving storage and compute platforms.- Design event-driven data flows over large-scale queue systems (Kafka) for reliable, efficient data movement.Cost & Performance- Continuously balance cost against performance: right-size compute, tune queries and jobs, optimize storage layout and file sizes, and choose the correct engine for each workload.- Build cost visibility and attribution into the platform so...