Senior GCP Data Engineer

16 hours ago

Apply Now

Receive Emails with Similar Jobs

Xebia Poland

WebsiteLinkedInAll Job Openings

Software Development • Agile Development • DevOps • Scrum • Mobile Applications

1001 - 5000 employees

Founded 2001

🤖 Artificial Intelligence

☁️ SaaS

Description

• Work closely with engineering, product, and data teams to deliver scalable and robust data solutions • Designing, building, and maintaining data platforms and pipelines • Mentoring new engineers • Working with various clients globally, delivering software systems and best practices for scalable and robust solutions • Engineering data platforms for scale, performance, reliability, and security • Integrating data sources and optimizing data processing • Proactively addressing challenges, resolving blockers, and driving effective communication across distributed teams • Continuously seeking opportunities to enhance data systems and ensuring alignment with evolving business needs.

Requirements

• 5+ years in a senior developer role • hands-on experience in building data processing pipelines • proficiency with GCP services, especially BigQuery and BigQuery SQL • extensive experience with Apache Airflow, including DAG creation, triggers, and workflow optimization • knowledge of data partitioning, batch configuration, and performance tuning for terabyte-scale processing • strong Python proficiency, with expertise in modern data libraries and frameworks (e.g., Databricks, Snowflake, Spark, SQL) • experience with unit testing, pre-commit checks, and strict type enforcement for data pipelines • deep understanding of relational and NoSQL databases, data modelling, and data warehousing concepts • excellent command of oral and written English • Nice to have: expertise in optimizing BigQuery performance using tools like Query Profiler and addressing compute resource bottlenecks • prior experience developing or testing custom operators in Apache Airflow • familiarity with Docker, Kubernetes, Helm, Terraform, Kafka, and CI/CD pipelines for data environments.