Senior Data Engineer

June 26

Apply Now

Receive Emails with Similar Jobs

Sand Technologies

WebsiteLinkedInAll Job Openings

A global tech-services and talent-solutions company with expertise in industrial AI, data science, software, and more.

501 - 1000

Description

• A Senior Data Engineer, has the primary role of designing, building, and maintaining scalable data pipelines and infrastructure to support data-intensive applications and analytics solutions. • Lead the design, implement, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of data from various sources using tools such as databricks, python, and pyspark. • Architect scalable and efficient data solutions using the appropriate architecture design, opting for modern architectures where possible. • Design and optimize data models and schemas for efficient storage, retrieval, and analysis of structured and unstructured data. • Develop, optimize and automate ETL workflows to extract data from diverse sources, transform it into usable formats, and load it into data warehouses, data lakes or lakehouses. • Utilize big data technologies such as Spark, Kafka, and Flink for distributed data processing and analytics.

Requirements

• Proven experience as a Senior Data Engineer, or in a similar role, with hands-on experience building and optimizing data pipelines and infrastructure, and designing data architectures. • Proven experience working with Big Data and tools used to process Big Data • Strong problem-solving and analytical skills with the ability to diagnose and resolve complex data-related issues. • Excellent understanding of data engineering principles and practices. • Excellent communication and collaboration skills to work effectively in cross-functional teams and communicate technical concepts to non-technical stakeholders. • Ability to adapt to new technologies, tools, and methodologies in a dynamic and fast-paced environment. • Ability to write clean, scalable, robust code using python or similar programming languages. Background in software engineering a plus. • Knowledge of data governance frameworks and practices. • Understanding of machine learning workflows and how to support them with robust data pipelines.

Benefits

• 11 paid holidays • Generous Accrued Time Off increasing with years of service • Generous paid sick time • Annual day of service