Senior Data Engineer

August 26

Apply Now

Receive Emails with Similar Jobs

SoHo Dragon

WebsiteLinkedInAll Job Openings

We are agile, independent, and hold a straightforward philosophy – that outstanding talent produces outstanding work.

Application Development • SharePoint • Business Intelligence Analysis • Recruiting • Azure

201 - 500

Description

• Integrate diverse data sources by designing and implementing scalable high performance data pipelines and infrastructure. • Build ETL processes using a variety of methods to facilitate efficient movement of data between systems. • Incorporate best practices to ensure data pipelines are robust and include error handling and alerting. • Design data models that turn complex organizational data into easy to use data structures ensuring seamless flow for Client's operational, analytics and reporting needs. • Use DBT or Snowflake native capabilities to transform data and ensure data is accurate and up to date. • Optimize data structures and queries to ensure efficient data storage and retrieval. • Implement and enforce data quality standards to ensure the accuracy and reliability of educational data used in academic assessments globally. • Collaborate with cross-functional teams, including analysts and business stakeholders, to understand unique data requirements for data processing or analytics needs. • Implement and maintain data security measures to protect sensitive information, ensuring compliance with international data privacy regulations. • Possess expertise in Snowflake for effective data warehousing, transformations, data sharing, and structured management in a cloud-based environment. • Create and maintain comprehensive documentation for data engineering processes, systems, and workflows. • Provide technical leadership and mentorship to junior members of the data engineering team, fostering a collaborative environment dedicated to excellence in handling educational data. • Utilize Tableau to deliver data insights using impactful visualizations in a meaningful and actionable manner.

Requirements

• Bachelor's or Master's Degree in Computer Science, Information Technology, or a related field, with a strong emphasis on Data related technologies. • Significant experience (usually 5+ years) in data engineering roles, with a focus on designing and implementing scalable data solutions. • Proficiency in programming languages such as Python, Java, or Scala. • Expertise in working with both SQL and NoSQL databases, with hands-on experience in database design and optimization. • Proficiency in Snowflake is required. • Knowledgeable of Machine Learning concepts and an interest to grow in the area. • Experience with cloud platforms like Azure, AWS, or Google Cloud Platform, and proficiency in leveraging cloud-based. • Knowledge of version control systems like Git or Azure DevOps for managing the codebase. • Strong analytical and problem-solving skills to address complex data engineering challenges specific to educational data. • Excellent communication skills to effectively collaborate with cross-functional teams and non-technical stakeholders. • Ability to adapt to evolving technologies and industry best practices in the field of data engineering.