Data Engineer

October 17

Apply Now

Receive Emails with Similar Jobs

Shuvel

WebsiteLinkedInAll Job Openings

11 - 50 employees

🌐 Web 3

🔌 API

☁️ SaaS

Description

• U.S. Customs and Border Protection (CBP) oversees the flow of people and products. • Develop complex data analytical solutions for risk assessment of potential threats. • Design, develop, and maintain scalable data pipelines and architectures. • Utilize SQL for complex data transformations and optimize queries. • Build comprehensive datasets from various relational databases. • Collaborate with cross-functional teams to understand and translate requirements. • Assist with data migration to cloud/non-relational storage. • Leverage Apache Spark for large data processing. • Transform large datasets for analytical products and reports. • Troubleshoot data-related issues and ensure integrity and accuracy. • Implement best practices for data governance, security, and quality. • Manage data engineering source code control using GitLab.

Requirements

• Experience with relational databases and knowledge of query tools and/or BI tools like Power BI or OBIEE and data analysis tools. • Extensive experience with SQL and proficiency in writing complex queries. • Solid understanding of data warehousing concepts and platforms such as Oracle and cloud-based solutions. • Strong experience in automating ETL jobs via UNIX/LINUX shell scripts and CRON jobs. • Demonstrate a strong practical understanding of data warehousing from a production relational database environment. • Strong experience using analytic functions within Oracle or similar tools within non-relational (MongoDB, Cassandra etc.) database systems. • Strong understanding of distributed computing principles and experience with frameworks like Apache Spark. • Hands-on-experience with data lake architectures and technologies in a cloud environment. • Experience with Atlassian suite of tools such as Jira and Confluence. • Knowledge of Continuous Integration & Continuous Development tools (CI/CD). • Must be able to multitask efficiently and progressively and work comfortably in an ever-changing data environment. • Must work well in a team environment as well as independently. • Excellent verbal/written communication and problem-solving skills; ability to communicate information to a variety of groups at different technical skill levels.