Data Pipeline Operations Engineer
December 3
Description
• We are seeking a detail-oriented and technically skilled Data Pipeline Operations Engineer to manage and execute our weekly scanning process. • This critical role ensures the timely flow of customer data through our research, scanning, and UI ingest pipeline. • SixMap is the leading Automated Cyber Defense Platform for continuous threat exposure management (CTEM). • The platform identifies vulnerabilities, correlates threat intelligence, and provides actionable insights to defend against imminent threats.
Requirements
• Strong Linux command line skills • Experience with Airflow or similar workflow orchestration tools • Python programming proficiency • Advanced SQL knowledge for data ingest, refresh, and validation • Ability to diagnose and resolve issues with long-running batch processes • Excellent attention to detail and problem-solving skills • Good communication to coordinate with other teams • Flexibility to handle off-hours work when needed to meet SLAs • Familiarity with network scanning tools and methodologies • Experience optimizing database performance • Scripting skills to automate routine tasks • Understanding of common network protocols and services • Knowledge of AWS services like EC2
Benefits
• Competitive compensation packages; including equity • Employer paid medical, dental, vision, disability & life insurance • 401(k) plans • Flexible Spending Accounts (health & dependents) • Unlimited PTO • Remote Working Options
Apply NowSimilar Jobs
November 30
Join HALO as a Data Engineer to design and maintain data integrations for our enterprise warehouse.
🇺🇸 United States – Remote
💵 $90k - $130k / year
💰 Private Equity Round on 2016-01
⏰ Full Time
🟡 Mid-level
🟠 Senior
🚰 Data Engineer
🦅 H1B Visa Sponsor
November 28
As a Data Engineer, you will support data ingestion and analytics for mission partners. Build solutions in a cloud environment while ensuring data transfer security.
November 27
WRS Health
201 - 500
Join WRS Health as a Data Architect. Build data infrastructure and transform data into insights.
November 26
Join CVS Health as a data engineer to develop data infrastructure for advanced analytics.
November 24
Join NPM as a Clinical Data Engineer, advancing cancer care through impactful data engineering. Contribute to curating data for clinical trials in an innovative healthcare environment.