Senior Data Engineer

3 days ago

Apply Now

Receive Emails with Similar Jobs

phData

WebsiteLinkedInAll Job Openings

Spark • Impala • Kafka • Kudu • Scala

201 - 500 employees

Founded 2014

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

💰 $2.5M Seed Round on 2018-03

Description

•Join phData, a dynamic and innovative leader in the modern data stack. •phData celebrates the culture of each of our team members and fosters a community of technological curiosity, ownership and trust. •We are proud to be an equal opportunity employer and prohibit discrimination and harassment of any kind based on race, color, religion, national origin, sex, sexual orientation, gender identity, age, veteran status, genetic information, disability, or other characteristics.

Requirements

•At least 4+ years experience as a Software Engineer, Data Engineer or Data Analyst •Ability to develop end-to-end technical solutions into production — and to help ensure performance, security, scalability, and robust data integration. •Programming expertise in Java, Python and/or Scala •Core cloud data platforms including Snowflake, AWS, Azure, Databricks and GCP •SQL and the ability to write, debug, and optimize SQL queries •Client-facing written and verbal communication skills and experience •Create and deliver detailed presentations •Detailed solution documentation (e.g. including POCS and roadmaps, sequence diagrams, class hierarchies, logical system views, etc.) •4-year Bachelor's degree in Computer Science or a related field •Prefer any of the following: Production experience in core data platforms: Snowflake, AWS, Azure, GCP, Hadoop, Databricks •Cloud and Distributed Data Storage: S3, ADLS, HDFS, GCS, Kudu, ElasticSearch/Solr, Cassandra or other NoSQL storage systems •Data integration technologies: Spark, Kafka, event/streaming, Streamsets, Matillion, Fivetran, NiFi, AWS Data Migration Services, Azure DataFactory, Informatica Intelligent Cloud Services (IICS), Google DataProc or other data integration technologies •Multiple data sources (e.g. queues, relational databases, files, search, API) •Complete software development lifecycle experience including design, documentation, implementation, testing, and deployment •Automated data transformation and data curation: dbt, Spark, Spark streaming, automated pipelines •Workflow Management and Orchestration: Airflow, AWS Managed Airflow, Luigi, NiFi

Benefits

•Remote-First Workplace •Medical Insurance for Self & Family •Medical Insurance for Parents •Term Life & Personal Accident •Wellness Allowance •Broadband Reimbursement •Continuous learning and growth opportunities to enhance your skills and expertise •Other benefits include paid certifications, professional development allowance, and bonuses for creating for company-approved content