Senior Software Engineer

November 8

Apply Now

Receive Emails with Similar Jobs

Twilio

WebsiteLinkedInAll Job Openings

telecommunications • API • cloud communications • SaaS • telephony

5001 - 10000 employees

Description

• Join the team as our next Senior Software Engineer - Profiles. • This position is needed to create high-quality, modern solutions to complex engineering problems. • Responsible for building and maintaining our data lake house architecture. • Your expertise in Spark and Scala will be essential in developing scalable solutions that meet the demands of our growing data landscape. • Design and develop robust, scalable data pipelines using Databricks, Apache Spark, and Delta Lake. • Optimize performance and scalability of data pipelines, ensuring high availability and reliability. • Monitor and troubleshoot data workflows and systems, providing timely resolutions to issues. • Stay current with industry trends and technologies to continuously improve our data architecture. • Build globally available and highly scalable distributed systems. • Participate in an on-call rotation to support our business-critical infrastructure.

Requirements

• 5+ years of experience in software engineering, with a focus on data engineering and lake house architecture. • Strong proficiency in Spark and Scala; experience with Databricks technologies is highly desirable. • Strong proficiency with cloud platforms (e.g., AWS, GCP) and data storage solutions (e.g., Delta Lake, Iceberg). • Solid understanding of ETL processes and data pipeline architecture. • Experience with SQL and data modeling; knowledge of NoSQL databases is a plus. • Fundamental understanding and experience with asynchronous architectures, their benefits and challenges including various broker implementations (Kafka, SQS, MQ) • Experience operating large-scale, distributed systems on top of cloud infrastructure such as Amazon Web Services (AWS) or Google Compute Platform (GCP) • Experience shipping services (products) following CI/CD development paradigm. • Excellent written and verbal communication skills.

Benefits

• Competitive pay • Generous time-off • Ample parental and wellness leave • Healthcare • Retirement savings program • Much more