Data Engineer

3 days ago

Apply Now

Receive Emails with Similar Jobs

Roofstock

WebsiteLinkedInAll Job Openings

Real Estate Investing • Technology • Rental Properties • Online Marketplace • Investment Properties

501 - 1000

Description

• Improve and maintain the data services platform. • Deliver high-quality data services promptly, ensuring data governance and integrity while meeting objectives and maintaining SLAs for data sharing across multiple products. • Develop effective architectures and produce key code components that contribute to the design, implementation, and maintenance of technical solutions. • Integrating a diverse network of third-party tools into a cohesive, scalable platform, optimizing code for enhanced scalability, performance, and readability. • Continuously improving system performance and reliability by diagnosing and resolving unexpected operational issues to prevent recurrence. • Ensuring that your team’s work undergoes rigorous testing through repeatable, automated methods. • Support data infrastructure and rest of the data team who designs, implements and deploys, scalable, fault-tolerant pipelines that ingest, and refine large diverse (structured, semi-structured and unstructured datasets) into simplified accessible data models in production • Collaborate with cross-functional teams to understand data flows and design, build and test optimal solutions for engineering challenges. • Operate within an Agile/Scrum framework, working closely with Product and Engineering teams to deliver value across multiple services and products. • Influence and shape the enterprise data platform and services roadmap, architecture, and design standards. Collaborate with technology leaders and team members to design, adapt, and enhance the architecture to meet evolving business needs.

Requirements

• BS or MS in a technical field: computer science, engineering or similar • 5+ years technical experience working with data • 5+ strong experience building scalable data services and applications using either SQL, Python, Java / Kotlin, with the interest and aim to learn additional tools and technologies. • Deep understanding of microservices architecture and RESTful API development including gRPC, REST/SOAP, GraphQL • Experience with AWS services including Messaging such as SQS, SNS, and familiarity with real-time data processing frameworks such as Apache Kafka or AWS Kinesis. • Significant experience building and deploying data-related infrastructure, robust data pipelines (beyond simple API pulls) & ETL/ELT code encompassing messaging, storage, compute, transformation, execution. • Strong understanding of data architecture and related problems • Experience working on complex problems and distributed systems where scalability and performance are extremely important (every millisecond counts) • Experience in identifying and proposing initiatives aimed at enhancing the performance and efficiency of existing systems, setting the standard for SLAs & SLOs. • Strong communication and interpersonal skills • Should be independent and able to effectively work with cross functional teams • Experience managing a team or experience working with an on-shore/off-shore model is a plus