Data Engineer

March 18

🐊 Florida – Remote

Although this job is listed in Florida, this company may be open to hiring remote in other states.

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

🦅 H1B Visa Sponsor

Apply Now

Receive Emails with Similar Jobs

MAS Global Consulting

WebsiteLinkedInAll Job Openings

MAS Global Consulting is a consulting firm specializing in agile software development, cloud solutions, data solutions, and AI technologies. The company provides services such as legacy modernization, data visualization, and cloud migration to midsize to Fortune 1000 global brands. They are known for their nearshore development model, which offers clients strategic advantages such as matched time zones and flexible scaling. As a Latina-owned business, MAS Global is committed to innovation, inclusion, and community impact through initiatives like scholarships and bootcamps for women and Latinx in technology. With high-caliber engineering and advisory teams, they focus on delivering technology transformations that meet clients' evolving needs.

Nearshore services (From Colombia to North America) • Custom software development • Microsoft technologies • Agile Methodologies • DevOps

201 - 500 employees

☁️ SaaS

📋 Description

• Design, develop, and manage scalable data pipelines using advanced technologies like Java, Apache Spark, and AWS to process large-scale data and ensure seamless data integration and transformation. • Optimize job execution and performance for both real-time and batch data workflows, ensuring efficient processing and minimal downtime. • Troubleshoot and resolve production issues to maintain system reliability and performance across platforms. • Implement and manage event-driven architectures using AWS services (SNS, SQS, Lambda, EventBridge) to deliver processed data to downstream applications. • Perform advanced data validation, reconciliation checks, and error tracking mechanisms to ensure data accuracy, integrity, and security. • Develop complex SQL queries for data manipulation, including deduplication, filtering, and encryption to secure sensitive financial data. • Collaborate with cross-functional teams to design and deliver data-driven solutions that meet business needs and align with organizational goals. • Manage AWS resources and deploy infrastructure-as-code using Terraform to maintain consistent environments across development, staging, and production. • Maintain and manage operational storage in Cassandra DB and Hive tables for large-scale querying and error logging. • Develop and maintain automated workflows using Shell scripts, Control-M, and AWS EMR to enable smooth pipeline execution and job scheduling. • Utilize Snowflake as the central data warehouse for analytics, integrating structured and unstructured data into a unified reporting framework. • Develop and maintain Java-based test suites using JUnit to validate pipeline integrity and conduct unit and integration testing. • Integrate machine learning models into data pipelines to enhance customer experiences with personalized recommendations. • Monitor and troubleshoot distributed systems, including Spark job failures, Lambda timeouts, and performance issues. • Enforce data governance practices to maintain data security and prevent unauthorized access or data leaks.

🎯 Requirements

• Bachelor's degree in Computer Science, Information Technology, or a related field. • Strong experience in Java, Apache Spark, and other big data technologies. • Proficient in AWS services (SNS, SQS, Lambda, EventBridge, EMR) and deploying applications using Terraform. • Expertise in SQL and experience with databases like Cassandra, Hive, and Snowflake. • Familiarity with machine learning concepts and integration into data pipelines. • Experience with CI/CD automation and version control systems (e.g., Git). • Strong understanding of distributed systems, data governance, and security best practices. • Familiar with tools like Splunk and Dynatrace for monitoring and troubleshooting. • Excellent problem-solving, communication, and collaboration skills. • Preferred Skills: Experience with Scala, Python, or other programming languages. • Familiarity with financial data processing and transaction systems. • Experience with testing frameworks such as Mockito for unit testing.