AWS Data Engineer

6 days ago

🇺🇸 United States – Remote

🤠 Texas – Remote

Although this job is listed in Texas, this company may be open to hiring remote in other states.

⏰ Full Time

🟡 Mid-level

🟠 Senior

🚰 Data Engineer

Apply Now

Receive Emails with Similar Jobs

Scalepex

WebsiteLinkedInAll Job Openings

Customer Care • Technology • User Experience • Consulting • Project Delivery

51 - 200 employees

🤝 B2B

👥 HR Tech

🤖 Artificial Intelligence

Description

• Why Scalepex? • Scalepex is a dynamic services firm specializing in providing solutions for premium brands. • Join the Innovation Frontier at Scalepex! • We are seeking an experienced AWS Data Engineer with a strong background in building scalable data solutions and expertise in utilities-related datasets. • The ideal candidate will have at least 5 years of experience in data engineering, • design, develop, and optimize data pipelines to support analytics in the utilities industry. • Key Responsibilities • Develop scalable pipelines using AWS services (e.g., Glue, S3, Redshift) to process large datasets. • Use AWS Step Functions to orchestrate workflows across data pipelines; experience with Airflow is acceptable. • Implement ETL/ELT processes using PySpark, Python, and Pandas. • Ensure reliability, scalability, and performance in handling large-scale utility data. • Use AWS Lambda functions to build serverless solutions. • Design data models tailored for utilities use cases. • Monitor and improve the performance of data pipelines. • Implement robust security measures to protect sensitive utility data.

Requirements

• Minimum of 5 years of experience in data engineering • Proficiency in AWS services such as Step Functions, Lambda, Glue, S3, DynamoDB, and Redshift. • Strong programming skills in Python with experience using PySpark and Pandas for large-scale data processing. • Hands-on experience with distributed systems and scalable architectures. • Knowledge of ETL/ELT processes for integrating diverse datasets into centralized systems. • Familiarity with utilities-specific datasets (e.g., smart meters, energy grids) is highly desirable. • Strong analytical skills with the ability to work on unstructured datasets. • Knowledge of data governance practices to ensure accuracy, consistency, and security of data. • Strong experience in AWS data engineering • Ability to work independently • Ability to work with a cross-functional teams, including interfacing and communicating with business stakeholders • Professional oral and written communication skills • Strong problem solving and troubleshooting skills with experience exercising mature judgement • Excellent teamwork and interpersonal skills • Ability to obtain and maintain the required clearance for this role