Senior Data Engineer

November 5

Apply Now

Receive Emails with Similar Jobs

My Digital Brand

WebsiteLinkedInAll Job Openings

Digital Branding • Social Media • LinkedIn • Personal Brand

1 - 10

Description

• The Senior Data Engineer is a hands-on technical role focused on full stack software development within the Enterprise Data organization. • The role will pay curtail part in shaping future big data and analytics initiatives. • Designs and develops code and data pipelines to ingest from relational databases (Oracle, SQL Server, DB2, Aurora), file shares, and web services. • Streaming ingestion with Kinesis Streams, Kinesis Firehose, Kinesis Analytics and Kafka(MSK) • Build Data Lake on AWS S3 with optimal performance considerations by partitioning and compressing data. • Data Engineering and Analytics using AWS Glue, Informatica, EMR, Spark, Athena, Python. • Data modeling and building Data Warehouse using Snowflake. • Designs and develops code and data pipelines to ingest relational databases, file shares, and web services. • Designs JavaScript modules and REST APIs utilizing MarkLogic to support complex searches. • Develops MarkLogic integrations with existing enterprise platforms. • Participates in requirements definition, system architecture design, and data architecture design. • Participates in all aspects of the software life cycle using Agile development methodologies.

Requirements

• 7 + years of experience in Enterprise Information Solution Architecture, Design, and development required. • 7 + years of experience with integration architectures such as SOA, Microservices, ETL or other integration technologies. • 7 + years of experience with working content or knowledge management systems, search engines, relational databases, NoSQL databases, ETL tools, geospatial systems, or semantic technology. • 5+ years of hands-on experience with a MarkLogic framework , DynamoDB preferred. • 5+ years of hands-on experience with AWS services ( S3, Kinesis, Lambda, Athena, Glue, EMR) required. • 5 + years of analytics tools like SAS, R, Python, and other advanced statistical software. • 5 + years of Web development experience with Angular, JavaScript, and Node.js. • Experience with JSON or XML data modeling required. • Experience with Git/GitHub, branching, and other modern source code management methodologies required. • Domain knowledge of NoSQL or relational database required. • Understanding of database architecture and performance implications required. • Experience integrating Business Intelligence applications like Qlik Sense, Tableau, or PowerBI. • Experience with Machine Learning and Artificial Intelligence. • Ability to multi-task effectively. • Ability to work collaboratively as part of an Agile Team . • Extensive knowledge and experience with Python, JavaScript and Java. • Excellent written and verbal communication skills, sense of ownership, urgency and drive.

Benefits

• Comprehensive medical benefits coverage, • dental plans and vision coverage. • Health care and dependent care spending accounts. • Short- and long-term disability. • Life insurance and accidental death & dismemberment insurance. • Employee and Family Assistance Program (EAP). • Employee discount programs. • Retirement plan with a generous company match. • Employee Stock Purchase Plan (ESPP).