Senior Data Research Engineer - Database Engineer

5 days ago

Apply Now

Receive Emails with Similar Jobs

Forbes

WebsiteLinkedInAll Job Openings

Business • Finance • Investing • Technology • Politics

201 - 500

💰 $200M Corporate Round on 2022-02

Description

• Design, develop, and maintain the database infrastructure to store and manage company data efficiently and securely. • Work with databases of varying scales, including small-scale databases, and databases involving big data processing. • Work on data security and compliance, by implementing access controls, encryption, and compliance standards (GDPR). • Collaborate with cross-functional teams to understand data requirements and support the design of the database architecture. • Migrate data from spreadsheets or other sources to a relational database system (e.g., PostgreSQL, MySQL) or cloud-based solutions like Google BigQuery. • Develop import workflows and scripts to automate the data import process and ensure data accuracy and consistency. • Optimize database performance by analyzing query execution plans, implementing indexing strategies, and improving data retrieval and storage mechanisms. • Work with the team to ensure data integrity and enforce data quality standards, including data validation rules, constraints, and referential integrity. • Monitor database health and identify and resolve issues. • Collaborate with the full-stack web developer in the team to support the implementation of efficient data access and retrieval mechanisms. • Implement data security measures to protect sensitive information and comply with relevant regulations. • Demonstrate creativity in problem-solving and contribute ideas for improving data engineering processes and workflows. • Embrace a learning mindset, staying updated with emerging database technologies, tools, and best practices. • Explore third-party technologies as alternatives to legacy approaches for efficient data pipelines. • Familiarize yourself with tools and technologies used in the team's workflow, such as Knime for data integration and analysis. • Use Python for tasks such as data manipulation, automation, and scripting. • Collaborate with the Data Research Engineer to estimate development efforts and meet project deadlines. • Assume accountability for achieving development milestones. • Prioritize tasks to ensure timely delivery, in a fast-paced environment with rapidly changing priorities. • Collaborate with and assist fellow members of the Data Research Engineering Team as required. • Perform tasks with precision and build reliable systems. • Leverage online resources effectively like StackOverflow, ChatGPT, Bard, etc., while considering their capabilities and limitations.

Requirements

• Bachelor's degree in Computer Science, Information Systems, or a related field is desirable but not essential. • Knowledge of database development and administration concepts, especially with relational databases like PostgreSQL or MySQL. • Knowledge of SQL and understanding of database design principles, normalization, and indexing. • Knowledge of data migration, ETL (Extract, Transform, Load) processes, or integrating data from various sources. • Knowledge of cloud-based databases, such as Google BigQuery and AWS RDS. • Eagerness to develop import workflows and scripts to automate data import processes. • Ideally, familiarity with Knime or similar tools for data integration and analysis. • Knowledge of data security best practices, including access controls, encryption, and compliance standards (e.g., GDPR, HIPAA). • Strong problem-solving and analytical skills with attention to detail. • Creative and critical thinking. • Strong willingness to learn and expand knowledge in data engineering. • Knowledge of Python programming, including data manipulation and automation, and with modules such as Pandas, SQLAlchemy, gspread, PyDrive, PySpark. • Familiarity with Agile development methodologies is a plus. • Familiarity with Docker containers or similar technologies is a plus. • Experience with version control systems, such as Git, for collaborative development. • Ability to thrive in a fast-paced environment with rapidly changing priorities. • Ability to work collaboratively in a team environment. • Good and effective communication skills. • Comfortable with autonomy and ability to work independently.