3 days ago
• Collaborate with cross-functional teams to understand data requirements, define data standards, and design efficient data models and architectures. • Develop and implement strategies for data acquisition, transformation, and storage. • Evaluate, recommend, and select data warehouse components, including hardware, database management systems, ETL software and data mining tools. • Coordinate and work with other IT staff to develop database architectures, integration and coding standards as well as quality assurance policies and procedures. • Build, implement and optimize large-scale data processing systems for batch and real-time data pipelines. • Define and build a data semantic layer and present to Data Analysts and subject matter experts in the business. • Design, manage and maintain databases, ensuring performance, security, and scalability. • Design and implement redundant systems, policies and procedures for disaster recovery and data archiving to ensure availability, protection, and integrity of data assets. • Develop and maintain ETL (extract, transform, load) processes to ensure smooth and efficient flow of data from source to destination. • Implement data quality checks and ensure data integrity throughout the data lifecycle. • Maintain comprehensive documentation for data processes, workflows, and systems. • Provide training and support to other team members as required. • Performs other related duties as needed and assigned.
• Minimum 5 years in data engineering, data analytics, database design and ETL development. • Experience with data warehousing solutions such as Azure Synapse. • Hands on experience with data architecting, data mining, large scale data modeling and business requirements gathering/analysis. • Proficiency in programming/scripting languages such as Python, Java, PowerShell or C#. • Experience with data integration, orchestration, workflow and data management tools such as Azure Data Factory and Data Bricks. • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. • Advanced data manipulation skills: read in data, process and clean it, transform and recode it, merge different data sets, reformat data between wide and long, etc. • Technical expertise in data modeling and design principles, data mining and segmentation techniques. • Strong understanding of business processes and data flows. • Strong interpersonal and collaboration skills. • Excellent problem solving, troubleshooting and analytical skills. • Demonstrated successful ability to organize and prioritize work to ensure timely deadlines. • Must work independently and with minimal technical direction, as well as within a team environment. • Project leading experience required.
• Must have Broadband availability: Min 30 MBPS (national service provider JIO/TATA/Airtel Hathway etc) • Important: Access to a quiet home office environment with above mentioned broadband availability and working space to accommodate two monitors +1 Laptop.
Apply NowNovember 10
201 - 500
Data Engineer for venue management software company optimizing data pipelines.
November 10
51 - 200
Develop data integration pipelines for online retail technology company