Data Engineer

Job description

Data Engineer

Job Description

This role is part of the Data Engineering team, to serve the data engineering needs for both social

enterprises as well as a strategic project to identify and deliver on currently unserved family needs.

We are looking for passionate data engineers to develop data analytic capabilities, from data

infrastructure, ingestions, ETL/ELT data pipeline, to data modeling, you will be getting "first-hand"

access to our engineer centralized data platform, working with high impact projects and interacting

directly with senior leadership. Your voice and effort would be critical to the success of the data

platform.

The ideal candidate is an experienced data wrangler or data enthusiast who enjoys optimizing data

systems and solving problems through data, with extensive technical expertise in big data

technology, data ingestion pipeline and data modeling.

He/she will be responsible for designing and managing data warehouse plans for a product or

business line, designing,building and maintaining the batch or real time data pipeline in production

using cloud big data technology, and working with the business team on transforming the raw data

into actionable data mart.

You will be reporting to the head of data engineering.

Duties and Responsibilities

Set up data infrastructure, data pipelines, integrate source system data with data lakes

and data mining models into data pipelines.

Design, build, support and optimize new and existing data models and ETL/ELT

processes, including the ETL/ELT from source system to data lake and those within the

data lake

Develop and support the data pipeline to integrate data from new data sources with

emerging data technologies.

Define and manage SLA, data quality for all data sets in allocated areas of ownership

Maintain and optimize the performance of data analytics infrastructure to ensure

accurate, reliable and timely delivery of key insights for decision making

Mandatory requirements

Bachelors/Masters in Computer Science Engineering or related field

Relevant work experience as Data Engineer or related field

Experience with Data Engineer or Data Analytics Infrastructure. 1-5 years' experience in

designing, building and operationalizing medium to large scale data integration projects with

Google cloud.

Familiarity with SQL and one or more data Lake, Data Warehouse, RDBMS technologies (e.g.,

MSSQL, Oracle, SAP Hana, Hive, Bigquery, Redshift, etc.)

Able to work independently with large and multiple data sets from various business

processes and systems, to support the business in achieving strategic objectives

Strong interest in understanding and solving business problem with data

1-5 years of experience with python or any equivalent programming language

AWS or Google cloud knowledge and experience is a plus.

Requirements

Set up data infrastructure, data pipelines, integrate source system data with data lakes and data mining models into data pipelines. Design, build, support and optimize new and existing data models and ETL/ELT processes, including the ETL/ELT from source system to data lake and those within the data lake Develop and support the data pipeline to integrate data from new data sources with emerging data technologies. Define and manage SLA, data quality for all data sets in allocated areas of ownership Maintain and optimize the performance of data analytics infrastructure to ensure accurate, reliable and timely delivery of key insights for decision making Mandatory requirements Bachelors/Masters in Computer Science Engineering or related field Relevant work Experience as Data Engineer or related field Experience with Data Engineer or Data Analytics Infrastructure. 1-5 years' Experience in designing, building and operationalizing medium to large scale data integration projects with Google cloud. Familiarity with SQL and one or more data Lake, Data Warehouse, RDBMS technologies ( e. g., MSSQL, Oracle, SAP Hana, Hive, Bigquery, Redshift, etc. ) Able to work independently with large and multiple data sets from various business processes and systems, to support the business in achieving strategic objectives Strong interest in understanding and solving business problem with data 1-5 years of Experience with python or any equivalent programming language AWS or Google cloud knowledge and Experience is a plus.