Data Analytics Engineer Full Time

Job Description
The Analytics Data Engineer, which is an emerging role in the analytics team, is responsible for operationalizing data pipelines that support analytics initiatives for the company. The primary responsibilities include building, managing, and optimizing data pipelines and moving these pipelines effectively into production. The data pipelines will provide a curated data lake that enables consumers to complete advanced analytics as well as business reporting. Additionally, the data engineer is responsible for ensuring data quality, governance and data security procedures are met while curating data for use in the Data Lake.

Responsibilities
During your employment your responsibilities will include:

Develop big data solutions for near real-time stream processing, as well as batch processing on the Big Data platform
Work with business domain experts, data scientists and application developers to identify data that is relevant for analysis and develop a scalable solution
Ensure on-time quality deliverable with ability to coordinate effectively with the rest of the team
Build indexes, mappings, search queries and perform analytics
To perform data related benchmarking, performance analysis
Execute and manage large scale ETL processes to support development and publishing of reports, Datamart’s and predictive models
Build and maintain high performing ETL processes, including data quality and testing aligned across technology, internal reporting and other functional teams

Requirements
Knowledge of SQL and conventional databases
Experience in NOSQL technologies like Cassandra, MongoDB
Experience with data preparation, transformation and analytical model development
Experience with Unix/Shell or Python scripting and exposure to Scheduling tools like Oozie and Airflow.

Nice To Have
Experience with developing and maintaining production data pipelines using Kafka
Experience with ClickHouse
Experience with Apache Superset