Development » Infrastructure » Cloud Data Engineer

Cloud Data Engineer

NYC, NY 200K - 400K

Responsibilities

Design large scale data analytics platform
Design data pipelines and persistence in a cloud environment
Build solutions to process structured and unstructured data from multiple sources
Work with teams to build data catalogs and track lineage
Build solutions for OLTP and OLAP
Mange ETL at scale with open source and cloud native tools
Design schemas and normalization strategies based on the queries performed
Work with Lucene based search engines, with a preference for Elasticsearch
Experience with data transport tools and messaging busses
Work closely with software developers, data scientists, and Quantitative analysts
Design and implement highly available, scalable, cloud based storage solutions
Manage, monitor, and operate production platforms
Hands-on oversight of development work for the data analytics platforms
The candidate must have experience developing production ready code to perform data transformations and basic analytics, in one or more programming languages, to include Python. Experience working with numerical, scientific, and machine learning libraries is desired.

LR150

Careers@hrg.net

Submit resume