Data Engineer

About the Role:

As a Data Engineer, you will play an integral role in setting up and monitoring the health of data ingestion and transformation pipelines, as well as managing and optimizing our Snowflake instance.  You will provide guidance and collaborate with upstream teams to address data governance concerns and requirements.  You’ll have the chance to collaborate with exceptionally skilled individuals and enhance your expertise.  You will gain experience working in a wide range of technologies pulling data in from a variety of sources, including operational data stores like MySQL and MongoDB; web and mobile event tracking logs; internal and 3rd party APIs; streaming data sets; FTP transfers, and more.

What You’ll Do:

• Create new data ingestion and transformation pipelines using dbt, Python, and Prefect
• Manage the infrastructure and resources for data processing and storage
• Collaborate with cross-functional teams including data scientists, business intelligence and machine learning engineers to capture their requirements and deliver solutions to meet their needs
• Promote data quality standards to ensure the accuracy, completeness and integrity of data
• Produce and maintain comprehensive documentation including documentation of architecture, data dictionary,  models, pipelines and lineage.