Perpay is hiring a

Data Engineer

Job Overview

  • Posted 1 month ago
  • Full Time
  • Philadelphia, PA, USA
  • 90000

Roles & Responsibilities

As a Mid-Level Data Engineer at Perpay, you will contribute to the development and optimization of our data pipelines and architectures. You will collaborate with data scientists, analysts, and other team members to support Perpay’s mission of creating inclusive financial products that enhance the lives of our members. With the introduction of our credit card, the demand for efficient data engineering solutions has grown significantly to meet our expanding modeling, reporting, and analytical needs.
You will have the opportunity to work on diverse projects across multiple domains, ensuring our data infrastructure supports a variety of business functions, including risk, commerce, marketing, operations, and more. Your contributions will directly impact our customers by enabling automated and efficient data-driven services.

We are seeking a Mid-Level Data Engineer who is a quantitative, analytical thinker with a strong passion for data and a solid foundation in data engineering principles. The ideal candidate has experience in building and maintaining data pipelines, implementing ETL processes, and contributing to data governance efforts. You should be comfortable working in a dynamic, fast-paced environment and managing multiple tasks with various stakeholders.

 

Responsibilities:

  1. Develop and optimize ETL pipelines using tools like Apache Airflow, AWS Glue, and Fivetran to support various business requirements
  2. Collaborate with data producers to understand data sources and contribute to the design and implementation of efficient data models using Redshift and Snowflake
  3. Implement data governance practices, including metadata management and data lineage using tools such as Open Lineage and Datahub
  4. Work with cross-functional teams to ensure data pipelines are scalable, reliable, and meet performance standards
  5. Identify and resolve data-related issues, optimizing workflows using techniques like partitioning, indexing, and caching
  6. Contribute to the ongoing development and maintenance of a modern data architecture, ensuring data quality and integrity
  7. Stay up-to-date with industry best practices and emerging technologies in data engineering

Skills Required

  • Machine Learning
  • Python

Find more jobs at Perpay

There are no results matching your search.

Reset
AISolvesThat © 2024 All rights reserved