Company Description

Our partner is a world leader in transportation equipment, leasing and asset management. They are in need of a team oriented and technically hands-on Data Engineering Lead who wants to move into a Manager role. To get onboard with this great company and work for a truly wonderful human, please apply today. We value diversity in the workplace and encourage women, minorities, and veterans to apply. Thank you!               

Location: US Remote

Type: Permanent F/T

Job Summary:

The Data Engineering team is responsible for delivering a broad range of software capabilities including building data pipelines, managing the ETL/ELT processes, receiving and delivering data through various interfaces, and processing significant amounts of data related to logistics, liability, and financial calculations. As manager you will provide technical direction to the team and participate in development tasks. The duties for this position will be divided 50/50 between coding activities and management.

Primary Responsibilities

  • Write expert level Python code for data processing as well as ETL/ELT pipelines
  • Coordinate with multiple teams on various data provisioning needs
  • Coordinate with Data Owners, Business Analysts, and Product Owners as needed throughout the projects
  • Contribute design ideas for complex data pipelines and ETL/ELT processes
  • Mentor data engineering team members
  • Perform code reviews for pull requests
  • Participate in strategy sessions with other managers
  • Perform one on one meetings with team members
  • Guide employees through work milestones and career development

  Qualifications

  • 5+ years of data engineering or equivalent experience
  • Hands on technical experience with Apache Spark / Azure Databricks
  • Expert level coding experience with PySpark
  • Expert level knowledge of relational databases and query authoring (SQL)
  • Proven experience designing and implementing big data technologies (Hadoop, NoSQL, OLTP, and OLAP)
  • Experience using and designing solutions on Azure Cloud infrastructure – Azure: both Data Factory & DevOps
  • Experience working with a distributed event-streaming platform such as Kafka
  • Experience working across multiple technical teams
  • Understanding of core business intelligence and data warehousing technology
  • Excellent communication skills particularly bridging conversations between data and business stakeholders
  • Experience with software development practices such as Agile, TDD, and CICD
  • Experience leading or managing a Data Engineering team, including employee recruitment
  • Snowflake experience is a plus
  • Any experience with graph databases or graph libraries is a plus
  • Any experience with Amazon Deequ or similar tools is a plus

Personal Attributes

  • Exemplifies leadership characteristics in support of the development teams’ objectives
  • Able to understand and communicate elegant solutions to complex problems and identify patterns at the technical level
  • Able to analyze and optimize both technical and business processes
  • Equally comfortable working with both technical and business stakeholders & sound judgement and decision-making with the appropriate sense of urgency