Lead Data Engineer

About the Role & Team

The Disney Decision Science + Integration (DDSI) organization is responsible for supporting clients across The Walt Disney Company including the Disney Parks, Experiences and Products segment which include Parks & Resorts both domestic and international, Consumer Products and Disney Signature Experiences as well as the Disney Entertainment segment including Studios Content (Disney Theatrical Group), General Entertainment Content, and ESPN and Sports Content.

DDSI leverages technology, data analytics, optimization, statistical and econometric modeling to explore opportunities, shape business decisions and drive business value.

The DDSI Data Engineering (DE) team is seeking a Data Engineering Manager to work on a Parks/Tickets Yield Management project supporting multiple theme park locations. This position will work with the Decision Science Products and Science teams to design, develop, enhance, and implement systems in the park/ticket yielding space.

What You Will Do

The Lead Data Engineer role will be responsible for planning and managing the data engineering processes related to a multi-site application supporting the Parks Yield Management portfolio. In this position, the candidate will drive DE activities related to project scoping, data requirements, planning, estimating, design, development, testing, production rollout and sustainment activities. Additional responsibilities will include participating in weekly project meetings, status updates, define/manage DE sprint activities, consult and collaborate with project team members, lead design reviews, ensure DE standards are followed, and provide hands-on development as needed.

Required Qualifications & Skills

• Experience with defining and estimating level-of-effort DE activities

• Experience with project and sprint planning

• Experience translating project scope into data engineering tasks

• Experience defining solutions to sophisticated data engineering problems in support of advanced analytic processes

• Experience collaborating with multiple project teams in a fast-paced environment

• Ability to effectively communicate complex technical concepts and solutions to non-technical team members

• Experience designing and building data structures to support requirements

• 7+ years overall experience in a software development capacity using a multi environment (Dev, QA, Prod, etc.) and DEVOP procedures for code deployment/promotion

• Multiple years of experience with ELT/ETL data pipeline development and maintenance

• Multiple years of shown experience and expertise using SQL and Python

• 2+ years using, designing and building relational databases (preferably Snowflake or PostgreSQL)

• 2+ years of experience managing and deploying code using a source control product such as GitLab/GitHub

• 2+ years of experience with job scheduling software like Apache Airflow, Amazon MWAA, GitLab Runners or UC4

• Experience using containerization technologies such as Docker or Kubernetes

• Knowledgeable on cloud architecture and product offerings, preferably AWS

Preferred Qualifications

• Knowledgeable with Disney Parks attendance, reservations and/or products

• Experience with cloud based technologies, preferably AWS EMR, EC2, and S3

• Experience with various Snowflake offerings such as Snowpark, Data Exchange, Data Marketplace and Snowpipe

Education

• Bachelor’s degree (Computer Science, Mathematics, Software Engineering or related field, or equivalent experience)

• Master’s degree preferred (Computer Science, Mathematics, Engineering or related field preferred)