DISNEYのLead Data Engineer Skip Navigation
EN
The Walt Disney Company: Be Part of the Story

Be Part of the Story

Lead Data Engineer

応募後で応募 Job ID 862612BR 勤務地-都市 ニューヨーク, ニューヨーク州, アメリカ合衆国 勤務地-国 Marvel Entertainment 掲載日 Sep. 14, 2021

仕事内容:

Marvel is seeking an experienced AWS Cloud Data Engineer with significant DevOps and SysOps experience. The company is headquartered in NYC, but this role is envisioned as a remote position and will focus on providing engineering support for a variety of analytics, data architecture and data science endeavors.

In this role you will primarily lead the design and evolution of the BI data lake, while working closely with the rest of the BI team to build a flexible and robust data infrastructure.

You will co-develop and maintain an evolving number of data pipelines to enable advanced reporting capabilities across our Subscription, Publishing, Digital, Consumer Products, Corporate and Marketing teams. This role will function as Marvel’s primary subject matter expert on creating and maintaining efficient data pipelines to clean, conform and deliver large datasets, both structured and unstructured, to downstream destinations.

As the team’s ETL expert, there will be ample opportunities to conduct complex data wrangling/munging operations using a variety of AWS and other industry standards tools including, Python, Pandas, PySpark, Glue Studio, Lambdas, Advanced SQL, etc. You will also work with APIs, create complex materialized views and scheduled queries, as well as develop error logging routines and associated alerts. You can expect to work closely with the Enterprise Architect and Data Architect to design and deploy best practice data governance operations as well.

Our team is small but capable, and looking for an intellectually curious engineer with excellent communication skills, who is interested in working very closely to co-invent solutions to complex problems. Our department is also an environment that encourages constantly learning and cross-functional growth, so you can expect to explore and expand your knowledge in areas like supervised and unsupervised machine learning, graph databases, AI and applied statistics/mathematics.

職責/担当・主要業務:

  • Develop batch and real-time data pipelines, and lead the integration of Marvel’s many 1st, 2nd, and 3rd party data sources, while working closely with other engineering services such as the personalization and testing teams.
  • Create data catalogs and validation routines to ensure quality and correctness of key operational datasets and metrics in real time.
  • Build integrations with organic and paid media platforms to effectively deliver data to support the optimization of various KPIs.
  • Partner with Data Architect to build data infrastructure that enables activation, attribution and segmentation capabilities across growth, retention and marketing objectives
  • Collaborate with lifecycle and product marketing teams to democratize insights that will drive subscriber engagement using data driven solutions.
  • Coach other engineers and BI team members on best practices and technical concepts of building large scale, robust and well governed data platforms.

必須要件:

  • Excellent communicator and collaborator, able to apply technical acumen to drive business outcomes.
  • A natural team player with a willingness and desire to engage in cross training in a small team environment.
  • 4+ years in big data and/or data intensive projects in industry or academic/research settings
  • 4+ years of deep experience developing in Python
  • Expert Level SQL developer – with an emphasis on Redshift but capable across multiple other transactional databases such as PostgreSQL, MySQL, Mongo dB, etc.
  • Significant experience developing with PySpark
  • Experience engineering big-data solutions using technologies like Redshift, Spark, S3, DynamoDB, Glue Studio and AWS SageMaker, Glue Studio, SageMaker Data Wrangler, etc.
  • Demonstrated understanding of data engineering tools and practices, including platforms like Airflow, Databricks, Snowflake, and Jenkins
  • Experience with deploying and running AWS-based data solutions and comfortable deploying tools such as Cloud Formation, AWS Glue, Kinesis, DynamoDB, Athena and Lambda
  • Demonstrated experience applying Master Data Management including metadata management, data lineage, and the principles of data governance
  • Ability to deliver technical solutions in the face of challenging data conditions.

望ましい経験/スキル:

  • Experience implementing marketing technology stacks including real-time messaging and attribution pipelines.
  • Experience leveraging DMPs (BlueKai) and CDPs (mParticle, Segment) to create deterministic user profiles that can be leveraged across a variety of applications.
  • Experience integrating with ML platforms and experimentation frameworks.
  • Familiarity with front-end development frameworks and experience in full stack development a plus.
  • An experimental and autodidactic mind set towards expanding your own capabilities.
  • Familiarity with binary data serialization formats such as Parquet, Avro, and Thrift.

望ましい学歴

BA / BS Degree or relevant work experience.

Marvel Entertainment について:

Marvel Entertainment, LLC,はThe Walt Disney Companyの完全子会社で、世界で最も有名なキャラクターを生み出すエンターテイメント企業の1つです。70年以上にわたり、様々なメディアで8000を超える特徴的なキャラクターを世に送り出し、実績あるコレクションを築いてきました。Marvelはエンターテイメントやライセンス、出版業界に対しキャラクターのフランチャイズ化を行っています。

The Walt Disney Company について:

The Walt Disney Companyおよびその子会社・関連会社は、メディア・ネットワーク、パーク&リゾート、スタジオ・エンターテイメント、コンシューマ・プロダクツ、インタラクティブ・メディア事業を扱う、多角化したファミリー向けエンターテイメントとメディアのグローバルカンパニーです。1920年代に小さなアニメーション・スタジオとしてスタートしたディズニーは、今日のエンターテイメント業界において世界中の人々に愛される存在となりました。今後もお客様一人ひとりに最上のストーリーと体験を提供できるような作品作りを継承し、40カ国以上で従業員とキャストメンバーが一丸となり、ディズニーエンターテイメント体験を創出していきます。

これは Marvel Entertainment, LLC, のポジションであり、 Marvel Entertainmentという事業区分に含まれます。

Marvel Entertainment, LLC は雇用において均等な機会を提供しています。人種、肌の色、宗教、性別、国籍、性的指向、性自認、障害、又は保護を受けている退役軍人であるという立場に関わらず、応募者を選考します。Disneyは、企業が成長し、革新を生み、最高のストーリーを創出し、急速に変化する世界に対応できるよう、あらゆる人のアイデアや決定を尊重する企業文化を育みます。

応募 後で応募

ジョブアラートに登録する

ジョブアラートにご登録いただくと、ご希望の求人情報をメールで受け取ることができます。

関心カテゴリーを検索し、提案リストから一つ選択してください。勤務地を検索し、提案リストから一つ選択してください。最後に、「追加」をクリックして、ジョブアラートを作成してください。

  • デジタル&インタラクティブ・メディア, ニューヨーク, ニューヨーク州, アメリカ合衆国削除