Azure Databricks Data Engineering Lead Job at 5 Star Recruitment, Washington DC

VC9zSVZFdjB3SThVaTZVUVpxQ0ZHaytPNnc9PQ==
  • 5 Star Recruitment
  • Washington DC

Job Description

Job Description

  • 7+ years of experience in Databricks, Microsoft Azure, PySpark and Python.
  • Lead large-scale, complex, cross-functional projects to build the technical roadmap for the WFM Data Services platform.
  • Lead and review design artifacts.
  • Build and own the automation and monitoring frameworks that showcase reliable, accurate, easy-to-understand metrics and operational KPIs to stakeholders for data pipeline quality.
  • Execute proof of concept on new technology and tools to pick the best tools and solutions.
  • Support business objectives by collaborating with business partners to identify opportunities and drive resolution.
  • Communicate status and issues to Senior Starbucks leadership and stakeholders.
  • Direct project team and cross-functional teams on all technical aspects of the projects.
  • Lead with engineering team to build and support real-time, highly available data, data pipeline and technology capabilities.
  • Translate strategic requirements into business requirements to ensure solutions meet business needs.
  • Define and implement data retention policies and procedures.
  • Define and implement data governance policies and procedures.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
  • Enable team to pursue insights and applied breakthroughs, while also driving the solutions to Starbucks scale.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of structured and unstructured data sources using big data technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Perform root cause analysis to identify permanent resolutions to software or business process issues.

MUST HAVE:

  • 7+ years of experience in Databricks, Microsoft Azure, PySpark and Python.

Job Tags

Permanent employment,

Similar Jobs

Ladgov Corporation

Protestant Music Director Job at Ladgov Corporation

 ...performance : 3355 Illinois Street, Bldg. 301, Great Lakes, IL Qualifications: Two years or more of piano accompanist and worship musical leadership in a contemporary Christian church Understand Navy organization and ministry requirements for Chapel use.... 

BASF Agricultural Solutions US LLC

Government & Industry Affairs Coordinator Job at BASF Agricultural Solutions US LLC

 ...balance between economic, environmental and social value creation for sustainable and efficient agriculture. The Government and Industry Affairs Coordinator supports the U.S. PGA teams advocacy and policy initiatives by serving as a liaison with government agencies... 

Pacific Shipyards International, LLC

Ship Superintendent Job at Pacific Shipyards International, LLC

Pacific Shipyards International (PSI) is searching for an experienced Ship Superintendent to join our ship repair team in Hawaii. Position Title: Ship Superintendent Reports To: Vice President of Programs Location: Honolulu, Hawaii Position Summary PSI... 

Three Brothers Concrete

Concrete Form Setter Job at Three Brothers Concrete

 ...Type: Full-time Pay: $23.57 $30.00 per hour Under the direction of the foreman, a Concrete Form Setter performs a variety of carpentry tasks associated with the prepping, pouring, placing, and finishing of concrete. This may include using a variety of concrete... 

Hastings Public Schools

Mathematics Teacher (9-12) Job at Hastings Public Schools

This position is for a Mathematics teacher in a 9-12 High School Applicants must have valid Nebraska Teaching Certificate with appropriate endorsements. EOE/VET