Azure Databricks Data Engineering Lead Job at 5 Star Recruitment, Washington DC

VC9zSVZFdjB3SThVaTZVUVpxQ0ZHaytPNnc9PQ==
  • 5 Star Recruitment
  • Washington DC

Job Description

Job Description

  • 7+ years of experience in Databricks, Microsoft Azure, PySpark and Python.
  • Lead large-scale, complex, cross-functional projects to build the technical roadmap for the WFM Data Services platform.
  • Lead and review design artifacts.
  • Build and own the automation and monitoring frameworks that showcase reliable, accurate, easy-to-understand metrics and operational KPIs to stakeholders for data pipeline quality.
  • Execute proof of concept on new technology and tools to pick the best tools and solutions.
  • Support business objectives by collaborating with business partners to identify opportunities and drive resolution.
  • Communicate status and issues to Senior Starbucks leadership and stakeholders.
  • Direct project team and cross-functional teams on all technical aspects of the projects.
  • Lead with engineering team to build and support real-time, highly available data, data pipeline and technology capabilities.
  • Translate strategic requirements into business requirements to ensure solutions meet business needs.
  • Define and implement data retention policies and procedures.
  • Define and implement data governance policies and procedures.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
  • Enable team to pursue insights and applied breakthroughs, while also driving the solutions to Starbucks scale.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of structured and unstructured data sources using big data technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Perform root cause analysis to identify permanent resolutions to software or business process issues.

MUST HAVE:

  • 7+ years of experience in Databricks, Microsoft Azure, PySpark and Python.

Job Tags

Permanent employment,

Similar Jobs

Red Hat

Associate Consultant Job at Red Hat

 ...for candidates who meet all the requirements, we're looking for people who are excited about working with us and growing their career at...  ...networking and community events Within 6 months, be ready to deliver a project by attaining the following: Collaborate... 

Music Ministry International

Director of Music Pianist Keyboardist or Organist Job at Music Ministry International

 ...The successful candidate for this position will be a 1099 contractor with Music Ministry International and be responsible for the following: 1.0. BACKGROUND. It is incumbent upon Commanding Officers (COs) to have a CRP which accommodates the religious needs and rights... 

Sumitomo Mitsui Banking Corporation

Analyst/Associate, Infrastructure, Power & Energy Project Finance, North America Job at Sumitomo Mitsui Banking Corporation

 ...Group offers a diverse range of financial services, including banking, leasing, securities, credit cards, and consumer finance. The Group...  ..., Nagoya, and New York (NYSE: SMFG) stock exchanges. In the Americas, SMBC Group has a presence in the US, Canada, Mexico, Brazil,... 

Move For Hunger

Content Strategist & Digital Creator Job at Move For Hunger

 ...passionate, and creative team that works collaboratively to fight...  ...across all channels and social media creation for the organization...  ...Reporting to the Director of Marketing with support from our graphic...  ...environment is Remote/Work From Home Monday-Friday, 9 am to 5 pm Eastern... 

Heartlands Concepts Inc.

Crew Member Food Service Job at Heartlands Concepts Inc.

Heartland Concepts, who owns and operates Auntie Annes Pretzels, Planet Smoothie is currently seeking applications for Crew Members at all of our locations. We have locations at Westroads Mall, , Nebraska Crossing and Gateway Mall in Lincoln. Minimum age is 16 years old...