Job Description

Vaco is seeking a talented Azure Databricks Admin to lead the installation, configuration, maintenance, and optimization for of this environment for our global retail client. In this role you will be collaborating closely with data engineers, data scientists, and business stakeholders to ensure the seamless operation of our data analytics platform. We are looking for those with a background in retail data environments within the Azure ecosystem (Databricks clusters/workspaces, data privacy and compliance, data governance, etc.). This role will be leading the migration from legacy workspaces to new Unity Catalog Environments, so we are interested in good experience with similar projects. If you are interested and have the requirements were looking for, please apply today and reach out to a member of the Vaco team to learn more.

Responsibilities:

• Install, configure, and maintain Azure Databricks clusters and workspaces.
  
  
• Monitor system performance and troubleshoot issues to ensure high availability and reliability.
  
  
• Implement security best practices and ensure compliance with data governance policies.
  
  
• Optimize and fine-tune Databricks clusters for performance and cost efficiency.
  
  
• Lead the migration of existing legacy workspaces, schemas, and data to new Unity Catalog Environments.
  
  
• Manage the Azure Databricks platform, ensuring availability, reliability, and performance.
  
  
• Implement and maintain security measures to protect sensitive data and ensure compliance with regulations like GDPR or HIPAA.
  
  
• Integrate Databricks with other systems and tools in the data ecosystem, such as data lakes, databases, and visualization tools.
  
  
• Collaborate with data engineers and data scientists to design and implement data pipelines and workflows.
  
  
• Provide technical support and guidance to users and stakeholders.
  
  
• Stay current with Azure Databricks updates, new features, and best practices.
  

Requirements:

• Proven experience (8+ years) as a Databricks Administrator or similar role.
  
  
• In-depth knowledge of Azure Databricks architecture, features, and capabilities.
  
  
• Strong Retail Domain experience
  
  
• Proficiency in scripting languages such as Python, PowerShell, or Bash.
  
  
• Strong understanding of cloud computing concepts and experience with Microsoft Azure services.
  
  
• Hands-on experience with cloud platforms such as AWS, Azure, or GCP is a must.
  
  
• Experience in implementing CI/CD pipelines for automating build, test, and deployment processes.
  
  
• Excellent troubleshooting and problem-solving skills.
  
  
• Good communication and interpersonal skills, with the ability to work effectively in a team environment.
  

Job Tags

Similar Jobs