Data Platforms Administrator Job

Data Platforms Administrator Job

This is an exciting opportunity for a highly skilled Databricks administrator to join our team.
• This position requires a strong understanding of Databricks architecture and administration, as well as excellent communication and problem-solving skills.

The successful candidate will be responsible for ensuring the smooth operation of Databricks clusters and workspaces, as well as providing technical support to users.
Key Responsibilities:
• Design, implement, and maintain Databricks clusters, including setting up and configuring the platform, managing account identities, and monitoring cluster performance.
• Implement and manage access controls and security policies to protect sensitive data.
• Perform regular software updates and patches.
• Provide technical support to Databricks users, including troubleshooting and issue resolution.
• Conduct training sessions to educate users on platform best practices and capabilities.
• Optimize cluster configurations for performance and cost-effectiveness.
• Monitor and manage auto-scaling to ensure resources are allocated efficiently.
• Implement and enforce security policies, access controls, and encryption mechanisms.
• Stay up-to-date with security best practices and compliance requirements.
• Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
• Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
• Monitor and manage platform costs, including optimizing resource utilization to control expenses.
• Maintain detailed documentation of configurations, procedures, and best practices.
• Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts, to understand their requirements and provide technical solutions.