Can cluster policies be modified or updated after they have been assigned?

Cluster policies can be modified or updated after they have been assigned in Azure Databricks. You can use the Azure Databricks CLI or the Databricks REST API to make changes to existing cluster policies. Here’s an example using the Azure Databricks CLI:

1. Identify the Cluster Policy ID:
   • First, you need to identify the ID of the cluster policy you want to modify. You can use the following command to list the existing cluster policies and their IDs: databricks clusters policy list
   • Note down the ID of the cluster policy you want to update.
2. Update the Cluster Policy:
   • Open a command prompt or terminal.
   • Run the following command to update the cluster policy: databricks clusters policy update --policy-id <policy-id> --<property-to-update> <new-value> Replace <policy-id> with the ID of the cluster policy you want to update. Provide the specific property you want to modify in <property-to-update>, and set its <new-value> accordingly.For example, to update the maximum number of workers allowed in the “DataScientistsPolicy” to 15, you would run: databricks clusters policy update --policy-id <policy-id> --num-workers.max_value 15
3. Verify the Update:
   • You can use the Azure Databricks CLI or the Databricks UI to verify that the cluster policy has been updated successfully.
   • To view the details of a specific cluster policy using the CLI, run the following command: databricks clusters policy get --policy-id <policy-id> This command will display the updated configuration of the cluster policy.

By updating cluster policies, you can adjust the configurations and limitations applied to teams or users in Azure Databricks. This allows you to adapt the policies to changing requirements or to refine the access control rules for your Databricks environment.

Note: The commands provided assume that you have already set up the Azure Databricks CLI and have appropriate permissions to manage cluster policies and update their configurations.