'Unable to view cluster on UI that is created by databricks api
I am creating a databricks cluster via api but somehow it is not visible on the databricks UI. Please could you suggest if i am missing something.
Also, I have created a group and added users to it, will that give access to this cluster?
Note: I can see that the databricks cluster is created but due to some reason it is in termination state.
def create_cluster():
data = {
"cluster_name": "test-cluster",
"spark_version": "10.1.x-cpu-ml-scala2.12",
"node_type_id": "i3.xlarge",
"autoscale" : {
"min_workers": 1,
"max_workers": 2
}
}
response = requests.post(get_url('/clusters/create'), json=data, headers=HEADERS)
print(json.dumps(json.loads(response.text), indent=2))
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|
