'install databricks inside azure self-hosted pool in windows
The main idea is installed databricks, so I use the following script:
- task: CmdLine@2
displayName: "Install databricks cli"
inputs:
script: |
pip install databricks-cli --user
pip install databricks
workingDirectory: $(projectRoot)/${{ parameters.IrropsMLService }}
- script: |
databricks --version
But I faced with problem: 'databricks' is not recognized as an internal or external command, operable program or batch file. Could you help me to resole the problem?
Solution 1:[1]
First remove databricks connect and also to uninstall any pyspark installation. And then follow the installation guide.
Uninstall PySpark. This is required because the databricks-connect package conflicts with PySpark.
pip uninstall pysparkInstall the Databricks Connect client.
pip install -U "databricks-connect==7.3.*" # or X.Y.* to match your cluster version.
Note - Always specify databricks-connect==X.Y.* instead of databricks-connect=X.Y, to make sure that the newest package is installed.
For more information follow this link
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | AbhishekKhandave-MT |
