'Databricks runtime from docker hub image vs original Databricks runtime
are databricks runtimes from docker hub ( https://hub.docker.com/r/databricksruntime/standard ) same as actual runtimes inside Databricks? I mean when we made our own docker image from databricksruntime/standard will be there same dependencies, versions etc as in runtime inside databricks? We need to archive older runtimes in bank environment and be able to run old notebooks with exactly same runtime.
And another question about runtime’s version. If I use my docker container in cluster creation with for example runtime version 6.6 but in setup I also select different version in column Databricks runtime version what will happened? Will be column Databricks runtime version ignored?
Solution 1:[1]
The base Docker images that are published on Docker Hub are just a base Docker images - they don't contain actual Databricks Runtime (DBR). DBR is actually injected into Docker image (base or provided by you) on a start. And you can really create a completely new Docker image, not based on the Databricks' base images - you just need to meet requirements for Java version, some tools, etc.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | Alex Ott |