'JFrog as Apache Spark artifactory with authentication
Trying to use JFrog as authenticated Artifactory with Apache Spark with the https://user:pswd@url suggested here: https://spark.apache.org/docs/latest/submitting-applications.html#advanced-dependency-management and it is not working with next configuration:
"jars":"https://user:[email protected]/artifactory/default-generic-local/spark-sql-kafka-0-10_2.12-3.0.3.jar"
It doesn't work:
22/04/27 15:27:21 INFO SecurityManager - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(1000690000); groups with view permissions: Set(); users with modify permissions: Set(1000690000); groups with modify permissions: Set()
Exception in thread "main" java.io.IOException: Server returned HTTP response code: 401 for URL: https://user:[email protected]/artifactory/default-generic-local/spark-sql-kafka-0-10_2.12-3.0.3.jar
Even if you try from a console this work:
curl -v "https://user:[email protected]/artifactory/default-generic-local/"
Also a no authenticated JFrog artifact it works good. Any advice to use an authenticated artifact from Spark?
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
Solution | Source |
---|