'While running a spark-java program in eclipse, I am getting this error - java.lang.NoClassDefFoundError

I am using Spark 3.1.2 prebuilt with hadoop 3.2.0. I am using winutils instead of hadoop installation.

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/util/HadoopFSUtils$
    at org.apache.spark.sql.execution.datasources.DataSource$.$anonfun$checkAndGlobPathIfNecessary$5(DataSource.scala:814)
    at org.apache.spark.sql.execution.datasources.DataSource$.$anonfun$checkAndGlobPathIfNecessary$5$adapted(DataSource.scala:813)
    at scala.collection.TraversableLike.$anonfun$partition$1(TraversableLike.scala:402)
    at scala.collection.immutable.List.foreach(List.scala:392)
    at scala.collection.TraversableLike.partition(TraversableLike.scala:402)
    at scala.collection.TraversableLike.partition$(TraversableLike.scala:400)
    at scala.collection.AbstractTraversable.partition(Traversable.scala:108)
    at org.apache.spark.sql.execution.datasources.DataSource$.checkAndGlobPathIfNecessary(DataSource.scala:813)
    at org.apache.spark.sql.execution.datasources.DataSource.checkAndGlobPathIfNecessary(DataSource.scala:590)
    at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:415)
    at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:326)
    at org.apache.spark.sql.DataFrameReader.$anonfun$load$3(DataFrameReader.scala:308)
    at scala.Option.getOrElse(Option.scala:189)
    at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:308)
    at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:240)
    at Main.main(Main.java:26)
Caused by: java.lang.ClassNotFoundException: org.apache.spark.util.HadoopFSUtils$
    at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
    ... 16 more


Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source