Category "scala"

Gatling load testing and running scenarios

I am looking to create three scenarios: The first scenario will run a bunch of GET requests for 30s The second and third scenarios will run in parallel and wait

How do we do Spark Dataframe testing using JUnit?

We are trying to build an integration test suite using JUnit. Our pipeline (built in Spark using Scala) gives us DataFrames as output, we plan to compare them a

Failed to build request: No attribute named 'token' is defined in Gatling script

I convert HAR file to Gatling simulations script, but I have problem with extracting token from request header. After conversion I have the following code: impo

Apache Arrow in Scala: AbstractMethodError on loadBatch

I'm trying to load Arrow file into scala. But every time I call ethier arrowStreamReader.loadNextBatch() nor arrowFileReader.loadRecordBatch(arrowBlock), the JV

Get item in the list in Scala?

How in the world do you get just an element at index i from the List in scala? I tried get(i), and [i] - nothing works. Googling only returns how to "find" an

IOException: Cannot run program "javac": CreateProcess error=2, The system cannot find the file specified

I got the error "IOException: Cannot run program "javac": CreateProcess error=2, The system cannot find the file specified" while running my scala project in pl

Multidimensional Array zip array in scala

I have two array like: val one = Array(1, 2, 3, 4) val two = Array(4, 5, 6, 7) var three = one zip two map{case(a, b) => a * b} It's ok. But I have a multid

Scala: grouped from right?

In Scala, grouped works from left to right. val list = List(1,2,3,4,5) list.grouped(2).toList => List[List[Int]] = List(List(1, 2), List(3, 4), List(5)) B

How to use a Scala class inside Pyspark

I've been searching for a while if there is any way to use a Scala class in Pyspark, and I haven't found any documentation nor guide about this subject. Let's

IntelliJ Scala so slow on fast CPU with 32GB ram

I am using IntelliJ 2019.1.3 Community Edition. In Scala compile server, JVM maximum heap size: 4096 my idea.vmoptions: -Xms4096m -Xmx6144m -XX:ReservedCodeCac