Recent questions tagged scala

0 votes

840 views

1 answer

scala - Spark Dataframe write to kafka topic in avro format?

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

872 views

1 answer

scala - How to encode categorical features in Apache Spark

I have a set of data based on which I want to create a classification model. Each row has the following form: user1,class1 ... (id , cl , vs) } See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

845 views

1 answer

scala - DeDuplication error with SBT assembly plugin

I am trying to create an executable jar using SBT assembly plugin. I am ending up with below error : [error] ( ... works.. Looking for help... See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

907 views

1 answer

scala - How to get SSSP actual path by apache spark graphX?

I have ran the single source shortest path (SSSP) example on spark site as follows: graphx-SSSP pregel example ... hint? Thanks for your help! See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

845 views

1 answer

scala - Basic usage of Dispatch 0.9

I want to POST to a URL, setting query parameters and headers and passing a raw string in the body. I then want to ... 200, 301, 302, 400, 500). See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

653 views

1 answer

scala - UnsatisfiedLinkError: no snappyjava in java.library.path when running Spark MLLib Unit test within Intellij

The following exception is occurring when running a spark unit test that requires snappy compression: java.lang.reflect. ... to fix the issue? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

687 views

1 answer

scala - UnsatisfiedLinkError: no snappyjava in java.library.path when running Spark MLLib Unit test within Intellij

The following exception is occurring when running a spark unit test that requires snappy compression: java.lang.reflect. ... to fix the issue? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

754 views

1 answer

scala - Basic usage of Dispatch 0.9

I want to POST to a URL, setting query parameters and headers and passing a raw string in the body. I then want to ... 200, 301, 302, 400, 500). See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

809 views

1 answer

scala - UnsatisfiedLinkError: no snappyjava in java.library.path when running Spark MLLib Unit test within Intellij

The following exception is occurring when running a spark unit test that requires snappy compression: java.lang.reflect. ... to fix the issue? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

920 views

1 answer

scala - How to force SBT to use Java 8?

How can I force SBT to compile to Java 8 class files. I added scalacOptions += "-target:jvm-1.8" but it ... is required for this project.") } See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.2k views

1 answer

scala - Spark Dataframe write to kafka topic in avro format?

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

817 views

1 answer

scala - How to encode categorical features in Apache Spark

I have a set of data based on which I want to create a classification model. Each row has the following form: user1,class1 ... (id , cl , vs) } See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

859 views

1 answer

scala - DeDuplication error with SBT assembly plugin

I am trying to create an executable jar using SBT assembly plugin. I am ending up with below error : [error] ( ... works.. Looking for help... See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.1k views

1 answer

scala - How to get SSSP actual path by apache spark graphX?

I have ran the single source shortest path (SSSP) example on spark site as follows: graphx-SSSP pregel example ... hint? Thanks for your help! See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

780 views

1 answer

scala - Basic usage of Dispatch 0.9

I want to POST to a URL, setting query parameters and headers and passing a raw string in the body. I then want to ... 200, 301, 302, 400, 500). See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

729 views

1 answer

scala - UnsatisfiedLinkError: no snappyjava in java.library.path when running Spark MLLib Unit test within Intellij

The following exception is occurring when running a spark unit test that requires snappy compression: java.lang.reflect. ... to fix the issue? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

702 views

1 answer

scala - Why prefer Typeclass over Inheritance?

According to this Erik Osheim's slide, he says the inheritance can solve the same problem as typeclass would, but ... , am I missing something? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

946 views

1 answer

scala - Intellij sbt sbt-native-packager and enablePlugins error

I have an sbt build that works when I run from the command line, but that Intellij does not like. My Intellij is ... -patch" version := "1.0" See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

898 views

1 answer

scala - How to programmatically ignore/skip tests with ScalaTest?

I am running some tests with ScalaTest which rely on connections to test servers to be present. I currently ... How should I accomplish this? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

851 views

1 answer

scala - How to "negative select" columns in spark's dataframe

I can't figure it out, but guess it's simple. I have a spark dataframe df. This df has columns "A","B" ... Seq[String]). What am I doing wrong? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

892 views

1 answer

scala - (run-main-0) java.lang.NoSuchMethodError

I got a problem when I used sbt to run a spark job, I have finish compile, but when I run the command run ... ) Anyone knows what should I do? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

890 views

1 answer

scala - on demand actor get or else create

I can create actors with actorOf and look them with actorFor. I now want to get an actor by some id:String ... .asInstanceOf[ActorRef] } ... } See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

894 views

1 answer

scala - Why Some(null) isn't considered None?

I am curious: scala> Some(null) == None res10: Boolean = false Why isn't Some(null) transformed to None? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

852 views

1 answer

scala - How can I get the name of an Akka actor from within the actor itself?

So, if I have an actor, I can give it a name. But, can I access that name internally? Example: class ... docs didn't seem to have anything. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

857 views

1 answer

scala - Reading from Cassandra using Spark Streaming

I have a problem when i use spark streaming to read from Cassandra. https://github.com/datastax/spark-cassandra- ... ssc.awaitTermination() } } See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

993 views

1 answer

scala - instantiate object with reflection using constructor arguments

I'm trying to figure out how to instantiate a case class object with reflection. Is there any support for ... Any help would be appreciated. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

857 views

1 answer

scala - selecting a range of elements in an array spark sql

I use spark-shell to do the below operations. Recently loaded a table with an array column in spark-sql . ... the array in spark-sql. Thanks See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

907 views

1 answer

scala - Using Spark UDFs with struct sequences

Given a dataframe in which one column is a sequence of structs generated by the following sequence val df = ... the DataFrame API if possible. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

Categories

Just Browsing Browsing

Most popular tags