错误：scalac：错误的符号引用。 SQLContext.class中的签名是指org.apache.spark包中的Logging类型，它不可用

本文介绍了错误：scalac：错误的符号引用。 SQLContext.class中的签名是指org.apache.spark包中的Logging类型，它不可用的处理方法，对大家解决问题具有一定的参考价值，需要的朋友们下面随着小编来一起学习吧！ 问题描述

当我编译使用IntelliJ IDEA的scala文件时，显示以下错误。

When I complied a scala file used IntelliJ IDEA, the following error showed.

错误：scalac：错误的符号引用。 SQLContext.class中的签名是指org.apache.spark包中的Logging类型，它不可用。 当前类路径可能完全丢失，或者上的版本，类路径可能与编译SQLContext.class时使用的版本不兼容。

注意：将spark-sql添加到pom.xml文件时发生错误。这是版本问题吗？

Attention: the error happened when I add the spark-sql into the pom.xml file. Is it the version problem?

我的pom.xml是：

my pom.xml is：

<?xml version="1.0" encoding="UTF-8"?> <project xmlns="maven.apache/POM/4.0.0" xmlns:xsi="www.w3/2001/XMLSchema-instance" xsi:schemaLocation="maven.apache/POM/4.0.0 maven.apache/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>cn.zhangyitian.spark</groupId> <artifactId>sparkProject2</artifactId> <version>1.0-SNAPSHOT</version> <properties> <java.version>1.8</java.version> <scala.binary.version>2.10</scala.binary.version> </properties> <dependencies> <!-- mvnrepository/artifact/org.apache.spark/spark-core_2.10 --> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.10</artifactId> <version>2.1.0</version> </dependency> <!-- mvnrepository/artifact/org.apache.spark/spark-sql_2.10 --> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-sql_2.10</artifactId> <version>1.6.2</version> </dependency> <!-- mvnrepository/artifact/org.apache.spark/spark-hive_2.10 --> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-hive_2.10</artifactId> <version>1.6.2</version> </dependency> <!-- mvnrepository/artifact/mysql/mysql-connector-java --> <dependency> <groupId>mysql</groupId> <artifactId>mysql-connector-java</artifactId> <version>5.1.6</version> </dependency> <!-- mvnrepository/artifact/net.sf.opencsv/opencsv --> <dependency> <groupId>net.sf.opencsv</groupId> <artifactId>opencsv</artifactId> <version>2.3</version> </dependency> <!-- mvnrepository/artifact/com.fasterxml.jackson.core/jackson-core --> <dependency> <groupId>com.fasterxml.jackson.core</groupId> <artifactId>jackson-core</artifactId> <version>2.8.8</version> </dependency> <!-- mvnrepository/artifact/org.eclipse.jetty/jetty-client --> <dependency> <groupId>org.eclipse.jetty</groupId> <artifactId>jetty-client</artifactId> <version>8.1.4.v20120524</version> </dependency> <dependency> <groupId>org.scalatest</groupId> <artifactId>scalatest_${scala.binary.version}</artifactId> <version>2.2.1</version> </dependency> <dependency> <groupId>org.scala-lang</groupId> <artifactId>scala-compiler</artifactId> <version>2.10.6</version> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-streaming_2.10</artifactId> <version>1.6.0</version> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-client</artifactId> <version>2.6.0</version> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-streaming-kafka_2.10</artifactId> <version>1.6.0</version> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-graphx_2.10</artifactId> <version>1.6.0</version> </dependency> <!-- mvnrepository/artifact/org.apache.hadoop/hadoop-common --> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-common</artifactId> <version>2.6.4</version> </dependency> </dependencies> <build> <pluginManagement> <plugins> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <version>3.1</version> <configuration> <source>${java.version}</source> <target>${java.version}</target> </configuration> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-assembly-plugin</artifactId> <version>2.2.2</version> <!-- The configuration of the plugin --> <configuration> <!-- Specifies the configuration file of the assembly plugin --> <descriptors> <descriptor>src/main/assembly/assembly.xml</descriptor> </descriptors> </configuration> </plugin> </plugins> </pluginManagement> </build>

推荐答案

请为所有依赖项使用相同版本的spark。

Please use the same version of spark for all the dependencies.

<dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.10</artifactId> <version>2.1.0</version> </dependency>

将此替换为

<dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.10</artifactId> <version>1.6.2</version> </dependency>

或者你可以使用 Spark 2.1.0 在所有依赖项中

Or you can use Spark 2.1.0 in all dependencies