Skip to content

Commit 238ee4a

Browse files
IgGusevsk0x50
authored andcommitted
IGNITE-17772 Updated new spark doc. Fixes #180
Signed-off-by: Slava Koptilin <slava.koptilin@gmail.com>
1 parent 765f0e2 commit 238ee4a

1 file changed

Lines changed: 18 additions & 23 deletions

File tree

docs/_docs/spark-3.2/spark-3.2.adoc

Lines changed: 18 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -14,12 +14,12 @@
1414
// limitations under the License.
1515
= Using Spark with Apache Ignite
1616

17-
This spark module provides an implementation of Spark RDD abstraction which enables easy access to Ignite caches.
17+
This module provides an implementation of Spark RDD abstraction, providing access to Ignite caches from your Spark project.
1818

19-
To use Ignite Spark-3.2 module
19+
== Using Spark 3.2 Integration
2020

21-
. Import it to your Maven project. If you are using Maven to manage dependencies of your project, you can add an Ignite
22-
Spark-3.2 module dependency like this (replace `${ignite-spark-3.2-ext.version}` with actual Ignite Spark-3.2 Extension version you are interested in):
21+
. Import the extension to your Maven project. If you are using Maven to manage dependencies of your project, you can add an Ignite
22+
Spark-3.2 module dependency in the following way (replace `${ignite-spark-3.2-ext.version}` with actual Ignite Spark-3.2 Extension version you are interested in):
2323
+
2424
[tabs]
2525
--
@@ -45,14 +45,10 @@ tab:pom.xml[]
4545
----
4646
--
4747

48-
. Make sure that all required libraries are presented in the classpath
49-
when run the application using the spark-submit command or add them to your POM file.
48+
. Make sure that all required libraries are present in the classpath
49+
if you run the application by using the spark-submit command, or add them to your POM file:
5050

51-
Versions:
52-
53-
* `${scala-version}` -- 2.12
54-
* `${spark-version}` -- 3.2
55-
* `${ignite-versions}` -- the version of Apache Ignite that you use
51+
NOTE: We support any minor version of Scala 2.12, Spark 3.2 and all versions of Apache Ignite.
5652

5753
tab:pom.xml[]
5854
[source,xml]
@@ -63,67 +59,66 @@ tab:pom.xml[]
6359
<dependency>
6460
<groupId>org.scala-lang</groupId>
6561
<artifactId>scala-library</artifactId>
66-
<version>${scala-version}</version>
67-
</dependency>
62+
<version>{scala-version}</dependency>
6863
6964
<dependency>
7065
<groupId>org.scala-lang</groupId>
7166
<artifactId>scala-reflect</artifactId>
72-
<version>${scala-version}</version>
67+
<version>{scala-version}</version>
7368
</dependency>
7469
7570
<dependency>
7671
<groupId>org.apache.ignite</groupId>
7772
<artifactId>ignite-core</artifactId>
78-
<version>${ignite-version}</version>
73+
<version>{ignite-version}</version>
7974
</dependency>
8075
8176
<dependency>
8277
<groupId>org.apache.ignite</groupId>
8378
<artifactId>ignite-indexing</artifactId>
84-
<version>${ignite-version}</version>
79+
<version>{ignite-version}</version>
8580
</dependency>
8681
8782
<dependency>
8883
<groupId>org.apache.ignite</groupId>
8984
<artifactId>ignite-spring</artifactId>
90-
<version>${ignite-version}</version>
85+
<version>{ignite-version}</version>
9186
</dependency>
9287
9388
<dependency>
9489
<groupId>org.apache.spark</groupId>
9590
<artifactId>spark-core_2.12</artifactId>
96-
<version>${spark.version}</version>
91+
<version>{spark-version}</version>
9792
</dependency>
9893
9994
<dependency>
10095
<groupId>org.apache.spark</groupId>
10196
<artifactId>spark-catalyst_2.12</artifactId>
102-
<version>${spark.version}</version>
97+
<version>{spark-version}</version>
10398
</dependency>
10499
105100
<dependency>
106101
<groupId>org.apache.spark</groupId>
107102
<artifactId>spark-sql_2.12</artifactId>
108-
<version>${spark.version}</version>
103+
<version>{spark-version}</version>
109104
</dependency>
110105
111106
<dependency>
112107
<groupId>org.apache.spark</groupId>
113108
<artifactId>spark-network-common_2.12</artifactId>
114-
<version>${spark.version}</version>
109+
<version>{spark-version}</version>
115110
</dependency>
116111
117112
<dependency>
118113
<groupId>org.apache.spark</groupId>
119114
<artifactId>spark-network-shuffle_2.12</artifactId>
120-
<version>${spark.version}</version>
115+
<version>{spark-version}</version>
121116
</dependency>
122117
123118
<dependency>
124119
<groupId>org.apache.spark</groupId>
125120
<artifactId>spark-tags_2.12</artifactId>
126-
<version>${spark.version}</version>
121+
<version>{spark-version}</version>
127122
</dependency>
128123
...
129124
</dependencies>

0 commit comments

Comments
 (0)