Apache License

Version 2.0, January 2004

http://www.apache.org/licenses/

TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION

1. Definitions.

"License" shall mean the terms and conditions for use, reproduction,

and distribution as defined by Sections 1 through 9 of this document.

"Licensor" shall mean the copyright owner or entity authorized by

the copyright owner that is granting the License.

"Legal Entity" shall mean the union of the acting entity and all

other entities that control, are controlled by, or are under common

control with that entity. For the purposes of this definition,

"control" means (i) the power, direct or indirect, to cause the

direction or management of such entity, whether by contract or

otherwise, or (ii) ownership of fifty percent (50%) or more of the

outstanding shares, or (iii) beneficial ownership of such entity.

"You" (or "Your") shall mean an individual or Legal Entity

exercising permissions granted by this License.

"Source" form shall mean the preferred form for making modifications,

including but not limited to software source code, documentation

source, and configuration files.

"Object" form shall mean any form resulting from mechanical

transformation or translation of a Source form, including but

not limited to compiled object code, generated documentation,

and conversions to other media types.

"Work" shall mean the work of authorship, whether in Source or

Object form, made available under the License, as indicated by a

copyright notice that is included in or attached to the work

(an example is provided in the Appendix below).

"Derivative Works" shall mean any work, whether in Source or Object

form, that is based on (or derived from) the Work and for which the

editorial revisions, annotations, elaborations, or other modifications

represent, as a whole, an original work of authorship. For the purposes

of this License, Derivative Works shall not include works that remain

separable from, or merely link (or bind by name) to the interfaces of,

the Work and Derivative Works thereof.

"Contribution" shall mean any work of authorship, including

the original version of the Work and any modifications or additions

to that Work or Derivative Works thereof, that is intentionally

submitted to Licensor for inclusion in the Work by the copyright owner

or by an individual or Legal Entity authorized to submit on behalf of

the copyright owner. For the purposes of this definition, "submitted"

means any form of electronic, verbal, or written communication sent

to the Licensor or its representatives, including but not limited to

communication on electronic mailing lists, source code control systems,

and issue tracking systems that are managed by, or on behalf of, the

Licensor for the purpose of discussing and improving the Work, but

excluding communication that is conspicuously marked or otherwise

designated in writing by the copyright owner as "Not a Contribution."

"Contributor" shall mean Licensor and any individual or Legal Entity

on behalf of whom a Contribution has been received by Licensor and

subsequently incorporated within the Work.

2. Grant of Copyright License. Subject to the terms and conditions of

this License, each Contributor hereby grants to You a perpetual,

worldwide, non-exclusive, no-charge, royalty-free, irrevocable

copyright license to reproduce, prepare Derivative Works of,

publicly display, publicly perform, sublicense, and distribute the

Work and such Derivative Works in Source or Object form.

3. Grant of Patent License. Subject to the terms and conditions of

this License, each Contributor hereby grants to You a perpetual,

worldwide, non-exclusive, no-charge, royalty-free, irrevocable

(except as stated in this section) patent license to make, have made,

use, offer to sell, sell, import, and otherwise transfer the Work,

where such license applies only to those patent claims licensable

by such Contributor that are necessarily infringed by their

Contribution(s) alone or by combination of their Contribution(s)

with the Work to which such Contribution(s) was submitted. If You

institute patent litigation against any entity (including a

cross-claim or counterclaim in a lawsuit) alleging that the Work

or a Contribution incorporated within the Work constitutes direct

or contributory patent infringement, then any patent licenses

granted to You under this License for that Work shall terminate

as of the date such litigation is filed.

4. Redistribution. You may reproduce and distribute copies of the

Work or Derivative Works thereof in any medium, with or without

modifications, and in Source or Object form, provided that You

meet the following conditions:

(a) You must give any other recipients of the Work or

Derivative Works a copy of this License; and

(b) You must cause any modified files to carry prominent notices

stating that You changed the files; and

(c) You must retain, in the Source form of any Derivative Works

that You distribute, all copyright, patent, trademark, and

attribution notices from the Source form of the Work,

excluding those notices that do not pertain to any part of

the Derivative Works; and

(d) If the Work includes a "NOTICE" text file as part of its

distribution, then any Derivative Works that You distribute must

include a readable copy of the attribution notices contained

within such NOTICE file, excluding those notices that do not

pertain to any part of the Derivative Works, in at least one

of the following places: within a NOTICE text file distributed

as part of the Derivative Works; within the Source form or

documentation, if provided along with the Derivative Works; or,

within a display generated by the Derivative Works, if and

wherever such third-party notices normally appear. The contents

of the NOTICE file are for informational purposes only and

do not modify the License. You may add Your own attribution

notices within Derivative Works that You distribute, alongside

or as an addendum to the NOTICE text from the Work, provided

that such additional attribution notices cannot be construed

as modifying the License.

You may add Your own copyright statement to Your modifications and

may provide additional or different license terms and conditions

for use, reproduction, or distribution of Your modifications, or

for any such Derivative Works as a whole, provided Your use,

reproduction, and distribution of the Work otherwise complies with

the conditions stated in this License.

5. Submission of Contributions. Unless You explicitly state otherwise,

any Contribution intentionally submitted for inclusion in the Work

by You to the Licensor shall be under the terms and conditions of

this License, without any additional terms or conditions.

Notwithstanding the above, nothing herein shall supersede or modify

the terms of any separate license agreement you may have executed

with Licensor regarding such Contributions.

6. Trademarks. This License does not grant permission to use the trade

names, trademarks, service marks, or product names of the Licensor,

except as required for reasonable and customary use in describing the

origin of the Work and reproducing the content of the NOTICE file.

7. Disclaimer of Warranty. Unless required by applicable law or

agreed to in writing, Licensor provides the Work (and each

Contributor provides its Contributions) on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or

implied, including, without limitation, any warranties or conditions

of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A

PARTICULAR PURPOSE. You are solely responsible for determining the

appropriateness of using or redistributing the Work and assume any

risks associated with Your exercise of permissions under this License.

8. Limitation of Liability. In no event and under no legal theory,

whether in tort (including negligence), contract, or otherwise,

unless required by applicable law (such as deliberate and grossly

negligent acts) or agreed to in writing, shall any Contributor be

liable to You for damages, including any direct, indirect, special,

incidental, or consequential damages of any character arising as a

result of this License or out of the use or inability to use the

Work (including but not limited to damages for loss of goodwill,

work stoppage, computer failure or malfunction, or any and all

other commercial damages or losses), even if such Contributor

has been advised of the possibility of such damages.

9. Accepting Warranty or Additional Liability. While redistributing

the Work or Derivative Works thereof, You may choose to offer,

and charge a fee for, acceptance of support, warranty, indemnity,

or other liability obligations and/or rights consistent with this

License. However, in accepting such obligations, You may act only

on Your own behalf and on Your sole responsibility, not on behalf

of any other Contributor, and only if You agree to indemnify,

defend, and hold each Contributor harmless for any liability

incurred by, or claims asserted against, such Contributor by reason

of your accepting any such warranty or additional liability.

END OF TERMS AND CONDITIONS

APPENDIX: How to apply the Apache License to your work.

To apply the Apache License to your work, attach the following

boilerplate notice, with the fields enclosed by brackets "[]"

replaced with your own identifying information. (Don't include

the brackets!) The text should be enclosed in the appropriate

comment syntax for the file format. We also recommend that a

file or class name and description of purpose be included on the

same "printed page" as the copyright notice for easier

identification within third-party archives.

Copyright [yyyy] [name of copyright owner]

Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License.

------------------------------------------------------------------------------------

This project bundles some components that are also licensed under the Apache

License Version 2.0:

at.yawk.lz4:lz4-java

com.clearspring.analytics:stream

com.fasterxml.jackson.core:jackson-annotations

com.fasterxml.jackson.core:jackson-core

com.fasterxml.jackson.core:jackson-databind

com.fasterxml.jackson.dataformat:jackson-dataformat-yaml

com.fasterxml.jackson.datatype:jackson-datatype-jsr310

com.fasterxml.jackson.module:jackson-module-scala_2.13

com.github.joshelser:dropwizard-metrics-hadoop-metrics2-reporter

com.google.code.findbugs:jsr305

com.google.code.gson:gson

com.google.crypto.tink:tink

com.google.flatbuffers:flatbuffers-java

com.google.guava:guava

com.jamesmurty.utils:java-xmlbuilder

com.ning:compress-lzf

com.squareup.okhttp3:okhttp

com.squareup.okio:okio

com.tdunning:json

com.twitter:chill-java

com.twitter:chill_2.13

com.univocity:univocity-parsers

com.zaxxer:HikariCP

commons-cli:commons-cli

commons-codec:commons-codec

commons-dbcp:commons-dbcp

commons-io:commons-io

commons-lang:commons-lang

commons-pool:commons-pool

io.airlift:aircompressor

io.dropwizard.metrics:metrics-core

io.dropwizard.metrics:metrics-graphite

io.dropwizard.metrics:metrics-jmx

io.dropwizard.metrics:metrics-json

io.dropwizard.metrics:metrics-jvm

io.fabric8:kubernetes-client

io.fabric8:kubernetes-client-api

io.fabric8:kubernetes-httpclient-vertx

io.fabric8:kubernetes-model-admissionregistration

io.fabric8:kubernetes-model-apiextensions

io.fabric8:kubernetes-model-apps

io.fabric8:kubernetes-model-autoscaling

io.fabric8:kubernetes-model-batch

io.fabric8:kubernetes-model-certificates

io.fabric8:kubernetes-model-common

io.fabric8:kubernetes-model-coordination

io.fabric8:kubernetes-model-core

io.fabric8:kubernetes-model-discovery

io.fabric8:kubernetes-model-events

io.fabric8:kubernetes-model-extensions

io.fabric8:kubernetes-model-flowcontrol

io.fabric8:kubernetes-model-gatewayapi

io.fabric8:kubernetes-model-metrics

io.fabric8:kubernetes-model-networking

io.fabric8:kubernetes-model-node

io.fabric8:kubernetes-model-policy

io.fabric8:kubernetes-model-rbac

io.fabric8:kubernetes-model-resource

io.fabric8:kubernetes-model-scheduling

io.fabric8:kubernetes-model-storageclass

io.fabric8:volcano-client

io.fabric8:volcano-model

io.fabric8:zjsonpatch

io.github.java-diff-utils:java-diff-utils

io.jsonwebtoken:jjwt-api

io.jsonwebtoken:jjwt-impl

io.jsonwebtoken:jjwt-jackson

io.netty:netty-all

io.netty:netty-buffer

io.netty:netty-codec

io.netty:netty-codec-base

io.netty:netty-codec-compression

io.netty:netty-codec-dns

io.netty:netty-codec-http

io.netty:netty-codec-http2

io.netty:netty-codec-socks

io.netty:netty-common

io.netty:netty-handler

io.netty:netty-handler-proxy

io.netty:netty-resolver

io.netty:netty-resolver-dns

io.netty:netty-tcnative-boringssl-static

io.netty:netty-tcnative-classes

io.netty:netty-transport

io.netty:netty-transport-classes-epoll

io.netty:netty-transport-classes-kqueue

io.netty:netty-transport-native-epoll

io.netty:netty-transport-native-kqueue

io.netty:netty-transport-native-unix-common

io.vertx:vertx-auth-common

io.vertx:vertx-core

io.vertx:vertx-web-client

io.vertx:vertx-web-common

jakarta.inject:jakarta.inject-api

jakarta.validation:jakarta.validation-api

javax.jdo:jdo-api

joda-time:joda-time

net.sf.opencsv:opencsv

net.sf.supercsv:super-csv

net.sf.jpam:jpam

org.apache.arrow:arrow-compression

org.apache.arrow:arrow-format

org.apache.arrow:arrow-memory-core

org.apache.arrow:arrow-memory-netty

org.apache.arrow:arrow-memory-netty-buffer-patch

org.apache.arrow:arrow-vector

org.apache.avro:avro

org.apache.avro:avro-ipc

org.apache.avro:avro-mapred

org.apache.commons:commons-collections4

org.apache.commons:commons-compress

org.apache.commons:commons-crypto

org.apache.commons:commons-lang3

org.apache.commons:commons-math3

org.apache.commons:commons-text

org.apache.curator:curator-client

org.apache.curator:curator-framework

org.apache.curator:curator-recipes

org.apache.derby:derby

org.apache.derby:derbyshared

org.apache.derby:derbytools

org.apache.datasketches:datasketches-java

org.apache.datasketches:datasketches-memory

org.apache.hadoop:hadoop-client-api

org.apache.hadoop:hadoop-client-runtime

org.apache.hive:hive-beeline

org.apache.hive:hive-cli

org.apache.hive:hive-common

org.apache.hive:hive-exec

org.apache.hive:hive-jdbc

org.apache.hive:hive-metastore

org.apache.hive:hive-serde

org.apache.hive:hive-service-rpc

org.apache.hive:hive-shims-0.23

org.apache.hive:hive-shims

org.apache.hive:hive-shims-common

org.apache.hive:hive-shims-scheduler

org.apache.hive:hive-storage-api

org.apache.httpcomponents:httpclient

org.apache.httpcomponents:httpcore

org.apache.ivy:ivy

org.apache.logging.log4j:log4j-1.2-api

org.apache.logging.log4j:log4j-api

org.apache.logging.log4j:log4j-core

org.apache.logging.log4j:log4j-layout-template-json

org.apache.logging.log4j:log4j-slf4j2-impl

org.apache.orc:orc-core

org.apache.orc:orc-format

org.apache.orc:orc-mapreduce

org.apache.orc:orc-shims

org.apache.parquet:parquet-column

org.apache.parquet:parquet-common

org.apache.parquet:parquet-encoding

org.apache.parquet:parquet-format-structures

org.apache.parquet:parquet-hadoop

org.apache.parquet:parquet-jackson

org.apache.thrift:libfb303

org.apache.thrift:libthrift

org.apache.ws.xmlschema:xmlschema-core

org.apache.xbean:xbean-asm9-shaded

org.apache.yetus:audience-annotations

org.apache.zookeeper:zookeeper

org.apache.zookeeper:zookeeper-jute

org.datanucleus:datanucleus-api-jdo

org.datanucleus:datanucleus-core

org.datanucleus:datanucleus-rdbms

org.datanucleus:javax.jdo

org.eclipse.jetty:jetty-client

org.eclipse.jetty:jetty-http

org.eclipse.jetty:jetty-io

org.eclipse.jetty:jetty-plus

org.eclipse.jetty:jetty-proxy

org.eclipse.jetty:jetty-security

org.eclipse.jetty:jetty-server

org.eclipse.jetty:jetty-servlet

org.eclipse.jetty:jetty-servlets

org.eclipse.jetty:jetty-util

org.glassfish.jersey.containers:jersey-container-servlet

org.glassfish.jersey.containers:jersey-container-servlet-core

org.glassfish.jersey.core:jersey-client

org.glassfish.jersey.core:jersey-common

org.glassfish.jersey.core:jersey-server

org.glassfish.jersey.inject:jersey-hk2

org.javassist:javassist

org.json4s:json4s-ast_2.13

org.json4s:json4s-core_2.13

org.json4s:json4s-jackson-core_2.13

org.json4s:json4s-jackson_2.13

org.json4s:json4s-scalap_2.13

org.objenesis:objenesis

org.roaringbitmap:RoaringBitmap

org.rocksdb:rocksdbjni

org.scala-lang:scala-compiler

org.scala-lang:scala-library

org.scala-lang:scala-reflect

org.scala-lang.modules:scala-parallel-collections_2.13

org.scala-lang.modules:scala-parser-combinators_2.13

org.scala-lang.modules:scala-xml_2.13

org.scalanlp:breeze-macros_2.13

org.scalanlp:breeze_2.13

org.snakeyaml:snakeyaml-engine

org.xerial.snappy:snappy-java

org.yaml:snakeyaml

oro:oro

core/src/main/java/org/apache/spark/util/collection/TimSort.java

core/src/main/resources/org/apache/spark/ui/static/bootstrap*

core/src/main/resources/org/apache/spark/ui/static/vis*

core/src/main/resources/org/apache/spark/ui/static/d3-flamegraph.min.js

core/src/main/resources/org/apache/spark/ui/static/d3-flamegraph.css

------------------------------------------------------------------------------------

This product bundles various third-party components under other open source licenses.

This section summarizes those components and their licenses. See licenses-binary/

for text of these licenses.

Python Software Foundation License

----------------------------------

python/pyspark/loose_version.py

BSD 0-Clause

------------

org.tukaani:xz

BSD 2-Clause

------------

com.github.luben:zstd-jni

com.github.wendykierp:JTransforms

javolution:javolution

jline:jline

pl.edu.icm:JLargeArrays

python/pyspark/errors/exceptions/tblib.py

BSD 3-Clause

------------

com.esotericsoftware:kryo-shaded

com.esotericsoftware:minlog

com.esotericsoftware:reflectasm

com.google.protobuf:protobuf-java

com.thoughtworks.paranamer:paranamer

net.sf.py4j:py4j

net.sourceforge.f2j:arpack_combined_all

org.antlr:ST4

org.antlr:antlr-runtime

org.antlr:antlr4-runtime

org.codehaus.janino:commons-compiler

org.codehaus.janino:janino

org.fusesource.leveldbjni:leveldbjni-all

org.jline:jline

org.jpmml:pmml-model

org.locationtech.jts:jts-core

org.threeten:threeten-extra

python/lib/py4j-*-src.zip

python/pyspark/cloudpickle.py

python/pyspark/join.py

The CSS style for the navigation sidebar of the documentation was originally

submitted by Óscar Nájera for the scikit-learn project. The scikit-learn project

is distributed under the 3-Clause BSD license.

MIT License

-----------

com.github.scopt:scopt_2.13

dev.ludovic.netlib:blas

dev.ludovic.netlib:arpack

dev.ludovic.netlib:lapack

net.razorvine:pickle

org.typelevel:algebra_2.13:jar

org.typelevel:cats-kernel_2.13

org.typelevel:spire_2.13

org.typelevel:spire-macros_2.13

org.typelevel:spire-platform_2.13

org.typelevel:spire-util_2.13

org.slf4j:jcl-over-slf4j

org.slf4j:jul-to-slf4j

org.slf4j:slf4j-api

core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js

core/src/main/resources/org/apache/spark/ui/static/*dataTables*

core/src/main/resources/org/apache/spark/ui/static/graphlib-dot.min.js

core/src/main/resources/org/apache/spark/ui/static/jquery*

core/src/main/resources/org/apache/spark/ui/static/sorttable.js

ISC License

-----------

core/src/main/resources/org/apache/spark/ui/static/d3.min.js

Common Development and Distribution License (CDDL) 1.0

------------------------------------------------------

javax.transaction:transaction-api

Common Development and Distribution License (CDDL) 1.1

------------------------------------------------------

javax.transaction:jta http://www.oracle.com/technetwork/java/index.html

javax.servlet:javax.servlet-api https://oss.oracle.com/licenses/CDDL+GPL-1.1

Eclipse Distribution License (EDL) 1.0

--------------------------------------

com.sun.istack:istack-commons-runtime

jakarta.activation:jakarta.activation-api

jakarta.xml.bind:jakarta.xml.bind-api

org.glassfish.jaxb:jaxb-core

org.glassfish.jaxb:jaxb-runtime

Eclipse Public License (EPL) 2.0

--------------------------------

jakarta.annotation:jakarta.annotation-api https://projects.eclipse.org/projects/ee4j.ca

jakarta.servlet:jakarta.servlet-api https://projects.eclipse.org/projects/ee4j.servlet

jakarta.ws.rs:jakarta.ws.rs-api https://github.com/eclipse-ee4j/jaxrs-api

org.glassfish.hk2.external:aopalliance-repackaged

org.glassfish.hk2:hk2-api

org.glassfish.hk2:hk2-locator

org.glassfish.hk2:hk2-utils

org.glassfish.hk2:osgi-resource-locator

Creative Commons CC0 1.0 Universal Public Domain Dedication

-----------------------------------------------------------

(see LICENSE-CC0.txt)

data/mllib/images/kittens/29.5.a_b_EGDP022204.jpg

data/mllib/images/kittens/54893.jpg

data/mllib/images/kittens/DP153539.jpg

data/mllib/images/kittens/DP802813.jpg

data/mllib/images/multi-channel/chr30.4.184.jpg

Unicode/ICU License

-------------------

com.ibm.icu:icu4j