Hadoop Distributed File System - HDFS

The connector offers Flows and Sources that interact with HDFS file systems.

For more information about Hadoop, please visit the Hadoop documentation.

Project Info: Alpakka HDFS
Artifact
com.lightbend.akka
akka-stream-alpakka-hdfs
3.0.4+59-f1dbbcb3-SNAPSHOT
JDK versions
Adopt OpenJDK 8
Adopt OpenJDK 11
Scala versions2.13.8
JPMS module nameakka.stream.alpakka.hdfs
License
Readiness level
Since 0.20, 2018-07-04
Home pagehttps://doc.akka.io/docs/alpakka/current
API documentation
Forums
Release notesGitHub releases
IssuesGithub issues
Sourceshttps://github.com/akka/alpakka

Artifacts

sbt
val AkkaVersion = "2.6.19"
libraryDependencies ++= Seq(
  "com.lightbend.akka" %% "akka-stream-alpakka-hdfs" % "3.0.4+59-f1dbbcb3-SNAPSHOT",
  "com.typesafe.akka" %% "akka-stream" % AkkaVersion
)
Maven
<properties>
  <akka.version>2.6.19</akka.version>
  <scala.binary.version>2.13</scala.binary.version>
</properties>
<dependencies>
  <dependency>
    <groupId>com.lightbend.akka</groupId>
    <artifactId>akka-stream-alpakka-hdfs_${scala.binary.version}</artifactId>
    <version>3.0.4+59-f1dbbcb3-SNAPSHOT</version>
  </dependency>
  <dependency>
    <groupId>com.typesafe.akka</groupId>
    <artifactId>akka-stream_${scala.binary.version}</artifactId>
    <version>${akka.version}</version>
  </dependency>
</dependencies>
Gradle
def versions = [
  AkkaVersion: "2.6.19",
  ScalaBinary: "2.13"
]
dependencies {
  implementation "com.lightbend.akka:akka-stream-alpakka-hdfs_${versions.ScalaBinary}:3.0.4+59-f1dbbcb3-SNAPSHOT"
  implementation "com.typesafe.akka:akka-stream_${versions.ScalaBinary}:${versions.AkkaVersion}"
}

The table below shows direct dependencies of this module and the second tab shows all libraries it depends on transitively.

Direct dependencies
OrganizationArtifactVersion
com.typesafe.akkaakka-stream_2.132.6.19
org.apache.hadoophadoop-client3.2.1
org.scala-langscala-library2.13.8
org.typelevelcats-core_2.132.0.0
Dependency tree
com.typesafe.akka    akka-stream_2.13    2.6.19    Apache-2.0
    com.typesafe.akka    akka-actor_2.13    2.6.19    Apache-2.0
        com.typesafe    config    1.4.2    Apache-2.0
        org.scala-lang.modules    scala-java8-compat_2.13    1.0.0    Apache-2.0
            org.scala-lang    scala-library    2.13.8    Apache-2.0
        org.scala-lang    scala-library    2.13.8    Apache-2.0
    com.typesafe.akka    akka-protobuf-v3_2.13    2.6.19    Apache-2.0
    com.typesafe    ssl-config-core_2.13    0.4.3    Apache-2.0
        com.typesafe    config    1.4.2    Apache-2.0
        org.scala-lang.modules    scala-parser-combinators_2.13    1.1.2    Apache-2.0
            org.scala-lang    scala-library    2.13.8    Apache-2.0
        org.scala-lang    scala-library    2.13.8    Apache-2.0
    org.reactivestreams    reactive-streams    1.0.3    CC0
    org.scala-lang    scala-library    2.13.8    Apache-2.0
org.apache.hadoop    hadoop-client    3.2.1
    org.apache.hadoop    hadoop-annotations    3.2.1
    org.apache.hadoop    hadoop-common    3.2.1
        com.fasterxml.jackson.core    jackson-databind    2.9.8
            com.fasterxml.jackson.core    jackson-annotations    2.9.8
            com.fasterxml.jackson.core    jackson-core    2.9.8
        com.fasterxml.woodstox    woodstox-core    5.0.3    The Apache License, Version 2.0
            org.codehaus.woodstox    stax2-api    3.1.4    The BSD License
        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
        com.google.code.gson    gson    2.2.4    The Apache Software License, Version 2.0
        com.google.guava    guava    27.0-jre
            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
            com.google.guava    failureaccess    1.0
            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
            org.checkerframework    checker-qual    2.5.2    The MIT License
            org.codehaus.mojo    animal-sniffer-annotations    1.17
        com.google.protobuf    protobuf-java    2.5.0    New BSD license
        com.google.re2j    re2j    1.1    The Go license
        com.sun.jersey    jersey-servlet    1.19
            com.sun.jersey    jersey-server    1.19
                com.sun.jersey    jersey-core    1.19
                    javax.ws.rs    jsr311-api    1.1.1    CDDL License
        commons-beanutils    commons-beanutils    1.9.3
            commons-collections    commons-collections    3.2.2
            commons-logging    commons-logging    1.2
        commons-cli    commons-cli    1.2
        commons-codec    commons-codec    1.11
        commons-collections    commons-collections    3.2.2
        commons-io    commons-io    2.5
        commons-logging    commons-logging    1.2
        commons-net    commons-net    3.6
        dnsjava    dnsjava    2.1.7    BSD 2-Clause license
        javax.servlet.jsp    jsp-api    2.1
        org.apache.avro    avro    1.7.7
            com.thoughtworks.paranamer    paranamer    2.3
            org.apache.commons    commons-compress    1.18
            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
            org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
            org.slf4j    slf4j-api    1.7.25
            org.xerial.snappy    snappy-java    1.0.5    The Apache Software License, Version 2.0
        org.apache.commons    commons-compress    1.18
        org.apache.commons    commons-configuration2    2.1.1
            commons-logging    commons-logging    1.2
        org.apache.commons    commons-lang3    3.7
        org.apache.commons    commons-math3    3.1.1
        org.apache.commons    commons-text    1.4
            org.apache.commons    commons-lang3    3.7
        org.apache.curator    curator-client    2.13.0
            com.google.guava    guava    27.0-jre
                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                com.google.guava    failureaccess    1.0
                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                org.checkerframework    checker-qual    2.5.2    The MIT License
                org.codehaus.mojo    animal-sniffer-annotations    1.17
            org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                jline    jline    0.9.94    BSD
                org.apache.yetus    audience-annotations    0.5.0
                org.slf4j    slf4j-api    1.7.25
            org.slf4j    slf4j-api    1.7.25
        org.apache.curator    curator-recipes    2.13.0
            org.apache.curator    curator-framework    2.13.0
                org.apache.curator    curator-client    2.13.0
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                        jline    jline    0.9.94    BSD
                        org.apache.yetus    audience-annotations    0.5.0
                        org.slf4j    slf4j-api    1.7.25
                    org.slf4j    slf4j-api    1.7.25
        org.apache.hadoop    hadoop-annotations    3.2.1
        org.apache.hadoop    hadoop-auth    3.2.1
            com.google.guava    guava    27.0-jre
                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                com.google.guava    failureaccess    1.0
                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                org.checkerframework    checker-qual    2.5.2    The MIT License
                org.codehaus.mojo    animal-sniffer-annotations    1.17
            com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                    net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                        org.ow2.asm    asm    5.0.4
            commons-codec    commons-codec    1.11
            net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                    org.ow2.asm    asm    5.0.4
            org.apache.curator    curator-framework    2.13.0
                org.apache.curator    curator-client    2.13.0
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                        jline    jline    0.9.94    BSD
                        org.apache.yetus    audience-annotations    0.5.0
                        org.slf4j    slf4j-api    1.7.25
                    org.slf4j    slf4j-api    1.7.25
            org.apache.httpcomponents    httpclient    4.5.6
                commons-codec    commons-codec    1.11
                commons-logging    commons-logging    1.2
                org.apache.httpcomponents    httpcore    4.4.10
            org.apache.kerby    kerb-simplekdc    1.0.1
                org.apache.kerby    kerb-admin    1.0.1
                    org.apache.kerby    kerb-server    1.0.1
                        org.apache.kerby    kerb-common    1.0.1
                            commons-io    commons-io    2.5
                            org.apache.kerby    kerb-crypto    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-util    1.0.1
                            org.apache.kerby    kerby-config    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerb-identity    1.0.1
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerby-config    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                    org.apache.kerby    kerb-util    1.0.1
                        org.apache.kerby    kerb-core    1.0.1
                            org.apache.kerby    kerby-pkix    1.0.1
                                org.apache.kerby    kerby-asn1    1.0.1
                                org.apache.kerby    kerby-util    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerb-crypto    1.0.1
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerby-util    1.0.1
                        org.apache.kerby    kerby-config    1.0.1
                            org.slf4j    slf4j-api    1.7.25
                    org.apache.kerby    kerby-xdr    1.0.1
                org.apache.kerby    kerb-client    1.0.1
                    org.apache.kerby    kerb-common    1.0.1
                        commons-io    commons-io    2.5
                        org.apache.kerby    kerb-crypto    1.0.1
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerby-util    1.0.1
                        org.apache.kerby    kerby-config    1.0.1
                            org.slf4j    slf4j-api    1.7.25
                    org.apache.kerby    kerb-core    1.0.1
                        org.apache.kerby    kerby-pkix    1.0.1
                            org.apache.kerby    kerby-asn1    1.0.1
                            org.apache.kerby    kerby-util    1.0.1
                            org.slf4j    slf4j-api    1.7.25
                    org.apache.kerby    kerb-util    1.0.1
                        org.apache.kerby    kerb-core    1.0.1
                            org.apache.kerby    kerby-pkix    1.0.1
                                org.apache.kerby    kerby-asn1    1.0.1
                                org.apache.kerby    kerby-util    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerb-crypto    1.0.1
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerby-util    1.0.1
                        org.apache.kerby    kerby-config    1.0.1
                            org.slf4j    slf4j-api    1.7.25
                    org.apache.kerby    kerby-config    1.0.1
                        org.slf4j    slf4j-api    1.7.25
                    org.apache.kerby    token-provider    1.0.1
                        com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                            com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                            net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                    org.ow2.asm    asm    5.0.4
                        org.apache.kerby    kerb-core    1.0.1
                            org.apache.kerby    kerby-pkix    1.0.1
                                org.apache.kerby    kerby-asn1    1.0.1
                                org.apache.kerby    kerby-util    1.0.1
                                org.slf4j    slf4j-api    1.7.25
            org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                jline    jline    0.9.94    BSD
                org.apache.yetus    audience-annotations    0.5.0
                org.slf4j    slf4j-api    1.7.25
            org.slf4j    slf4j-api    1.7.25
        org.apache.htrace    htrace-core4    4.1.0-incubating
        org.apache.httpcomponents    httpclient    4.5.6
            commons-codec    commons-codec    1.11
            commons-logging    commons-logging    1.2
            org.apache.httpcomponents    httpcore    4.4.10
        org.apache.kerby    kerb-simplekdc    1.0.1
            org.apache.kerby    kerb-admin    1.0.1
                org.apache.kerby    kerb-server    1.0.1
                    org.apache.kerby    kerb-common    1.0.1
                        commons-io    commons-io    2.5
                        org.apache.kerby    kerb-crypto    1.0.1
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerby-util    1.0.1
                        org.apache.kerby    kerby-config    1.0.1
                            org.slf4j    slf4j-api    1.7.25
                    org.apache.kerby    kerb-identity    1.0.1
                        org.apache.kerby    kerb-core    1.0.1
                            org.apache.kerby    kerby-pkix    1.0.1
                                org.apache.kerby    kerby-asn1    1.0.1
                                org.apache.kerby    kerby-util    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerby-config    1.0.1
                            org.slf4j    slf4j-api    1.7.25
                org.apache.kerby    kerb-util    1.0.1
                    org.apache.kerby    kerb-core    1.0.1
                        org.apache.kerby    kerby-pkix    1.0.1
                            org.apache.kerby    kerby-asn1    1.0.1
                            org.apache.kerby    kerby-util    1.0.1
                            org.slf4j    slf4j-api    1.7.25
                    org.apache.kerby    kerb-crypto    1.0.1
                        org.apache.kerby    kerb-core    1.0.1
                            org.apache.kerby    kerby-pkix    1.0.1
                                org.apache.kerby    kerby-asn1    1.0.1
                                org.apache.kerby    kerby-util    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerby-util    1.0.1
                    org.apache.kerby    kerby-config    1.0.1
                        org.slf4j    slf4j-api    1.7.25
                org.apache.kerby    kerby-xdr    1.0.1
            org.apache.kerby    kerb-client    1.0.1
                org.apache.kerby    kerb-common    1.0.1
                    commons-io    commons-io    2.5
                    org.apache.kerby    kerb-crypto    1.0.1
                        org.apache.kerby    kerb-core    1.0.1
                            org.apache.kerby    kerby-pkix    1.0.1
                                org.apache.kerby    kerby-asn1    1.0.1
                                org.apache.kerby    kerby-util    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerby-util    1.0.1
                    org.apache.kerby    kerby-config    1.0.1
                        org.slf4j    slf4j-api    1.7.25
                org.apache.kerby    kerb-core    1.0.1
                    org.apache.kerby    kerby-pkix    1.0.1
                        org.apache.kerby    kerby-asn1    1.0.1
                        org.apache.kerby    kerby-util    1.0.1
                        org.slf4j    slf4j-api    1.7.25
                org.apache.kerby    kerb-util    1.0.1
                    org.apache.kerby    kerb-core    1.0.1
                        org.apache.kerby    kerby-pkix    1.0.1
                            org.apache.kerby    kerby-asn1    1.0.1
                            org.apache.kerby    kerby-util    1.0.1
                            org.slf4j    slf4j-api    1.7.25
                    org.apache.kerby    kerb-crypto    1.0.1
                        org.apache.kerby    kerb-core    1.0.1
                            org.apache.kerby    kerby-pkix    1.0.1
                                org.apache.kerby    kerby-asn1    1.0.1
                                org.apache.kerby    kerby-util    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerby-util    1.0.1
                    org.apache.kerby    kerby-config    1.0.1
                        org.slf4j    slf4j-api    1.7.25
                org.apache.kerby    kerby-config    1.0.1
                    org.slf4j    slf4j-api    1.7.25
                org.apache.kerby    token-provider    1.0.1
                    com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                        com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                        net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                            net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                org.ow2.asm    asm    5.0.4
                    org.apache.kerby    kerb-core    1.0.1
                        org.apache.kerby    kerby-pkix    1.0.1
                            org.apache.kerby    kerby-asn1    1.0.1
                            org.apache.kerby    kerby-util    1.0.1
                            org.slf4j    slf4j-api    1.7.25
        org.codehaus.woodstox    stax2-api    3.1.4    The BSD License
        org.eclipse.jetty    jetty-servlet    9.3.24.v20180605
            org.eclipse.jetty    jetty-security    9.3.24.v20180605
        org.eclipse.jetty    jetty-webapp    9.3.24.v20180605
            org.eclipse.jetty    jetty-servlet    9.3.24.v20180605
                org.eclipse.jetty    jetty-security    9.3.24.v20180605
            org.eclipse.jetty    jetty-xml    9.3.24.v20180605
        org.slf4j    slf4j-api    1.7.25
    org.apache.hadoop    hadoop-hdfs-client    3.2.1
        com.fasterxml.jackson.core    jackson-annotations    2.9.8
        com.fasterxml.jackson.core    jackson-databind    2.9.8
            com.fasterxml.jackson.core    jackson-annotations    2.9.8
            com.fasterxml.jackson.core    jackson-core    2.9.8
        com.squareup.okhttp    okhttp    2.7.5
            com.squareup.okio    okio    1.6.0
    org.apache.hadoop    hadoop-mapreduce-client-core    3.2.1
        com.fasterxml.jackson.core    jackson-databind    2.9.8
            com.fasterxml.jackson.core    jackson-annotations    2.9.8
            com.fasterxml.jackson.core    jackson-core    2.9.8
        com.google.protobuf    protobuf-java    2.5.0    New BSD license
        org.apache.hadoop    hadoop-hdfs-client    3.2.1
            com.fasterxml.jackson.core    jackson-annotations    2.9.8
            com.fasterxml.jackson.core    jackson-databind    2.9.8
                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                com.fasterxml.jackson.core    jackson-core    2.9.8
            com.squareup.okhttp    okhttp    2.7.5
                com.squareup.okio    okio    1.6.0
        org.apache.hadoop    hadoop-yarn-client    3.2.1
            com.google.guava    guava    27.0-jre
                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                com.google.guava    failureaccess    1.0
                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                org.checkerframework    checker-qual    2.5.2    The MIT License
                org.codehaus.mojo    animal-sniffer-annotations    1.17
            commons-cli    commons-cli    1.2
            commons-logging    commons-logging    1.2
            org.apache.hadoop    hadoop-yarn-api    3.2.1
                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                com.google.guava    guava    27.0-jre
                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                    com.google.guava    failureaccess    1.0
                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                    org.checkerframework    checker-qual    2.5.2    The MIT License
                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                com.google.protobuf    protobuf-java    2.5.0    New BSD license
                commons-logging    commons-logging    1.2
                javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
            org.apache.hadoop    hadoop-yarn-common    3.2.1
                com.fasterxml.jackson.core    jackson-core    2.9.8
                com.fasterxml.jackson.core    jackson-databind    2.9.8
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                com.fasterxml.jackson.jaxrs    jackson-jaxrs-json-provider    2.9.8
                    com.fasterxml.jackson.jaxrs    jackson-jaxrs-base    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.fasterxml.jackson.core    jackson-databind    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.fasterxml.jackson.core    jackson-databind    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.core    jackson-databind    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                com.google.guava    guava    27.0-jre
                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                    com.google.guava    failureaccess    1.0
                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                    org.checkerframework    checker-qual    2.5.2    The MIT License
                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                com.google.inject    guice    4.0
                    aopalliance    aopalliance    1.0    Public Domain
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                com.google.protobuf    protobuf-java    2.5.0    New BSD license
                com.sun.jersey.contribs    jersey-guice    1.19
                    com.google.inject    guice    4.0
                        aopalliance    aopalliance    1.0    Public Domain
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                    com.sun.jersey    jersey-servlet    1.19
                        com.sun.jersey    jersey-server    1.19
                            com.sun.jersey    jersey-core    1.19
                                javax.ws.rs    jsr311-api    1.1.1    CDDL License
                    javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                com.sun.jersey    jersey-client    1.19
                    com.sun.jersey    jersey-core    1.19
                        javax.ws.rs    jsr311-api    1.1.1    CDDL License
                com.sun.jersey    jersey-core    1.19
                    javax.ws.rs    jsr311-api    1.1.1    CDDL License
                com.sun.jersey    jersey-json    1.19
                    com.sun.jersey    jersey-core    1.19
                        javax.ws.rs    jsr311-api    1.1.1    CDDL License
                    com.sun.xml.bind    jaxb-impl    2.2.3-1    CDDL 1.1
                        javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                    org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-jaxrs    1.9.2    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-xc    1.9.2    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jettison    jettison    1.1
                com.sun.jersey    jersey-server    1.19
                    com.sun.jersey    jersey-core    1.19
                        javax.ws.rs    jsr311-api    1.1.1    CDDL License
                commons-cli    commons-cli    1.2
                commons-codec    commons-codec    1.11
                commons-io    commons-io    2.5
                commons-logging    commons-logging    1.2
                javax.servlet    javax.servlet-api    3.1.0    CDDL + GPLv2 with classpath exception
                javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                org.apache.commons    commons-compress    1.18
                org.apache.hadoop    hadoop-auth    3.2.1
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                        com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                        net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                            net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                org.ow2.asm    asm    5.0.4
                    commons-codec    commons-codec    1.11
                    net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                        net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                            org.ow2.asm    asm    5.0.4
                    org.apache.curator    curator-framework    2.13.0
                        org.apache.curator    curator-client    2.13.0
                            com.google.guava    guava    27.0-jre
                                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                                com.google.guava    failureaccess    1.0
                                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                                org.checkerframework    checker-qual    2.5.2    The MIT License
                                org.codehaus.mojo    animal-sniffer-annotations    1.17
                            org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                                jline    jline    0.9.94    BSD
                                org.apache.yetus    audience-annotations    0.5.0
                                org.slf4j    slf4j-api    1.7.25
                            org.slf4j    slf4j-api    1.7.25
                    org.apache.httpcomponents    httpclient    4.5.6
                        commons-codec    commons-codec    1.11
                        commons-logging    commons-logging    1.2
                        org.apache.httpcomponents    httpcore    4.4.10
                    org.apache.kerby    kerb-simplekdc    1.0.1
                        org.apache.kerby    kerb-admin    1.0.1
                            org.apache.kerby    kerb-server    1.0.1
                                org.apache.kerby    kerb-common    1.0.1
                                    commons-io    commons-io    2.5
                                    org.apache.kerby    kerb-crypto    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerby-util    1.0.1
                                    org.apache.kerby    kerby-config    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-identity    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-config    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-util    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-crypto    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-util    1.0.1
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerby-xdr    1.0.1
                        org.apache.kerby    kerb-client    1.0.1
                            org.apache.kerby    kerb-common    1.0.1
                                commons-io    commons-io    2.5
                                org.apache.kerby    kerb-crypto    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-util    1.0.1
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-util    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-crypto    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-util    1.0.1
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerby-config    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    token-provider    1.0.1
                                com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                                    com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                                    net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                        net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                            org.ow2.asm    asm    5.0.4
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                    org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                        jline    jline    0.9.94    BSD
                        org.apache.yetus    audience-annotations    0.5.0
                        org.slf4j    slf4j-api    1.7.25
                    org.slf4j    slf4j-api    1.7.25
                org.apache.hadoop    hadoop-hdfs-client    3.2.1
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-databind    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.squareup.okhttp    okhttp    2.7.5
                        com.squareup.okio    okio    1.6.0
                org.apache.hadoop    hadoop-yarn-api    3.2.1
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    com.google.protobuf    protobuf-java    2.5.0    New BSD license
                    commons-logging    commons-logging    1.2
                    javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                org.eclipse.jetty    jetty-util    9.3.24.v20180605
                org.slf4j    slf4j-api    1.7.25
        org.apache.hadoop    hadoop-yarn-common    3.2.1
            com.fasterxml.jackson.core    jackson-core    2.9.8
            com.fasterxml.jackson.core    jackson-databind    2.9.8
                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                com.fasterxml.jackson.core    jackson-core    2.9.8
            com.fasterxml.jackson.jaxrs    jackson-jaxrs-json-provider    2.9.8
                com.fasterxml.jackson.jaxrs    jackson-jaxrs-base    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.core    jackson-databind    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.core    jackson-databind    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
            com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                com.fasterxml.jackson.core    jackson-core    2.9.8
                com.fasterxml.jackson.core    jackson-databind    2.9.8
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
            com.google.guava    guava    27.0-jre
                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                com.google.guava    failureaccess    1.0
                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                org.checkerframework    checker-qual    2.5.2    The MIT License
                org.codehaus.mojo    animal-sniffer-annotations    1.17
            com.google.inject    guice    4.0
                aopalliance    aopalliance    1.0    Public Domain
                com.google.guava    guava    27.0-jre
                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                    com.google.guava    failureaccess    1.0
                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                    org.checkerframework    checker-qual    2.5.2    The MIT License
                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                javax.inject    javax.inject    1    The Apache Software License, Version 2.0
            com.google.protobuf    protobuf-java    2.5.0    New BSD license
            com.sun.jersey.contribs    jersey-guice    1.19
                com.google.inject    guice    4.0
                    aopalliance    aopalliance    1.0    Public Domain
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                com.sun.jersey    jersey-servlet    1.19
                    com.sun.jersey    jersey-server    1.19
                        com.sun.jersey    jersey-core    1.19
                            javax.ws.rs    jsr311-api    1.1.1    CDDL License
                javax.inject    javax.inject    1    The Apache Software License, Version 2.0
            com.sun.jersey    jersey-client    1.19
                com.sun.jersey    jersey-core    1.19
                    javax.ws.rs    jsr311-api    1.1.1    CDDL License
            com.sun.jersey    jersey-core    1.19
                javax.ws.rs    jsr311-api    1.1.1    CDDL License
            com.sun.jersey    jersey-json    1.19
                com.sun.jersey    jersey-core    1.19
                    javax.ws.rs    jsr311-api    1.1.1    CDDL License
                com.sun.xml.bind    jaxb-impl    2.2.3-1    CDDL 1.1
                    javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                org.codehaus.jackson    jackson-jaxrs    1.9.2    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                org.codehaus.jackson    jackson-xc    1.9.2    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                org.codehaus.jettison    jettison    1.1
            com.sun.jersey    jersey-server    1.19
                com.sun.jersey    jersey-core    1.19
                    javax.ws.rs    jsr311-api    1.1.1    CDDL License
            commons-cli    commons-cli    1.2
            commons-codec    commons-codec    1.11
            commons-io    commons-io    2.5
            commons-logging    commons-logging    1.2
            javax.servlet    javax.servlet-api    3.1.0    CDDL + GPLv2 with classpath exception
            javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
            org.apache.commons    commons-compress    1.18
            org.apache.hadoop    hadoop-auth    3.2.1
                com.google.guava    guava    27.0-jre
                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                    com.google.guava    failureaccess    1.0
                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                    org.checkerframework    checker-qual    2.5.2    The MIT License
                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                    com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                    net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                        net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                            org.ow2.asm    asm    5.0.4
                commons-codec    commons-codec    1.11
                net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                    net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                        org.ow2.asm    asm    5.0.4
                org.apache.curator    curator-framework    2.13.0
                    org.apache.curator    curator-client    2.13.0
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                            jline    jline    0.9.94    BSD
                            org.apache.yetus    audience-annotations    0.5.0
                            org.slf4j    slf4j-api    1.7.25
                        org.slf4j    slf4j-api    1.7.25
                org.apache.httpcomponents    httpclient    4.5.6
                    commons-codec    commons-codec    1.11
                    commons-logging    commons-logging    1.2
                    org.apache.httpcomponents    httpcore    4.4.10
                org.apache.kerby    kerb-simplekdc    1.0.1
                    org.apache.kerby    kerb-admin    1.0.1
                        org.apache.kerby    kerb-server    1.0.1
                            org.apache.kerby    kerb-common    1.0.1
                                commons-io    commons-io    2.5
                                org.apache.kerby    kerb-crypto    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-util    1.0.1
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-identity    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerb-util    1.0.1
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-crypto    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-util    1.0.1
                            org.apache.kerby    kerby-config    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerby-xdr    1.0.1
                    org.apache.kerby    kerb-client    1.0.1
                        org.apache.kerby    kerb-common    1.0.1
                            commons-io    commons-io    2.5
                            org.apache.kerby    kerb-crypto    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-util    1.0.1
                            org.apache.kerby    kerby-config    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerb-core    1.0.1
                            org.apache.kerby    kerby-pkix    1.0.1
                                org.apache.kerby    kerby-asn1    1.0.1
                                org.apache.kerby    kerby-util    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerb-util    1.0.1
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-crypto    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-util    1.0.1
                            org.apache.kerby    kerby-config    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerby-config    1.0.1
                            org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    token-provider    1.0.1
                            com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                                com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                                net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                    net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                        org.ow2.asm    asm    5.0.4
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                    jline    jline    0.9.94    BSD
                    org.apache.yetus    audience-annotations    0.5.0
                    org.slf4j    slf4j-api    1.7.25
                org.slf4j    slf4j-api    1.7.25
            org.apache.hadoop    hadoop-hdfs-client    3.2.1
                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                com.fasterxml.jackson.core    jackson-databind    2.9.8
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                com.squareup.okhttp    okhttp    2.7.5
                    com.squareup.okio    okio    1.6.0
            org.apache.hadoop    hadoop-yarn-api    3.2.1
                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                com.google.guava    guava    27.0-jre
                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                    com.google.guava    failureaccess    1.0
                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                    org.checkerframework    checker-qual    2.5.2    The MIT License
                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                com.google.protobuf    protobuf-java    2.5.0    New BSD license
                commons-logging    commons-logging    1.2
                javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
            org.eclipse.jetty    jetty-util    9.3.24.v20180605
            org.slf4j    slf4j-api    1.7.25
        org.slf4j    slf4j-api    1.7.25
    org.apache.hadoop    hadoop-mapreduce-client-jobclient    3.2.1
        com.google.protobuf    protobuf-java    2.5.0    New BSD license
        org.apache.hadoop    hadoop-mapreduce-client-common    3.2.1
            com.google.protobuf    protobuf-java    2.5.0    New BSD license
            org.apache.hadoop    hadoop-mapreduce-client-core    3.2.1
                com.fasterxml.jackson.core    jackson-databind    2.9.8
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                com.google.protobuf    protobuf-java    2.5.0    New BSD license
                org.apache.hadoop    hadoop-hdfs-client    3.2.1
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-databind    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.squareup.okhttp    okhttp    2.7.5
                        com.squareup.okio    okio    1.6.0
                org.apache.hadoop    hadoop-yarn-client    3.2.1
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    commons-cli    commons-cli    1.2
                    commons-logging    commons-logging    1.2
                    org.apache.hadoop    hadoop-yarn-api    3.2.1
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        com.google.protobuf    protobuf-java    2.5.0    New BSD license
                        commons-logging    commons-logging    1.2
                        javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                    org.apache.hadoop    hadoop-yarn-common    3.2.1
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.fasterxml.jackson.core    jackson-databind    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.fasterxml.jackson.jaxrs    jackson-jaxrs-json-provider    2.9.8
                            com.fasterxml.jackson.jaxrs    jackson-jaxrs-base    2.9.8
                                com.fasterxml.jackson.core    jackson-core    2.9.8
                                com.fasterxml.jackson.core    jackson-databind    2.9.8
                                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                                    com.fasterxml.jackson.core    jackson-core    2.9.8
                            com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                                com.fasterxml.jackson.core    jackson-core    2.9.8
                                com.fasterxml.jackson.core    jackson-databind    2.9.8
                                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                                    com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                            com.fasterxml.jackson.core    jackson-databind    2.9.8
                                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                                com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        com.google.inject    guice    4.0
                            aopalliance    aopalliance    1.0    Public Domain
                            com.google.guava    guava    27.0-jre
                                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                                com.google.guava    failureaccess    1.0
                                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                                org.checkerframework    checker-qual    2.5.2    The MIT License
                                org.codehaus.mojo    animal-sniffer-annotations    1.17
                            javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                        com.google.protobuf    protobuf-java    2.5.0    New BSD license
                        com.sun.jersey.contribs    jersey-guice    1.19
                            com.google.inject    guice    4.0
                                aopalliance    aopalliance    1.0    Public Domain
                                com.google.guava    guava    27.0-jre
                                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                                    com.google.guava    failureaccess    1.0
                                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                                    org.checkerframework    checker-qual    2.5.2    The MIT License
                                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                                javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                            com.sun.jersey    jersey-servlet    1.19
                                com.sun.jersey    jersey-server    1.19
                                    com.sun.jersey    jersey-core    1.19
                                        javax.ws.rs    jsr311-api    1.1.1    CDDL License
                            javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                        com.sun.jersey    jersey-client    1.19
                            com.sun.jersey    jersey-core    1.19
                                javax.ws.rs    jsr311-api    1.1.1    CDDL License
                        com.sun.jersey    jersey-core    1.19
                            javax.ws.rs    jsr311-api    1.1.1    CDDL License
                        com.sun.jersey    jersey-json    1.19
                            com.sun.jersey    jersey-core    1.19
                                javax.ws.rs    jsr311-api    1.1.1    CDDL License
                            com.sun.xml.bind    jaxb-impl    2.2.3-1    CDDL 1.1
                                javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-jaxrs    1.9.2    The Apache Software License, Version 2.0
                                org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                                org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                                    org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                                org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-xc    1.9.2    The Apache Software License, Version 2.0
                                org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                                org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                                    org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jettison    jettison    1.1
                        com.sun.jersey    jersey-server    1.19
                            com.sun.jersey    jersey-core    1.19
                                javax.ws.rs    jsr311-api    1.1.1    CDDL License
                        commons-cli    commons-cli    1.2
                        commons-codec    commons-codec    1.11
                        commons-io    commons-io    2.5
                        commons-logging    commons-logging    1.2
                        javax.servlet    javax.servlet-api    3.1.0    CDDL + GPLv2 with classpath exception
                        javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                        org.apache.commons    commons-compress    1.18
                        org.apache.hadoop    hadoop-auth    3.2.1
                            com.google.guava    guava    27.0-jre
                                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                                com.google.guava    failureaccess    1.0
                                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                                org.checkerframework    checker-qual    2.5.2    The MIT License
                                org.codehaus.mojo    animal-sniffer-annotations    1.17
                            com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                                com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                                net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                    net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                        org.ow2.asm    asm    5.0.4
                            commons-codec    commons-codec    1.11
                            net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                    org.ow2.asm    asm    5.0.4
                            org.apache.curator    curator-framework    2.13.0
                                org.apache.curator    curator-client    2.13.0
                                    com.google.guava    guava    27.0-jre
                                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                                        com.google.guava    failureaccess    1.0
                                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                                        org.checkerframework    checker-qual    2.5.2    The MIT License
                                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                                    org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                                        jline    jline    0.9.94    BSD
                                        org.apache.yetus    audience-annotations    0.5.0
                                        org.slf4j    slf4j-api    1.7.25
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.httpcomponents    httpclient    4.5.6
                                commons-codec    commons-codec    1.11
                                commons-logging    commons-logging    1.2
                                org.apache.httpcomponents    httpcore    4.4.10
                            org.apache.kerby    kerb-simplekdc    1.0.1
                                org.apache.kerby    kerb-admin    1.0.1
                                    org.apache.kerby    kerb-server    1.0.1
                                        org.apache.kerby    kerb-common    1.0.1
                                            commons-io    commons-io    2.5
                                            org.apache.kerby    kerb-crypto    1.0.1
                                                org.apache.kerby    kerb-core    1.0.1
                                                    org.apache.kerby    kerby-pkix    1.0.1
                                                        org.apache.kerby    kerby-asn1    1.0.1
                                                        org.apache.kerby    kerby-util    1.0.1
                                                        org.slf4j    slf4j-api    1.7.25
                                                org.apache.kerby    kerby-util    1.0.1
                                            org.apache.kerby    kerby-config    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerb-identity    1.0.1
                                            org.apache.kerby    kerb-core    1.0.1
                                                org.apache.kerby    kerby-pkix    1.0.1
                                                    org.apache.kerby    kerby-asn1    1.0.1
                                                    org.apache.kerby    kerby-util    1.0.1
                                                    org.slf4j    slf4j-api    1.7.25
                                            org.apache.kerby    kerby-config    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerb-util    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerb-crypto    1.0.1
                                            org.apache.kerby    kerb-core    1.0.1
                                                org.apache.kerby    kerby-pkix    1.0.1
                                                    org.apache.kerby    kerby-asn1    1.0.1
                                                    org.apache.kerby    kerby-util    1.0.1
                                                    org.slf4j    slf4j-api    1.7.25
                                            org.apache.kerby    kerby-util    1.0.1
                                        org.apache.kerby    kerby-config    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-xdr    1.0.1
                                org.apache.kerby    kerb-client    1.0.1
                                    org.apache.kerby    kerb-common    1.0.1
                                        commons-io    commons-io    2.5
                                        org.apache.kerby    kerb-crypto    1.0.1
                                            org.apache.kerby    kerb-core    1.0.1
                                                org.apache.kerby    kerby-pkix    1.0.1
                                                    org.apache.kerby    kerby-asn1    1.0.1
                                                    org.apache.kerby    kerby-util    1.0.1
                                                    org.slf4j    slf4j-api    1.7.25
                                            org.apache.kerby    kerby-util    1.0.1
                                        org.apache.kerby    kerby-config    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerb-util    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerb-crypto    1.0.1
                                            org.apache.kerby    kerb-core    1.0.1
                                                org.apache.kerby    kerby-pkix    1.0.1
                                                    org.apache.kerby    kerby-asn1    1.0.1
                                                    org.apache.kerby    kerby-util    1.0.1
                                                    org.slf4j    slf4j-api    1.7.25
                                            org.apache.kerby    kerby-util    1.0.1
                                        org.apache.kerby    kerby-config    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-config    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    token-provider    1.0.1
                                        com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                                            com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                                            net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                                net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                                    org.ow2.asm    asm    5.0.4
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                            org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                                jline    jline    0.9.94    BSD
                                org.apache.yetus    audience-annotations    0.5.0
                                org.slf4j    slf4j-api    1.7.25
                            org.slf4j    slf4j-api    1.7.25
                        org.apache.hadoop    hadoop-hdfs-client    3.2.1
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-databind    2.9.8
                                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                                com.fasterxml.jackson.core    jackson-core    2.9.8
                            com.squareup.okhttp    okhttp    2.7.5
                                com.squareup.okio    okio    1.6.0
                        org.apache.hadoop    hadoop-yarn-api    3.2.1
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.google.guava    guava    27.0-jre
                                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                                com.google.guava    failureaccess    1.0
                                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                                org.checkerframework    checker-qual    2.5.2    The MIT License
                                org.codehaus.mojo    animal-sniffer-annotations    1.17
                            com.google.protobuf    protobuf-java    2.5.0    New BSD license
                            commons-logging    commons-logging    1.2
                            javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                        org.eclipse.jetty    jetty-util    9.3.24.v20180605
                        org.slf4j    slf4j-api    1.7.25
                org.apache.hadoop    hadoop-yarn-common    3.2.1
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.core    jackson-databind    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.jaxrs    jackson-jaxrs-json-provider    2.9.8
                        com.fasterxml.jackson.jaxrs    jackson-jaxrs-base    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                            com.fasterxml.jackson.core    jackson-databind    2.9.8
                                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                                com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                            com.fasterxml.jackson.core    jackson-databind    2.9.8
                                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                                com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.fasterxml.jackson.core    jackson-databind    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    com.google.inject    guice    4.0
                        aopalliance    aopalliance    1.0    Public Domain
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                    com.google.protobuf    protobuf-java    2.5.0    New BSD license
                    com.sun.jersey.contribs    jersey-guice    1.19
                        com.google.inject    guice    4.0
                            aopalliance    aopalliance    1.0    Public Domain
                            com.google.guava    guava    27.0-jre
                                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                                com.google.guava    failureaccess    1.0
                                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                                org.checkerframework    checker-qual    2.5.2    The MIT License
                                org.codehaus.mojo    animal-sniffer-annotations    1.17
                            javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                        com.sun.jersey    jersey-servlet    1.19
                            com.sun.jersey    jersey-server    1.19
                                com.sun.jersey    jersey-core    1.19
                                    javax.ws.rs    jsr311-api    1.1.1    CDDL License
                        javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                    com.sun.jersey    jersey-client    1.19
                        com.sun.jersey    jersey-core    1.19
                            javax.ws.rs    jsr311-api    1.1.1    CDDL License
                    com.sun.jersey    jersey-core    1.19
                        javax.ws.rs    jsr311-api    1.1.1    CDDL License
                    com.sun.jersey    jersey-json    1.19
                        com.sun.jersey    jersey-core    1.19
                            javax.ws.rs    jsr311-api    1.1.1    CDDL License
                        com.sun.xml.bind    jaxb-impl    2.2.3-1    CDDL 1.1
                            javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-jaxrs    1.9.2    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                                org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-xc    1.9.2    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                                org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jettison    jettison    1.1
                    com.sun.jersey    jersey-server    1.19
                        com.sun.jersey    jersey-core    1.19
                            javax.ws.rs    jsr311-api    1.1.1    CDDL License
                    commons-cli    commons-cli    1.2
                    commons-codec    commons-codec    1.11
                    commons-io    commons-io    2.5
                    commons-logging    commons-logging    1.2
                    javax.servlet    javax.servlet-api    3.1.0    CDDL + GPLv2 with classpath exception
                    javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                    org.apache.commons    commons-compress    1.18
                    org.apache.hadoop    hadoop-auth    3.2.1
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                            com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                            net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                    org.ow2.asm    asm    5.0.4
                        commons-codec    commons-codec    1.11
                        net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                            net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                org.ow2.asm    asm    5.0.4
                        org.apache.curator    curator-framework    2.13.0
                            org.apache.curator    curator-client    2.13.0
                                com.google.guava    guava    27.0-jre
                                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                                    com.google.guava    failureaccess    1.0
                                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                                    org.checkerframework    checker-qual    2.5.2    The MIT License
                                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                                org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                                    jline    jline    0.9.94    BSD
                                    org.apache.yetus    audience-annotations    0.5.0
                                    org.slf4j    slf4j-api    1.7.25
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.httpcomponents    httpclient    4.5.6
                            commons-codec    commons-codec    1.11
                            commons-logging    commons-logging    1.2
                            org.apache.httpcomponents    httpcore    4.4.10
                        org.apache.kerby    kerb-simplekdc    1.0.1
                            org.apache.kerby    kerb-admin    1.0.1
                                org.apache.kerby    kerb-server    1.0.1
                                    org.apache.kerby    kerb-common    1.0.1
                                        commons-io    commons-io    2.5
                                        org.apache.kerby    kerb-crypto    1.0.1
                                            org.apache.kerby    kerb-core    1.0.1
                                                org.apache.kerby    kerby-pkix    1.0.1
                                                    org.apache.kerby    kerby-asn1    1.0.1
                                                    org.apache.kerby    kerby-util    1.0.1
                                                    org.slf4j    slf4j-api    1.7.25
                                            org.apache.kerby    kerby-util    1.0.1
                                        org.apache.kerby    kerby-config    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerb-identity    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerby-config    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-util    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerb-crypto    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerby-util    1.0.1
                                    org.apache.kerby    kerby-config    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-xdr    1.0.1
                            org.apache.kerby    kerb-client    1.0.1
                                org.apache.kerby    kerb-common    1.0.1
                                    commons-io    commons-io    2.5
                                    org.apache.kerby    kerb-crypto    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerby-util    1.0.1
                                    org.apache.kerby    kerby-config    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-util    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerb-crypto    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerby-util    1.0.1
                                    org.apache.kerby    kerby-config    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    token-provider    1.0.1
                                    com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                                        com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                                        net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                            net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                                org.ow2.asm    asm    5.0.4
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                        org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                            jline    jline    0.9.94    BSD
                            org.apache.yetus    audience-annotations    0.5.0
                            org.slf4j    slf4j-api    1.7.25
                        org.slf4j    slf4j-api    1.7.25
                    org.apache.hadoop    hadoop-hdfs-client    3.2.1
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-databind    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.squareup.okhttp    okhttp    2.7.5
                            com.squareup.okio    okio    1.6.0
                    org.apache.hadoop    hadoop-yarn-api    3.2.1
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        com.google.protobuf    protobuf-java    2.5.0    New BSD license
                        commons-logging    commons-logging    1.2
                        javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                    org.eclipse.jetty    jetty-util    9.3.24.v20180605
                    org.slf4j    slf4j-api    1.7.25
                org.slf4j    slf4j-api    1.7.25
            org.apache.hadoop    hadoop-yarn-client    3.2.1
                com.google.guava    guava    27.0-jre
                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                    com.google.guava    failureaccess    1.0
                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                    org.checkerframework    checker-qual    2.5.2    The MIT License
                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                commons-cli    commons-cli    1.2
                commons-logging    commons-logging    1.2
                org.apache.hadoop    hadoop-yarn-api    3.2.1
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    com.google.protobuf    protobuf-java    2.5.0    New BSD license
                    commons-logging    commons-logging    1.2
                    javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                org.apache.hadoop    hadoop-yarn-common    3.2.1
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.core    jackson-databind    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.jaxrs    jackson-jaxrs-json-provider    2.9.8
                        com.fasterxml.jackson.jaxrs    jackson-jaxrs-base    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                            com.fasterxml.jackson.core    jackson-databind    2.9.8
                                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                                com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                            com.fasterxml.jackson.core    jackson-databind    2.9.8
                                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                                com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.fasterxml.jackson.core    jackson-databind    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    com.google.inject    guice    4.0
                        aopalliance    aopalliance    1.0    Public Domain
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                    com.google.protobuf    protobuf-java    2.5.0    New BSD license
                    com.sun.jersey.contribs    jersey-guice    1.19
                        com.google.inject    guice    4.0
                            aopalliance    aopalliance    1.0    Public Domain
                            com.google.guava    guava    27.0-jre
                                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                                com.google.guava    failureaccess    1.0
                                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                                org.checkerframework    checker-qual    2.5.2    The MIT License
                                org.codehaus.mojo    animal-sniffer-annotations    1.17
                            javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                        com.sun.jersey    jersey-servlet    1.19
                            com.sun.jersey    jersey-server    1.19
                                com.sun.jersey    jersey-core    1.19
                                    javax.ws.rs    jsr311-api    1.1.1    CDDL License
                        javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                    com.sun.jersey    jersey-client    1.19
                        com.sun.jersey    jersey-core    1.19
                            javax.ws.rs    jsr311-api    1.1.1    CDDL License
                    com.sun.jersey    jersey-core    1.19
                        javax.ws.rs    jsr311-api    1.1.1    CDDL License
                    com.sun.jersey    jersey-json    1.19
                        com.sun.jersey    jersey-core    1.19
                            javax.ws.rs    jsr311-api    1.1.1    CDDL License
                        com.sun.xml.bind    jaxb-impl    2.2.3-1    CDDL 1.1
                            javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-jaxrs    1.9.2    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                                org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-xc    1.9.2    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                                org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jettison    jettison    1.1
                    com.sun.jersey    jersey-server    1.19
                        com.sun.jersey    jersey-core    1.19
                            javax.ws.rs    jsr311-api    1.1.1    CDDL License
                    commons-cli    commons-cli    1.2
                    commons-codec    commons-codec    1.11
                    commons-io    commons-io    2.5
                    commons-logging    commons-logging    1.2
                    javax.servlet    javax.servlet-api    3.1.0    CDDL + GPLv2 with classpath exception
                    javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                    org.apache.commons    commons-compress    1.18
                    org.apache.hadoop    hadoop-auth    3.2.1
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                            com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                            net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                    org.ow2.asm    asm    5.0.4
                        commons-codec    commons-codec    1.11
                        net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                            net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                org.ow2.asm    asm    5.0.4
                        org.apache.curator    curator-framework    2.13.0
                            org.apache.curator    curator-client    2.13.0
                                com.google.guava    guava    27.0-jre
                                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                                    com.google.guava    failureaccess    1.0
                                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                                    org.checkerframework    checker-qual    2.5.2    The MIT License
                                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                                org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                                    jline    jline    0.9.94    BSD
                                    org.apache.yetus    audience-annotations    0.5.0
                                    org.slf4j    slf4j-api    1.7.25
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.httpcomponents    httpclient    4.5.6
                            commons-codec    commons-codec    1.11
                            commons-logging    commons-logging    1.2
                            org.apache.httpcomponents    httpcore    4.4.10
                        org.apache.kerby    kerb-simplekdc    1.0.1
                            org.apache.kerby    kerb-admin    1.0.1
                                org.apache.kerby    kerb-server    1.0.1
                                    org.apache.kerby    kerb-common    1.0.1
                                        commons-io    commons-io    2.5
                                        org.apache.kerby    kerb-crypto    1.0.1
                                            org.apache.kerby    kerb-core    1.0.1
                                                org.apache.kerby    kerby-pkix    1.0.1
                                                    org.apache.kerby    kerby-asn1    1.0.1
                                                    org.apache.kerby    kerby-util    1.0.1
                                                    org.slf4j    slf4j-api    1.7.25
                                            org.apache.kerby    kerby-util    1.0.1
                                        org.apache.kerby    kerby-config    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerb-identity    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerby-config    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-util    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerb-crypto    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerby-util    1.0.1
                                    org.apache.kerby    kerby-config    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-xdr    1.0.1
                            org.apache.kerby    kerb-client    1.0.1
                                org.apache.kerby    kerb-common    1.0.1
                                    commons-io    commons-io    2.5
                                    org.apache.kerby    kerb-crypto    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerby-util    1.0.1
                                    org.apache.kerby    kerby-config    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-util    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerb-crypto    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerby-util    1.0.1
                                    org.apache.kerby    kerby-config    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    token-provider    1.0.1
                                    com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                                        com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                                        net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                            net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                                org.ow2.asm    asm    5.0.4
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                        org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                            jline    jline    0.9.94    BSD
                            org.apache.yetus    audience-annotations    0.5.0
                            org.slf4j    slf4j-api    1.7.25
                        org.slf4j    slf4j-api    1.7.25
                    org.apache.hadoop    hadoop-hdfs-client    3.2.1
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-databind    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.squareup.okhttp    okhttp    2.7.5
                            com.squareup.okio    okio    1.6.0
                    org.apache.hadoop    hadoop-yarn-api    3.2.1
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        com.google.protobuf    protobuf-java    2.5.0    New BSD license
                        commons-logging    commons-logging    1.2
                        javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                    org.eclipse.jetty    jetty-util    9.3.24.v20180605
                    org.slf4j    slf4j-api    1.7.25
            org.apache.hadoop    hadoop-yarn-common    3.2.1
                com.fasterxml.jackson.core    jackson-core    2.9.8
                com.fasterxml.jackson.core    jackson-databind    2.9.8
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                com.fasterxml.jackson.jaxrs    jackson-jaxrs-json-provider    2.9.8
                    com.fasterxml.jackson.jaxrs    jackson-jaxrs-base    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.fasterxml.jackson.core    jackson-databind    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                        com.fasterxml.jackson.core    jackson-databind    2.9.8
                            com.fasterxml.jackson.core    jackson-annotations    2.9.8
                            com.fasterxml.jackson.core    jackson-core    2.9.8
                com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.core    jackson-databind    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                com.google.guava    guava    27.0-jre
                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                    com.google.guava    failureaccess    1.0
                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                    org.checkerframework    checker-qual    2.5.2    The MIT License
                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                com.google.inject    guice    4.0
                    aopalliance    aopalliance    1.0    Public Domain
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                com.google.protobuf    protobuf-java    2.5.0    New BSD license
                com.sun.jersey.contribs    jersey-guice    1.19
                    com.google.inject    guice    4.0
                        aopalliance    aopalliance    1.0    Public Domain
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                    com.sun.jersey    jersey-servlet    1.19
                        com.sun.jersey    jersey-server    1.19
                            com.sun.jersey    jersey-core    1.19
                                javax.ws.rs    jsr311-api    1.1.1    CDDL License
                    javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                com.sun.jersey    jersey-client    1.19
                    com.sun.jersey    jersey-core    1.19
                        javax.ws.rs    jsr311-api    1.1.1    CDDL License
                com.sun.jersey    jersey-core    1.19
                    javax.ws.rs    jsr311-api    1.1.1    CDDL License
                com.sun.jersey    jersey-json    1.19
                    com.sun.jersey    jersey-core    1.19
                        javax.ws.rs    jsr311-api    1.1.1    CDDL License
                    com.sun.xml.bind    jaxb-impl    2.2.3-1    CDDL 1.1
                        javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                    org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-jaxrs    1.9.2    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-xc    1.9.2    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                            org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jettison    jettison    1.1
                com.sun.jersey    jersey-server    1.19
                    com.sun.jersey    jersey-core    1.19
                        javax.ws.rs    jsr311-api    1.1.1    CDDL License
                commons-cli    commons-cli    1.2
                commons-codec    commons-codec    1.11
                commons-io    commons-io    2.5
                commons-logging    commons-logging    1.2
                javax.servlet    javax.servlet-api    3.1.0    CDDL + GPLv2 with classpath exception
                javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                org.apache.commons    commons-compress    1.18
                org.apache.hadoop    hadoop-auth    3.2.1
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                        com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                        net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                            net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                org.ow2.asm    asm    5.0.4
                    commons-codec    commons-codec    1.11
                    net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                        net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                            org.ow2.asm    asm    5.0.4
                    org.apache.curator    curator-framework    2.13.0
                        org.apache.curator    curator-client    2.13.0
                            com.google.guava    guava    27.0-jre
                                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                                com.google.guava    failureaccess    1.0
                                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                                org.checkerframework    checker-qual    2.5.2    The MIT License
                                org.codehaus.mojo    animal-sniffer-annotations    1.17
                            org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                                jline    jline    0.9.94    BSD
                                org.apache.yetus    audience-annotations    0.5.0
                                org.slf4j    slf4j-api    1.7.25
                            org.slf4j    slf4j-api    1.7.25
                    org.apache.httpcomponents    httpclient    4.5.6
                        commons-codec    commons-codec    1.11
                        commons-logging    commons-logging    1.2
                        org.apache.httpcomponents    httpcore    4.4.10
                    org.apache.kerby    kerb-simplekdc    1.0.1
                        org.apache.kerby    kerb-admin    1.0.1
                            org.apache.kerby    kerb-server    1.0.1
                                org.apache.kerby    kerb-common    1.0.1
                                    commons-io    commons-io    2.5
                                    org.apache.kerby    kerb-crypto    1.0.1
                                        org.apache.kerby    kerb-core    1.0.1
                                            org.apache.kerby    kerby-pkix    1.0.1
                                                org.apache.kerby    kerby-asn1    1.0.1
                                                org.apache.kerby    kerby-util    1.0.1
                                                org.slf4j    slf4j-api    1.7.25
                                        org.apache.kerby    kerby-util    1.0.1
                                    org.apache.kerby    kerby-config    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-identity    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-config    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-util    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-crypto    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-util    1.0.1
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerby-xdr    1.0.1
                        org.apache.kerby    kerb-client    1.0.1
                            org.apache.kerby    kerb-common    1.0.1
                                commons-io    commons-io    2.5
                                org.apache.kerby    kerb-crypto    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-util    1.0.1
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-util    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerb-crypto    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-util    1.0.1
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerby-config    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    token-provider    1.0.1
                                com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                                    com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                                    net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                        net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                            org.ow2.asm    asm    5.0.4
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                    org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                        jline    jline    0.9.94    BSD
                        org.apache.yetus    audience-annotations    0.5.0
                        org.slf4j    slf4j-api    1.7.25
                    org.slf4j    slf4j-api    1.7.25
                org.apache.hadoop    hadoop-hdfs-client    3.2.1
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-databind    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.squareup.okhttp    okhttp    2.7.5
                        com.squareup.okio    okio    1.6.0
                org.apache.hadoop    hadoop-yarn-api    3.2.1
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    com.google.protobuf    protobuf-java    2.5.0    New BSD license
                    commons-logging    commons-logging    1.2
                    javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                org.eclipse.jetty    jetty-util    9.3.24.v20180605
                org.slf4j    slf4j-api    1.7.25
            org.slf4j    slf4j-api    1.7.25
        org.slf4j    slf4j-api    1.7.25
    org.apache.hadoop    hadoop-yarn-api    3.2.1
        com.fasterxml.jackson.core    jackson-annotations    2.9.8
        com.google.guava    guava    27.0-jre
            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
            com.google.guava    failureaccess    1.0
            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
            org.checkerframework    checker-qual    2.5.2    The MIT License
            org.codehaus.mojo    animal-sniffer-annotations    1.17
        com.google.protobuf    protobuf-java    2.5.0    New BSD license
        commons-logging    commons-logging    1.2
        javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
    org.apache.hadoop    hadoop-yarn-client    3.2.1
        com.google.guava    guava    27.0-jre
            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
            com.google.guava    failureaccess    1.0
            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
            org.checkerframework    checker-qual    2.5.2    The MIT License
            org.codehaus.mojo    animal-sniffer-annotations    1.17
        commons-cli    commons-cli    1.2
        commons-logging    commons-logging    1.2
        org.apache.hadoop    hadoop-yarn-api    3.2.1
            com.fasterxml.jackson.core    jackson-annotations    2.9.8
            com.google.guava    guava    27.0-jre
                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                com.google.guava    failureaccess    1.0
                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                org.checkerframework    checker-qual    2.5.2    The MIT License
                org.codehaus.mojo    animal-sniffer-annotations    1.17
            com.google.protobuf    protobuf-java    2.5.0    New BSD license
            commons-logging    commons-logging    1.2
            javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
        org.apache.hadoop    hadoop-yarn-common    3.2.1
            com.fasterxml.jackson.core    jackson-core    2.9.8
            com.fasterxml.jackson.core    jackson-databind    2.9.8
                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                com.fasterxml.jackson.core    jackson-core    2.9.8
            com.fasterxml.jackson.jaxrs    jackson-jaxrs-json-provider    2.9.8
                com.fasterxml.jackson.jaxrs    jackson-jaxrs-base    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.core    jackson-databind    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
                com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                    com.fasterxml.jackson.core    jackson-databind    2.9.8
                        com.fasterxml.jackson.core    jackson-annotations    2.9.8
                        com.fasterxml.jackson.core    jackson-core    2.9.8
            com.fasterxml.jackson.module    jackson-module-jaxb-annotations    2.9.8
                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                com.fasterxml.jackson.core    jackson-core    2.9.8
                com.fasterxml.jackson.core    jackson-databind    2.9.8
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
            com.google.guava    guava    27.0-jre
                com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                com.google.guava    failureaccess    1.0
                com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                org.checkerframework    checker-qual    2.5.2    The MIT License
                org.codehaus.mojo    animal-sniffer-annotations    1.17
            com.google.inject    guice    4.0
                aopalliance    aopalliance    1.0    Public Domain
                com.google.guava    guava    27.0-jre
                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                    com.google.guava    failureaccess    1.0
                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                    org.checkerframework    checker-qual    2.5.2    The MIT License
                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                javax.inject    javax.inject    1    The Apache Software License, Version 2.0
            com.google.protobuf    protobuf-java    2.5.0    New BSD license
            com.sun.jersey.contribs    jersey-guice    1.19
                com.google.inject    guice    4.0
                    aopalliance    aopalliance    1.0    Public Domain
                    com.google.guava    guava    27.0-jre
                        com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                        com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                        com.google.guava    failureaccess    1.0
                        com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                        com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                        org.checkerframework    checker-qual    2.5.2    The MIT License
                        org.codehaus.mojo    animal-sniffer-annotations    1.17
                    javax.inject    javax.inject    1    The Apache Software License, Version 2.0
                com.sun.jersey    jersey-servlet    1.19
                    com.sun.jersey    jersey-server    1.19
                        com.sun.jersey    jersey-core    1.19
                            javax.ws.rs    jsr311-api    1.1.1    CDDL License
                javax.inject    javax.inject    1    The Apache Software License, Version 2.0
            com.sun.jersey    jersey-client    1.19
                com.sun.jersey    jersey-core    1.19
                    javax.ws.rs    jsr311-api    1.1.1    CDDL License
            com.sun.jersey    jersey-core    1.19
                javax.ws.rs    jsr311-api    1.1.1    CDDL License
            com.sun.jersey    jersey-json    1.19
                com.sun.jersey    jersey-core    1.19
                    javax.ws.rs    jsr311-api    1.1.1    CDDL License
                com.sun.xml.bind    jaxb-impl    2.2.3-1    CDDL 1.1
                    javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
                org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                org.codehaus.jackson    jackson-jaxrs    1.9.2    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                org.codehaus.jackson    jackson-xc    1.9.2    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                    org.codehaus.jackson    jackson-mapper-asl    1.9.13    The Apache Software License, Version 2.0
                        org.codehaus.jackson    jackson-core-asl    1.9.13    The Apache Software License, Version 2.0
                org.codehaus.jettison    jettison    1.1
            com.sun.jersey    jersey-server    1.19
                com.sun.jersey    jersey-core    1.19
                    javax.ws.rs    jsr311-api    1.1.1    CDDL License
            commons-cli    commons-cli    1.2
            commons-codec    commons-codec    1.11
            commons-io    commons-io    2.5
            commons-logging    commons-logging    1.2
            javax.servlet    javax.servlet-api    3.1.0    CDDL + GPLv2 with classpath exception
            javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
            org.apache.commons    commons-compress    1.18
            org.apache.hadoop    hadoop-auth    3.2.1
                com.google.guava    guava    27.0-jre
                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                    com.google.guava    failureaccess    1.0
                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                    org.checkerframework    checker-qual    2.5.2    The MIT License
                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                    com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                    net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                        net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                            org.ow2.asm    asm    5.0.4
                commons-codec    commons-codec    1.11
                net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                    net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                        org.ow2.asm    asm    5.0.4
                org.apache.curator    curator-framework    2.13.0
                    org.apache.curator    curator-client    2.13.0
                        com.google.guava    guava    27.0-jre
                            com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                            com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                            com.google.guava    failureaccess    1.0
                            com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                            com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                            org.checkerframework    checker-qual    2.5.2    The MIT License
                            org.codehaus.mojo    animal-sniffer-annotations    1.17
                        org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                            jline    jline    0.9.94    BSD
                            org.apache.yetus    audience-annotations    0.5.0
                            org.slf4j    slf4j-api    1.7.25
                        org.slf4j    slf4j-api    1.7.25
                org.apache.httpcomponents    httpclient    4.5.6
                    commons-codec    commons-codec    1.11
                    commons-logging    commons-logging    1.2
                    org.apache.httpcomponents    httpcore    4.4.10
                org.apache.kerby    kerb-simplekdc    1.0.1
                    org.apache.kerby    kerb-admin    1.0.1
                        org.apache.kerby    kerb-server    1.0.1
                            org.apache.kerby    kerb-common    1.0.1
                                commons-io    commons-io    2.5
                                org.apache.kerby    kerb-crypto    1.0.1
                                    org.apache.kerby    kerb-core    1.0.1
                                        org.apache.kerby    kerby-pkix    1.0.1
                                            org.apache.kerby    kerby-asn1    1.0.1
                                            org.apache.kerby    kerby-util    1.0.1
                                            org.slf4j    slf4j-api    1.7.25
                                    org.apache.kerby    kerby-util    1.0.1
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-identity    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-config    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerb-util    1.0.1
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-crypto    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-util    1.0.1
                            org.apache.kerby    kerby-config    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerby-xdr    1.0.1
                    org.apache.kerby    kerb-client    1.0.1
                        org.apache.kerby    kerb-common    1.0.1
                            commons-io    commons-io    2.5
                            org.apache.kerby    kerb-crypto    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-util    1.0.1
                            org.apache.kerby    kerby-config    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerb-core    1.0.1
                            org.apache.kerby    kerby-pkix    1.0.1
                                org.apache.kerby    kerby-asn1    1.0.1
                                org.apache.kerby    kerby-util    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerb-util    1.0.1
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                            org.apache.kerby    kerb-crypto    1.0.1
                                org.apache.kerby    kerb-core    1.0.1
                                    org.apache.kerby    kerby-pkix    1.0.1
                                        org.apache.kerby    kerby-asn1    1.0.1
                                        org.apache.kerby    kerby-util    1.0.1
                                        org.slf4j    slf4j-api    1.7.25
                                org.apache.kerby    kerby-util    1.0.1
                            org.apache.kerby    kerby-config    1.0.1
                                org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    kerby-config    1.0.1
                            org.slf4j    slf4j-api    1.7.25
                        org.apache.kerby    token-provider    1.0.1
                            com.nimbusds    nimbus-jose-jwt    4.41.1    The Apache Software License, Version 2.0
                                com.github.stephenc.jcip    jcip-annotations    1.0-1    Apache License, Version 2.0
                                net.minidev    json-smart    2.3    The Apache Software License, Version 2.0
                                    net.minidev    accessors-smart    1.2    The Apache Software License, Version 2.0
                                        org.ow2.asm    asm    5.0.4
                            org.apache.kerby    kerb-core    1.0.1
                                org.apache.kerby    kerby-pkix    1.0.1
                                    org.apache.kerby    kerby-asn1    1.0.1
                                    org.apache.kerby    kerby-util    1.0.1
                                    org.slf4j    slf4j-api    1.7.25
                org.apache.zookeeper    zookeeper    3.4.13    The Apache Software License, Version 2.0
                    jline    jline    0.9.94    BSD
                    org.apache.yetus    audience-annotations    0.5.0
                    org.slf4j    slf4j-api    1.7.25
                org.slf4j    slf4j-api    1.7.25
            org.apache.hadoop    hadoop-hdfs-client    3.2.1
                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                com.fasterxml.jackson.core    jackson-databind    2.9.8
                    com.fasterxml.jackson.core    jackson-annotations    2.9.8
                    com.fasterxml.jackson.core    jackson-core    2.9.8
                com.squareup.okhttp    okhttp    2.7.5
                    com.squareup.okio    okio    1.6.0
            org.apache.hadoop    hadoop-yarn-api    3.2.1
                com.fasterxml.jackson.core    jackson-annotations    2.9.8
                com.google.guava    guava    27.0-jre
                    com.google.code.findbugs    jsr305    3.0.2    The Apache Software License, Version 2.0
                    com.google.errorprone    error_prone_annotations    2.2.0    Apache 2.0
                    com.google.guava    failureaccess    1.0
                    com.google.guava    listenablefuture    9999.0-empty-to-avoid-conflict-with-guava
                    com.google.j2objc    j2objc-annotations    1.1    The Apache Software License, Version 2.0
                    org.checkerframework    checker-qual    2.5.2    The MIT License
                    org.codehaus.mojo    animal-sniffer-annotations    1.17
                com.google.protobuf    protobuf-java    2.5.0    New BSD license
                commons-logging    commons-logging    1.2
                javax.xml.bind    jaxb-api    2.2.11    CDDL 1.1
            org.eclipse.jetty    jetty-util    9.3.24.v20180605
            org.slf4j    slf4j-api    1.7.25
org.scala-lang    scala-library    2.13.8    Apache-2.0
org.typelevel    cats-core_2.13    2.0.0    MIT
    org.scala-lang    scala-library    2.13.8    Apache-2.0
    org.typelevel    cats-kernel_2.13    2.0.0    MIT
        org.scala-lang    scala-library    2.13.8    Apache-2.0
    org.typelevel    cats-macros_2.13    2.0.0    MIT
        org.scala-lang    scala-library    2.13.8    Apache-2.0

Specifying a Hadoop Version

By default, HDFS connector uses Hadoop 3.2.1. If you are using a different version of Hadoop, you should exclude the Hadoop libraries from the connector dependency and add the dependency for your preferred version.

Set up client

Flows provided by this connector need a prepared org.apache.hadoop.fs.FileSystem to interact with HDFS.

Scala
sourceimport org.apache.hadoop.conf.Configuration
import org.apache.hadoop.fs.FileSystem

val conf = new Configuration()
conf.set("fs.default.name", "hdfs://localhost:54310")

val fs: FileSystem = FileSystem.get(conf)
Java
sourceConfiguration conf = new Configuration();
conf.set("fs.default.name", "hdfs://localhost:54310");

fs = FileSystem.get(conf);

Writing

The connector provides three Flows. Each flow requires RotationStrategy and SyncStrategy to run. HdfsFlow. HdfsFlow.

The flows push OutgoingMessage to a downstream.

Data Writer

Use HdfsFlow.data to stream with FSDataOutputStream without any compression.

Scala
sourceval flow = HdfsFlow.data(
  fs,
  SyncStrategy.count(500),
  RotationStrategy.size(1, FileUnit.GB),
  HdfsWritingSettings()
)
Java
sourceFlow<HdfsWriteMessage<ByteString, NotUsed>, RotationMessage, NotUsed> flow =
    HdfsFlow.data(
        fs, SyncStrategy.count(500), RotationStrategy.size(1, FileUnit.GB()), settings);

Compressed Data Writer

First, create CompressionCodec.

Scala
sourceval codec = new DefaultCodec()
codec.setConf(fs.getConf)
Java
sourceDefaultCodec codec = new DefaultCodec();
codec.setConf(fs.getConf());

Then, use HdfsFlow.compress to stream with CompressionOutputStream and CompressionCodec.

Scala
sourceval flow = HdfsFlow.compressed(
  fs,
  SyncStrategy.count(1),
  RotationStrategy.size(0.1, FileUnit.MB),
  codec,
  settings
)
Java
sourceFlow<HdfsWriteMessage<ByteString, NotUsed>, RotationMessage, NotUsed> flow =
    HdfsFlow.compressed(
        fs, SyncStrategy.count(50), RotationStrategy.size(0.1, FileUnit.MB()), codec, settings);

Sequence Writer

Use HdfsFlow.sequence to stream a flat file consisting of binary key/value pairs.

Without Compression

Scala
sourceval flow = HdfsFlow.sequence(
  fs,
  SyncStrategy.none,
  RotationStrategy.size(1, FileUnit.MB),
  settings,
  classOf[Text],
  classOf[Text]
)
Java
sourceFlow<HdfsWriteMessage<Pair<Text, Text>, NotUsed>, RotationMessage, NotUsed> flow =
    HdfsFlow.sequence(
        fs,
        SyncStrategy.none(),
        RotationStrategy.size(1, FileUnit.MB()),
        SequenceFile.CompressionType.BLOCK,
        codec,
        settings,
        Text.class,
        Text.class);

With Compression

First, define a codec.

Scala
sourceval codec = new DefaultCodec()
codec.setConf(fs.getConf)
Java
sourceDefaultCodec codec = new DefaultCodec();
codec.setConf(fs.getConf());

Then, create a flow.

Scala
sourceval flow = HdfsFlow.sequence(
  fs,
  SyncStrategy.none,
  RotationStrategy.size(1, FileUnit.MB),
  CompressionType.BLOCK,
  codec,
  settings,
  classOf[Text],
  classOf[Text]
)
Java
sourceFlow<HdfsWriteMessage<Pair<Text, Text>, NotUsed>, RotationMessage, NotUsed> flow =
    HdfsFlow.sequence(
        fs,
        SyncStrategy.none(),
        RotationStrategy.size(1, FileUnit.MB()),
        settings,
        Text.class,
        Text.class);

Passing data through HdfsFlow

Use HdfsFlow.dataWithPassThrough, HdfsFlow.compressedWithPassThrough or HdfsFlow.sequenceWithPassThrough.

When streaming documents from Kafka, you might want to commit to Kafka. The flow will emit two messages. For every input, it will produce WrittenMessage and when it rotates, RotationMessage.

Let’s say that we have these classes.

Scala
sourcecase class Book(title: String)
case class KafkaOffset(offset: Int)
case class KafkaMessage(book: Book, offset: KafkaOffset)
Java
sourcepublic static class Book {
  final String title;

  Book(String title) {
    this.title = title;
  }
}

static class KafkaCommitter {
  List<Integer> committedOffsets = new ArrayList<>();

  void commit(KafkaOffset offset) {
    committedOffsets.add(offset.offset);
  }
}

static class KafkaOffset {
  final int offset;

  KafkaOffset(int offset) {
    this.offset = offset;
  }
}

static class KafkaMessage {
  final Book book;
  final KafkaOffset offset;

  KafkaMessage(Book book, KafkaOffset offset) {
    this.book = book;
    this.offset = offset;
  }
}

Then, we can stream with passThrough.

Scala
source// We're going to pretend we got messages from kafka.
// After we've written them to HDFS, we want
// to commit the offset to Kafka
val messagesFromKafka = List(
  KafkaMessage(Book("Akka Concurrency"), KafkaOffset(0)),
  KafkaMessage(Book("Akka in Action"), KafkaOffset(1)),
  KafkaMessage(Book("Effective Akka"), KafkaOffset(2)),
  KafkaMessage(Book("Learning Scala"), KafkaOffset(3)),
  KafkaMessage(Book("Scala Puzzlers"), KafkaOffset(4)),
  KafkaMessage(Book("Scala for Spark in Production"), KafkaOffset(5))
)

var committedOffsets = List[KafkaOffset]()

def commitToKafka(offset: KafkaOffset): Unit =
  committedOffsets = committedOffsets :+ offset

val resF = Source(messagesFromKafka)
  .map { kafkaMessage: KafkaMessage =>
    val book = kafkaMessage.book
    // Transform message so that we can write to hdfs
    HdfsWriteMessage(ByteString(book.title), kafkaMessage.offset)
  }
  .via(
    HdfsFlow.dataWithPassThrough[KafkaOffset](
      fs,
      SyncStrategy.count(50),
      RotationStrategy.count(4),
      HdfsWritingSettings().withNewLine(true)
    )
  )
  .map { message =>
    message match {
      case WrittenMessage(passThrough, _) =>
        commitToKafka(passThrough)
      case _ => ()
    }
    message
  }
  .collect {
    case rm: RotationMessage => rm
  }
  .runWith(Sink.seq)
Java
source// We're going to pretend we got messages from kafka.
// After we've written them to HDFS, we want
// to commit the offset to Kafka
List<KafkaMessage> messagesFromKafka =
    Arrays.asList(
        new KafkaMessage(new Book("Akka Concurrency"), new KafkaOffset(0)),
        new KafkaMessage(new Book("Akka in Action"), new KafkaOffset(1)),
        new KafkaMessage(new Book("Effective Akka"), new KafkaOffset(2)),
        new KafkaMessage(new Book("Learning Scala"), new KafkaOffset(3)),
        new KafkaMessage(new Book("Scala Puzzlers"), new KafkaOffset(4)),
        new KafkaMessage(new Book("Scala for Spark in Production"), new KafkaOffset(5)));

final KafkaCommitter kafkaCommitter = new KafkaCommitter();

Flow<HdfsWriteMessage<ByteString, KafkaOffset>, OutgoingMessage<KafkaOffset>, NotUsed> flow =
    HdfsFlow.dataWithPassThrough(
        fs,
        SyncStrategy.count(50),
        RotationStrategy.count(4),
        HdfsWritingSettings.create().withNewLine(true));

CompletionStage<List<RotationMessage>> resF =
    Source.from(messagesFromKafka)
        .map(
            kafkaMessage -> {
              Book book = kafkaMessage.book;
              // Transform message so that we can write to hdfs\
              return HdfsWriteMessage.create(
                  ByteString.fromString(book.title), kafkaMessage.offset);
            })
        .via(flow)
        .map(
            message -> {
              if (message instanceof WrittenMessage) {
                kafkaCommitter.commit(((WrittenMessage<KafkaOffset>) message).passThrough());
                return message;
              } else {
                return message;
              }
            })
        .collectType(RotationMessage.class) // Collect only rotation messages
        .runWith(Sink.seq(), system);

Configuration

We can configure the sink by HdfsWritingSettings.

Scala
sourceval settings =
  HdfsWritingSettings()
    .withOverwrite(true)
    .withNewLine(false)
    .withLineSeparator(System.getProperty("line.separator"))
    .withPathGenerator(pathGenerator)
Java
sourceHdfsWritingSettings.create()
    .withOverwrite(true)
    .withNewLine(false)
    .withLineSeparator(System.getProperty("line.separator"))
    .withPathGenerator(pathGenerator);

File path generator

FilePathGenerator provides a functionality to generate rotation path in HDFS.

Scala
sourceval pathGenerator =
  FilePathGenerator(
    (rotationCount: Long, timestamp: Long) => s"/tmp/alpakka/$rotationCount-$timestamp"
  )
Java
sourceBiFunction<Long, Long, String> func =
    (rotationCount, timestamp) -> "/tmp/alpakka/" + rotationCount + "-" + timestamp;
FilePathGenerator pathGenerator = FilePathGenerator.create(func);

Rotation Strategy

RotationStrategy provides a functionality to decide when to rotate files.

Sync Strategy

SyncStrategy provides a functionality to decide when to synchronize the output.

Reading

Use HdfsSource to read from HDFS. HdfsSource. HdfsSource.

Data Reader

Scala
sourceval source = HdfsSource.data(fs, path)
Java
sourceSource<ByteString, CompletionStage<IOResult>> source = HdfsSource.data(fs, path);

Compressed Data Reader

Scala
sourceval source = HdfsSource.compressed(fs, path, codec)
Java
sourceSource<ByteString, CompletionStage<IOResult>> source = HdfsSource.compressed(fs, path, codec);

Sequence Reader

Scala
sourceval source = HdfsSource.sequence(fs, path, classOf[Text], classOf[Text])
Java
sourceSource<Pair<Text, Text>, NotUsed> source =
    HdfsSource.sequence(fs, path, Text.class, Text.class);

Running the example code

The code in this guide is part of runnable tests of this project. You are welcome to edit the code and run it in sbt.

Scala
sbt
> hdfs/testOnly *.HdfsWriterSpec
> hdfs/testOnly *.HdfsReaderSpec
Java
sbt
> hdfs/testOnly *.HdfsWriterTest
> hdfs/testOnly *.HdfsReaderTest
Found an error in this documentation? The source code for this page can be found here. Please feel free to edit and contribute a pull request.