24/01/09 11:01:04 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 24/01/09 11:01:05 WARN SparkConf: The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled 24/01/09 11:01:05 WARN SparkConf: The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled Warning: Ignore classpath with proxy user specified in Cluster mode when spark.submit.proxyUser.allowCustomClasspathInClusterMode is disabled 24/01/09 11:01:05 WARN DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 24/01/09 11:01:05 INFO Configuration: resource-types.xml not found 24/01/09 11:01:05 INFO ResourceUtils: Unable to find 'resource-types.xml'. 24/01/09 11:01:05 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (16384 MB per container) 24/01/09 11:01:05 INFO Client: Will allocate AM container, with 9011 MB memory including 819 MB overhead 24/01/09 11:01:05 INFO Client: Setting up container launch context for our AM 24/01/09 11:01:05 INFO Client: Setting up the launch environment for our AM container 24/01/09 11:01:05 INFO Client: Preparing resources for our AM container 24/01/09 11:01:05 WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME. 24/01/09 11:01:08 INFO Client: Uploading resource file:/tmp/spark-6f713eb7-8ab7-4f09-bb7d-ead2684249fb/__spark_libs__7170785917954241130.zip -> hdfs://newns/user/anonymous/.sparkStaging/application_1703339837335_19597/__spark_libs__7170785917954241130.zip 24/01/09 11:01:09 INFO Client: Uploading resource file:/data/kyuubi/apache-kyuubi-1.8.0-bin/externals/engines/spark/kyuubi-spark-sql-engine_2.12-1.8.0.jar -> hdfs://newns/user/anonymous/.sparkStaging/application_1703339837335_19597/kyuubi-spark-sql-engine_2.12-1.8.0.jar 24/01/09 11:01:09 INFO Client: Uploading resource file:/data/kyuubi/aspectjweaver-1.9.9.1.jar -> hdfs://newns/user/anonymous/.sparkStaging/application_1703339837335_19597/aspectjweaver-1.9.9.1.jar 24/01/09 11:01:10 INFO Client: Uploading resource file:/tmp/spark-6f713eb7-8ab7-4f09-bb7d-ead2684249fb/__spark_conf__466759767943931798.zip -> hdfs://newns/user/anonymous/.sparkStaging/application_1703339837335_19597/__spark_conf__.zip 24/01/09 11:01:10 INFO SecurityManager: Changing view acls to: devops,anonymous 24/01/09 11:01:10 INFO SecurityManager: Changing modify acls to: devops,anonymous 24/01/09 11:01:10 INFO SecurityManager: Changing view acls groups to: 24/01/09 11:01:10 INFO SecurityManager: Changing modify acls groups to: 24/01/09 11:01:10 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: devops, anonymous; groups with view permissions: EMPTY; users with modify permissions: devops, anonymous; groups with modify permissions: EMPTY 24/01/09 11:01:10 INFO Client: Submitting application application_1703339837335_19597 to ResourceManager 24/01/09 11:01:10 INFO YarnClientImpl: Submitted application application_1703339837335_19597 24/01/09 11:01:10 INFO Client: Application report for application_1703339837335_19597 (state: ACCEPTED) 24/01/09 11:01:10 INFO Client: client token: N/A diagnostics: AM container is launched, waiting for AM container to Register with RM ApplicationMaster host: N/A ApplicationMaster RPC port: -1 queue: default start time: 1704769270129 final status: UNDEFINED tracking URL: http://node1.hadoop01.aloudata.work:8088/proxy/application_1703339837335_19597/ user: anonymous 24/01/09 11:01:10 INFO ShutdownHookManager: Shutdown hook called 24/01/09 11:01:10 INFO ShutdownHookManager: Deleting directory /tmp/spark-6f713eb7-8ab7-4f09-bb7d-ead2684249fb 24/01/09 11:01:10 INFO ShutdownHookManager: Deleting directory /tmp/spark-9a4c6e4b-39c0-4b05-ad06-6d9b416faefb