24/01/09 11:25:36 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
24/01/09 11:25:36 WARN SparkConf: The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled
24/01/09 11:25:36 WARN SparkConf: The configuration key 'spark.blacklist.enabled' has been deprecated as of Spark 3.1.0 and may be removed in the future. Please use spark.excludeOnFailure.enabled
Warning: Ignore classpath  with proxy user specified in Cluster mode when spark.submit.proxyUser.allowCustomClasspathInClusterMode is disabled
24/01/09 11:25:37 WARN DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
24/01/09 11:25:37 INFO Configuration: resource-types.xml not found
24/01/09 11:25:37 INFO ResourceUtils: Unable to find 'resource-types.xml'.
24/01/09 11:25:37 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (16384 MB per container)
24/01/09 11:25:37 INFO Client: Will allocate AM container, with 9011 MB memory including 819 MB overhead
24/01/09 11:25:37 INFO Client: Setting up container launch context for our AM
24/01/09 11:25:37 INFO Client: Setting up the launch environment for our AM container
24/01/09 11:25:37 INFO Client: Preparing resources for our AM container
24/01/09 11:25:37 WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
24/01/09 11:25:40 INFO Client: Uploading resource file:/tmp/spark-9c0b8f87-6a26-45d2-a3be-87a3db4d0376/__spark_libs__3666844409084604047.zip -> hdfs://newns/user/anonymous/.sparkStaging/application_1703339837335_19617/__spark_libs__3666844409084604047.zip
24/01/09 11:25:41 INFO Client: Uploading resource file:/data/kyuubi/apache-kyuubi-1.8.0-bin/externals/engines/spark/kyuubi-spark-sql-engine_2.12-1.8.0.jar -> hdfs://newns/user/anonymous/.sparkStaging/application_1703339837335_19617/kyuubi-spark-sql-engine_2.12-1.8.0.jar
24/01/09 11:25:41 INFO Client: Uploading resource file:/data/kyuubi/aspectjweaver-1.9.9.1.jar -> hdfs://newns/user/anonymous/.sparkStaging/application_1703339837335_19617/aspectjweaver-1.9.9.1.jar
24/01/09 11:25:41 INFO Client: Uploading resource file:/tmp/spark-9c0b8f87-6a26-45d2-a3be-87a3db4d0376/__spark_conf__7257192390678123054.zip -> hdfs://newns/user/anonymous/.sparkStaging/application_1703339837335_19617/__spark_conf__.zip
24/01/09 11:25:42 INFO SecurityManager: Changing view acls to: devops,anonymous
24/01/09 11:25:42 INFO SecurityManager: Changing modify acls to: devops,anonymous
24/01/09 11:25:42 INFO SecurityManager: Changing view acls groups to: 
24/01/09 11:25:42 INFO SecurityManager: Changing modify acls groups to: 
24/01/09 11:25:42 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: devops, anonymous; groups with view permissions: EMPTY; users with modify permissions: devops, anonymous; groups with modify permissions: EMPTY
24/01/09 11:25:42 INFO Client: Submitting application application_1703339837335_19617 to ResourceManager
24/01/09 11:25:42 INFO YarnClientImpl: Submitted application application_1703339837335_19617
24/01/09 11:25:42 INFO Client: Application report for application_1703339837335_19617 (state: ACCEPTED)
24/01/09 11:25:42 INFO Client: 
	 client token: N/A
	 diagnostics: [Tue Jan 09 11:25:42 +0800 2024] Application is Activated, waiting for resources to be assigned for AM.  Details : AM Partition = <DEFAULT_PARTITION> ; Partition Resource = <memory:137160, vCores:154> ; Queue's Absolute capacity = 70.0 % ; Queue's Absolute used capacity = 18.664333 % ; Queue's Absolute max capacity = 100.0 % ; 
	 ApplicationMaster host: N/A
	 ApplicationMaster RPC port: -1
	 queue: default
	 start time: 1704770742072
	 final status: UNDEFINED
	 tracking URL: http://node1.hadoop01.aloudata.work:8088/proxy/application_1703339837335_19617/
	 user: anonymous
24/01/09 11:25:42 INFO ShutdownHookManager: Shutdown hook called
24/01/09 11:25:42 INFO ShutdownHookManager: Deleting directory /tmp/spark-9c0b8f87-6a26-45d2-a3be-87a3db4d0376
24/01/09 11:25:42 INFO ShutdownHookManager: Deleting directory /tmp/spark-efa2259f-67b2-42a7-82ac-247a5e6b3671