2024-01-03 15:11:34.465 INFO KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.operation.LaunchEngine: Processing anonymous's query[b6575098-0244-402c-b2d7-2861a2706295]: PENDING_STATE -> RUNNING_STATE, statement: LaunchEngine 2024-01-03 15:11:34.467 INFO KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.shaded.curator.framework.imps.CuratorFrameworkImpl: Starting 2024-01-03 15:11:34.467 INFO KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Initiating client connection, connectString=10.5.20.10:2181,10.5.20.11:2181,10.5.20.12:2181 sessionTimeout=60000 watcher=org.apache.kyuubi.shaded.curator.ConnectionState@41a17551 2024-01-03 15:11:34.473 INFO KyuubiSessionManager-exec-pool: Thread-318-SendThread(node2.hadoop01.aloudata.work:2181) org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Opening socket connection to server node2.hadoop01.aloudata.work/10.5.20.11:2181. Will not attempt to authenticate using SASL (unknown error) 2024-01-03 15:11:34.475 INFO KyuubiSessionManager-exec-pool: Thread-318-SendThread(node2.hadoop01.aloudata.work:2181) org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Socket connection established to node2.hadoop01.aloudata.work/10.5.20.11:2181, initiating session 2024-01-03 15:11:34.480 INFO KyuubiSessionManager-exec-pool: Thread-318-SendThread(node2.hadoop01.aloudata.work:2181) org.apache.kyuubi.shaded.zookeeper.ClientCnxn: Session establishment complete on server node2.hadoop01.aloudata.work/10.5.20.11:2181, sessionid = 0x20000002c503a2e, negotiated timeout = 120000 2024-01-03 15:11:34.481 INFO KyuubiSessionManager-exec-pool: Thread-318-EventThread org.apache.kyuubi.shaded.curator.framework.state.ConnectionStateManager: State change: CONNECTED 2024-01-03 15:11:34.487 WARN KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.shaded.curator.utils.ZKPaths: The version of ZooKeeper being used doesn't support Container nodes. CreateMode.PERSISTENT will be used instead. 2024-01-03 15:11:34.495 INFO KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.engine.ProcBuilder: Creating anonymous's working directory at /data/kyuubi/apache-kyuubi-1.8.0-bin/work/anonymous 2024-01-03 15:11:34.496 INFO KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.Utils: Loading Kyuubi properties from /data/kyuubi/spark-3.5.0-bin-hadoop3/conf/spark-defaults.conf 2024-01-03 15:11:34.502 INFO KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.engine.ProcBuilder: Logging to /data/kyuubi/apache-kyuubi-1.8.0-bin/work/anonymous/kyuubi-spark-sql-engine.log.0 2024-01-03 15:11:34.504 INFO KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.engine.EngineRef: Launching engine: /data/kyuubi/spark-3.5.0-bin-hadoop3/bin/spark-submit \ --class org.apache.kyuubi.engine.spark.SparkSQLEngine \ --conf spark.additionalProp1=string \ --conf spark.additionalProp2=string \ --conf spark.additionalProp3=string \ --conf spark.kyuubi.client.ipAddress=172.16.0.91 \ --conf spark.kyuubi.engine.engineLog.path=/data/kyuubi/apache-kyuubi-1.8.0-bin/work/anonymous/kyuubi-spark-sql-engine.log.0 \ --conf spark.kyuubi.engine.submit.time=1704265894494 \ --conf spark.kyuubi.frontend.protocols=THRIFT_BINARY,REST \ --conf spark.kyuubi.ha.addresses=10.5.20.10:2181,10.5.20.11:2181,10.5.20.12:2181 \ --conf spark.kyuubi.ha.engine.ref.id=75e8af39-802d-4053-aa6d-faee87746bc8 \ --conf spark.kyuubi.ha.namespace=/kyuubi-tardis_1.8.0_USER_SPARK_SQL/anonymous/default \ --conf spark.kyuubi.server.ipAddress=10.5.220.1 \ --conf spark.kyuubi.session.connection.url=10.5.220.1:10099 \ --conf spark.kyuubi.session.real.user=anonymous \ --conf spark.app.name=kyuubi_USER_SPARK_SQL_anonymous_default_75e8af39-802d-4053-aa6d-faee87746bc8 \ --conf spark.yarn.tags=KYUUBI,75e8af39-802d-4053-aa6d-faee87746bc8 \ --proxy-user anonymous /data/kyuubi/apache-kyuubi-1.8.0-bin/externals/engines/spark/kyuubi-spark-sql-engine_2.12-1.8.0.jar 2024-01-03 15:11:57.899 INFO KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.ha.client.zookeeper.ZookeeperDiscoveryClient: Get service instance:bigdata-dn-3031:32761 engine id:application_1703339837335_12400 and version:1.8.0 under /kyuubi-tardis_1.8.0_USER_SPARK_SQL/anonymous/default 2024-01-03 15:11:58.934 INFO KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.session.KyuubiSessionImpl: [anonymous:172.16.0.91] SessionHandle [75e8af39-802d-4053-aa6d-faee87746bc8] - Connected to engine [bigdata-dn-3031:32761]/[application_1703339837335_12400] with SessionHandle [75e8af39-802d-4053-aa6d-faee87746bc8]] 2024-01-03 15:11:58.935 INFO Curator-Framework-0 org.apache.kyuubi.shaded.curator.framework.imps.CuratorFrameworkImpl: backgroundOperationsLoop exiting 2024-01-03 15:11:58.941 INFO KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.shaded.zookeeper.ZooKeeper: Session: 0x20000002c503a2e closed 2024-01-03 15:11:58.941 INFO KyuubiSessionManager-exec-pool: Thread-318-EventThread org.apache.kyuubi.shaded.zookeeper.ClientCnxn: EventThread shut down for session: 0x20000002c503a2e 2024-01-03 15:11:58.941 INFO KyuubiSessionManager-exec-pool: Thread-318 org.apache.kyuubi.operation.LaunchEngine: Processing anonymous's query[b6575098-0244-402c-b2d7-2861a2706295]: RUNNING_STATE -> FINISHED_STATE, time taken: 24.475 seconds