3.1.3 stderr log page for app-20230924212957-0005/0

Back to Master

Showing 83132 Bytes: 0 - 83132 of 83132
Spark Executor Command: "/usr/java8/jdk1.8.0_202/bin/java" "-cp" "/opt/spark/conf/:/opt/spark/jars/*" "-Xmx10240M" "-Dspark.driver.port=45295" "-verbose:gc" "-XX:+PrintGCDetails" "-XX:+PrintGCTimeStamps" "-XX:+HeapDumpOnOutOfMemoryError" "-Xloggc:/tmp/memLog.txt" "-XX:+UseCompressedOops" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "--driver-url" "spark://CoarseGrainedScheduler@static.154.188.161.5.clients.your-server.de:45295" "--executor-id" "0" "--hostname" "5.161.188.154" "--cores" "5" "--app-id" "app-20230924212957-0005" "--worker-url" "spark://Worker@5.161.188.154:46635"
========================================

Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
23/09/24 21:29:58 INFO CoarseGrainedExecutorBackend: Started daemon with process name: 266438@entity-resolution
23/09/24 21:29:58 INFO SignalUtils: Registering signal handler for TERM
23/09/24 21:29:58 INFO SignalUtils: Registering signal handler for HUP
23/09/24 21:29:58 INFO SignalUtils: Registering signal handler for INT
23/09/24 21:29:58 WARN Utils: Your hostname, entity-resolution resolves to a loopback address: 127.0.1.1; using 5.161.188.154 instead (on interface eth0)
23/09/24 21:29:58 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
23/09/24 21:29:58 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
23/09/24 21:29:58 INFO SecurityManager: Changing view acls to: root
23/09/24 21:29:58 INFO SecurityManager: Changing modify acls to: root
23/09/24 21:29:58 INFO SecurityManager: Changing view acls groups to: 
23/09/24 21:29:58 INFO SecurityManager: Changing modify acls groups to: 
23/09/24 21:29:58 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
23/09/24 21:29:59 INFO TransportClientFactory: Successfully created connection to static.154.188.161.5.clients.your-server.de/5.161.188.154:45295 after 62 ms (0 ms spent in bootstraps)
23/09/24 21:29:59 INFO SecurityManager: Changing view acls to: root
23/09/24 21:29:59 INFO SecurityManager: Changing modify acls to: root
23/09/24 21:29:59 INFO SecurityManager: Changing view acls groups to: 
23/09/24 21:29:59 INFO SecurityManager: Changing modify acls groups to: 
23/09/24 21:29:59 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
23/09/24 21:29:59 INFO TransportClientFactory: Successfully created connection to static.154.188.161.5.clients.your-server.de/5.161.188.154:45295 after 2 ms (0 ms spent in bootstraps)
23/09/24 21:29:59 INFO DiskBlockManager: Created local directory at /tmp/spark-b5306174-a655-4af8-962d-ed2dcefb130b/executor-9d03ff6a-c42a-4483-b16e-9d5949c0888e/blockmgr-2aca15f9-10af-4d65-8db1-f356971ddf0a
23/09/24 21:29:59 INFO MemoryStore: MemoryStore started with capacity 5.2 GiB
23/09/24 21:29:59 INFO CoarseGrainedExecutorBackend: Connecting to driver: spark://CoarseGrainedScheduler@static.154.188.161.5.clients.your-server.de:45295
23/09/24 21:29:59 INFO WorkerWatcher: Connecting to worker spark://Worker@5.161.188.154:46635
23/09/24 21:29:59 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:46635 after 3 ms (0 ms spent in bootstraps)
23/09/24 21:29:59 INFO WorkerWatcher: Successfully connected to spark://Worker@5.161.188.154:46635
23/09/24 21:29:59 INFO ResourceUtils: ==============================================================
23/09/24 21:29:59 INFO ResourceUtils: No custom resources configured for spark.executor.
23/09/24 21:29:59 INFO ResourceUtils: ==============================================================
23/09/24 21:29:59 INFO CoarseGrainedExecutorBackend: Successfully registered with driver
23/09/24 21:29:59 INFO Executor: Starting executor ID 0 on host 5.161.188.154
23/09/24 21:29:59 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 43909.
23/09/24 21:29:59 INFO NettyBlockTransferService: Server created on 5.161.188.154:43909
23/09/24 21:29:59 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
23/09/24 21:29:59 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(0, 5.161.188.154, 43909, None)
23/09/24 21:29:59 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(0, 5.161.188.154, 43909, None)
23/09/24 21:29:59 INFO BlockManager: Initialized BlockManager: BlockManagerId(0, 5.161.188.154, 43909, None)
23/09/24 21:29:59 INFO Executor: Fetching spark://static.154.188.161.5.clients.your-server.de:45295/jars/zingg-0.3.4-SNAPSHOT.jar with timestamp 1695590996527
23/09/24 21:29:59 INFO TransportClientFactory: Successfully created connection to static.154.188.161.5.clients.your-server.de/5.161.188.154:45295 after 1 ms (0 ms spent in bootstraps)
23/09/24 21:29:59 INFO Utils: Fetching spark://static.154.188.161.5.clients.your-server.de:45295/jars/zingg-0.3.4-SNAPSHOT.jar to /tmp/spark-b5306174-a655-4af8-962d-ed2dcefb130b/executor-9d03ff6a-c42a-4483-b16e-9d5949c0888e/spark-53cad3d8-477f-4c74-8557-9fed9821340d/fetchFileTemp8671535183136714598.tmp
23/09/24 21:29:59 INFO Utils: Copying /tmp/spark-b5306174-a655-4af8-962d-ed2dcefb130b/executor-9d03ff6a-c42a-4483-b16e-9d5949c0888e/spark-53cad3d8-477f-4c74-8557-9fed9821340d/8061961251695590996527_cache to /opt/spark/work/app-20230924212957-0005/0/./zingg-0.3.4-SNAPSHOT.jar
23/09/24 21:29:59 INFO Executor: Adding file:/opt/spark/work/app-20230924212957-0005/0/./zingg-0.3.4-SNAPSHOT.jar to class loader
23/09/24 21:29:59 INFO Executor: Fetching spark://static.154.188.161.5.clients.your-server.de:45295/jars/postgresql-42.6.0.jar with timestamp 1695590996527
23/09/24 21:29:59 INFO Utils: Fetching spark://static.154.188.161.5.clients.your-server.de:45295/jars/postgresql-42.6.0.jar to /tmp/spark-b5306174-a655-4af8-962d-ed2dcefb130b/executor-9d03ff6a-c42a-4483-b16e-9d5949c0888e/spark-53cad3d8-477f-4c74-8557-9fed9821340d/fetchFileTemp2439966866503606772.tmp
23/09/24 21:29:59 INFO Utils: Copying /tmp/spark-b5306174-a655-4af8-962d-ed2dcefb130b/executor-9d03ff6a-c42a-4483-b16e-9d5949c0888e/spark-53cad3d8-477f-4c74-8557-9fed9821340d/17346205461695590996527_cache to /opt/spark/work/app-20230924212957-0005/0/./postgresql-42.6.0.jar
23/09/24 21:29:59 INFO Executor: Adding file:/opt/spark/work/app-20230924212957-0005/0/./postgresql-42.6.0.jar to class loader
23/09/24 21:30:01 INFO CoarseGrainedExecutorBackend: Got assigned task 2
23/09/24 21:30:01 INFO CoarseGrainedExecutorBackend: Got assigned task 5
23/09/24 21:30:01 INFO CoarseGrainedExecutorBackend: Got assigned task 8
23/09/24 21:30:01 INFO CoarseGrainedExecutorBackend: Got assigned task 11
23/09/24 21:30:01 INFO CoarseGrainedExecutorBackend: Got assigned task 14
23/09/24 21:30:01 INFO Executor: Running task 2.0 in stage 0.0 (TID 2)
23/09/24 21:30:01 INFO Executor: Running task 8.0 in stage 0.0 (TID 8)
23/09/24 21:30:01 INFO Executor: Running task 5.0 in stage 0.0 (TID 5)
23/09/24 21:30:01 INFO Executor: Running task 11.0 in stage 0.0 (TID 11)
23/09/24 21:30:01 INFO Executor: Running task 14.0 in stage 0.0 (TID 14)
23/09/24 21:30:01 INFO TorrentBroadcast: Started reading broadcast variable 1 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:01 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:46709 after 2 ms (0 ms spent in bootstraps)
23/09/24 21:30:01 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 6.8 KiB, free 5.2 GiB)
23/09/24 21:30:01 INFO TorrentBroadcast: Reading broadcast variable 1 took 102 ms
23/09/24 21:30:01 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 13.1 KiB, free 5.2 GiB)
23/09/24 21:30:02 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1879048192-2013265920, partition values: [empty row]
23/09/24 21:30:02 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 268435456-402653184, partition values: [empty row]
23/09/24 21:30:02 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1073741824-1207959552, partition values: [empty row]
23/09/24 21:30:02 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1476395008-1610612736, partition values: [empty row]
23/09/24 21:30:02 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 671088640-805306368, partition values: [empty row]
23/09/24 21:30:02 INFO CodeGenerator: Code generated in 278.216262 ms
23/09/24 21:30:02 INFO TorrentBroadcast: Started reading broadcast variable 0 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:02 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 24.8 KiB, free 5.2 GiB)
23/09/24 21:30:02 INFO TorrentBroadcast: Reading broadcast variable 0 took 14 ms
23/09/24 21:30:02 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 394.6 KiB, free 5.2 GiB)
23/09/24 21:30:04 INFO Executor: Finished task 11.0 in stage 0.0 (TID 11). 2164 bytes result sent to driver
23/09/24 21:30:05 INFO CoarseGrainedExecutorBackend: Got assigned task 18
23/09/24 21:30:05 INFO Executor: Running task 18.0 in stage 0.0 (TID 18)
23/09/24 21:30:05 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2415919104-2550136832, partition values: [empty row]
23/09/24 21:30:05 INFO Executor: Finished task 5.0 in stage 0.0 (TID 5). 2238 bytes result sent to driver
23/09/24 21:30:05 INFO CoarseGrainedExecutorBackend: Got assigned task 22
23/09/24 21:30:05 INFO Executor: Running task 22.0 in stage 0.0 (TID 22)
23/09/24 21:30:05 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2952790016-3087007744, partition values: [empty row]
23/09/24 21:30:05 INFO Executor: Finished task 14.0 in stage 0.0 (TID 14). 2195 bytes result sent to driver
23/09/24 21:30:05 INFO CoarseGrainedExecutorBackend: Got assigned task 23
23/09/24 21:30:05 INFO Executor: Running task 23.0 in stage 0.0 (TID 23)
23/09/24 21:30:05 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3087007744-3221225472, partition values: [empty row]
23/09/24 21:30:05 INFO Executor: Finished task 8.0 in stage 0.0 (TID 8). 2195 bytes result sent to driver
23/09/24 21:30:05 INFO CoarseGrainedExecutorBackend: Got assigned task 27
23/09/24 21:30:05 INFO Executor: Running task 27.0 in stage 0.0 (TID 27)
23/09/24 21:30:05 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3623878656-3758096384, partition values: [empty row]
23/09/24 21:30:05 INFO Executor: Finished task 2.0 in stage 0.0 (TID 2). 2195 bytes result sent to driver
23/09/24 21:30:05 INFO CoarseGrainedExecutorBackend: Got assigned task 29
23/09/24 21:30:05 INFO Executor: Running task 29.0 in stage 0.0 (TID 29)
23/09/24 21:30:05 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3892314112-4026531840, partition values: [empty row]
23/09/24 21:30:06 INFO Executor: Finished task 18.0 in stage 0.0 (TID 18). 2195 bytes result sent to driver
23/09/24 21:30:06 INFO CoarseGrainedExecutorBackend: Got assigned task 35
23/09/24 21:30:06 INFO Executor: Running task 35.0 in stage 0.0 (TID 35)
23/09/24 21:30:06 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4697620480-4831838208, partition values: [empty row]
23/09/24 21:30:06 INFO Executor: Finished task 27.0 in stage 0.0 (TID 27). 2188 bytes result sent to driver
23/09/24 21:30:06 INFO Executor: Finished task 22.0 in stage 0.0 (TID 22). 2195 bytes result sent to driver
23/09/24 21:30:06 INFO CoarseGrainedExecutorBackend: Got assigned task 36
23/09/24 21:30:06 INFO Executor: Running task 36.0 in stage 0.0 (TID 36)
23/09/24 21:30:06 INFO CoarseGrainedExecutorBackend: Got assigned task 37
23/09/24 21:30:06 INFO Executor: Running task 37.0 in stage 0.0 (TID 37)
23/09/24 21:30:06 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4966055936-5100273664, partition values: [empty row]
23/09/24 21:30:06 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4831838208-4966055936, partition values: [empty row]
23/09/24 21:30:06 INFO Executor: Finished task 23.0 in stage 0.0 (TID 23). 2238 bytes result sent to driver
23/09/24 21:30:06 INFO CoarseGrainedExecutorBackend: Got assigned task 38
23/09/24 21:30:06 INFO Executor: Running task 38.0 in stage 0.0 (TID 38)
23/09/24 21:30:06 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5100273664-5234491392, partition values: [empty row]
23/09/24 21:30:06 INFO Executor: Finished task 29.0 in stage 0.0 (TID 29). 2195 bytes result sent to driver
23/09/24 21:30:06 INFO CoarseGrainedExecutorBackend: Got assigned task 40
23/09/24 21:30:06 INFO Executor: Running task 40.0 in stage 0.0 (TID 40)
23/09/24 21:30:06 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5368709120-5502926848, partition values: [empty row]
23/09/24 21:30:08 INFO Executor: Finished task 35.0 in stage 0.0 (TID 35). 2195 bytes result sent to driver
23/09/24 21:30:08 INFO CoarseGrainedExecutorBackend: Got assigned task 50
23/09/24 21:30:08 INFO Executor: Running task 50.0 in stage 0.0 (TID 50)
23/09/24 21:30:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6710886400-6845104128, partition values: [empty row]
23/09/24 21:30:08 INFO Executor: Finished task 38.0 in stage 0.0 (TID 38). 2195 bytes result sent to driver
23/09/24 21:30:08 INFO CoarseGrainedExecutorBackend: Got assigned task 51
23/09/24 21:30:08 INFO Executor: Running task 51.0 in stage 0.0 (TID 51)
23/09/24 21:30:08 INFO Executor: Finished task 36.0 in stage 0.0 (TID 36). 2238 bytes result sent to driver
23/09/24 21:30:08 INFO CoarseGrainedExecutorBackend: Got assigned task 52
23/09/24 21:30:08 INFO Executor: Running task 52.0 in stage 0.0 (TID 52)
23/09/24 21:30:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6845104128-6979321856, partition values: [empty row]
23/09/24 21:30:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6979321856-7113539584, partition values: [empty row]
23/09/24 21:30:08 INFO Executor: Finished task 37.0 in stage 0.0 (TID 37). 2195 bytes result sent to driver
23/09/24 21:30:08 INFO CoarseGrainedExecutorBackend: Got assigned task 53
23/09/24 21:30:08 INFO Executor: Running task 53.0 in stage 0.0 (TID 53)
23/09/24 21:30:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7113539584-7247757312, partition values: [empty row]
23/09/24 21:30:08 INFO Executor: Finished task 40.0 in stage 0.0 (TID 40). 2195 bytes result sent to driver
23/09/24 21:30:08 INFO CoarseGrainedExecutorBackend: Got assigned task 54
23/09/24 21:30:08 INFO Executor: Running task 54.0 in stage 0.0 (TID 54)
23/09/24 21:30:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7247757312-7381975040, partition values: [empty row]
23/09/24 21:30:09 INFO Executor: Finished task 50.0 in stage 0.0 (TID 50). 2195 bytes result sent to driver
23/09/24 21:30:09 INFO CoarseGrainedExecutorBackend: Got assigned task 65
23/09/24 21:30:09 INFO Executor: Running task 65.0 in stage 0.0 (TID 65)
23/09/24 21:30:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8724152320-8858370048, partition values: [empty row]
23/09/24 21:30:09 INFO Executor: Finished task 51.0 in stage 0.0 (TID 51). 2195 bytes result sent to driver
23/09/24 21:30:09 INFO CoarseGrainedExecutorBackend: Got assigned task 67
23/09/24 21:30:09 INFO Executor: Running task 67.0 in stage 0.0 (TID 67)
23/09/24 21:30:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8992587776-9126805504, partition values: [empty row]
23/09/24 21:30:09 INFO Executor: Finished task 52.0 in stage 0.0 (TID 52). 2195 bytes result sent to driver
23/09/24 21:30:09 INFO CoarseGrainedExecutorBackend: Got assigned task 68
23/09/24 21:30:09 INFO Executor: Running task 68.0 in stage 0.0 (TID 68)
23/09/24 21:30:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9126805504-9261023232, partition values: [empty row]
23/09/24 21:30:09 INFO Executor: Finished task 54.0 in stage 0.0 (TID 54). 2195 bytes result sent to driver
23/09/24 21:30:09 INFO CoarseGrainedExecutorBackend: Got assigned task 73
23/09/24 21:30:09 INFO Executor: Running task 73.0 in stage 0.0 (TID 73)
23/09/24 21:30:09 INFO Executor: Finished task 53.0 in stage 0.0 (TID 53). 2195 bytes result sent to driver
23/09/24 21:30:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9797894144-9932111872, partition values: [empty row]
23/09/24 21:30:09 INFO CoarseGrainedExecutorBackend: Got assigned task 74
23/09/24 21:30:09 INFO Executor: Running task 74.0 in stage 0.0 (TID 74)
23/09/24 21:30:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9932111872-10066329600, partition values: [empty row]
23/09/24 21:30:11 INFO Executor: Finished task 65.0 in stage 0.0 (TID 65). 2195 bytes result sent to driver
23/09/24 21:30:11 INFO CoarseGrainedExecutorBackend: Got assigned task 85
23/09/24 21:30:11 INFO Executor: Running task 85.0 in stage 0.0 (TID 85)
23/09/24 21:30:11 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11408506880-11542724608, partition values: [empty row]
23/09/24 21:30:11 INFO Executor: Finished task 67.0 in stage 0.0 (TID 67). 2195 bytes result sent to driver
23/09/24 21:30:11 INFO CoarseGrainedExecutorBackend: Got assigned task 86
23/09/24 21:30:11 INFO Executor: Running task 86.0 in stage 0.0 (TID 86)
23/09/24 21:30:11 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11542724608-11676942336, partition values: [empty row]
23/09/24 21:30:11 INFO Executor: Finished task 68.0 in stage 0.0 (TID 68). 2195 bytes result sent to driver
23/09/24 21:30:11 INFO CoarseGrainedExecutorBackend: Got assigned task 87
23/09/24 21:30:11 INFO Executor: Running task 87.0 in stage 0.0 (TID 87)
23/09/24 21:30:11 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11676942336-11811160064, partition values: [empty row]
23/09/24 21:30:11 INFO Executor: Finished task 73.0 in stage 0.0 (TID 73). 2195 bytes result sent to driver
23/09/24 21:30:11 INFO Executor: Finished task 74.0 in stage 0.0 (TID 74). 2145 bytes result sent to driver
23/09/24 21:30:11 INFO CoarseGrainedExecutorBackend: Got assigned task 88
23/09/24 21:30:11 INFO CoarseGrainedExecutorBackend: Got assigned task 89
23/09/24 21:30:11 INFO Executor: Running task 88.0 in stage 0.0 (TID 88)
23/09/24 21:30:11 INFO Executor: Running task 89.0 in stage 0.0 (TID 89)
23/09/24 21:30:11 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11811160064-11945377792, partition values: [empty row]
23/09/24 21:30:11 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11945377792-12079595520, partition values: [empty row]
23/09/24 21:30:12 INFO Executor: Finished task 85.0 in stage 0.0 (TID 85). 2195 bytes result sent to driver
23/09/24 21:30:12 INFO CoarseGrainedExecutorBackend: Got assigned task 100
23/09/24 21:30:12 INFO Executor: Running task 100.0 in stage 0.0 (TID 100)
23/09/24 21:30:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13421772800-13555990528, partition values: [empty row]
23/09/24 21:30:12 INFO Executor: Finished task 86.0 in stage 0.0 (TID 86). 2145 bytes result sent to driver
23/09/24 21:30:12 INFO CoarseGrainedExecutorBackend: Got assigned task 101
23/09/24 21:30:12 INFO Executor: Running task 101.0 in stage 0.0 (TID 101)
23/09/24 21:30:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13555990528-13690208256, partition values: [empty row]
23/09/24 21:30:12 INFO Executor: Finished task 87.0 in stage 0.0 (TID 87). 2195 bytes result sent to driver
23/09/24 21:30:12 INFO CoarseGrainedExecutorBackend: Got assigned task 102
23/09/24 21:30:12 INFO Executor: Running task 102.0 in stage 0.0 (TID 102)
23/09/24 21:30:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13690208256-13824425984, partition values: [empty row]
23/09/24 21:30:12 INFO Executor: Finished task 89.0 in stage 0.0 (TID 89). 2195 bytes result sent to driver
23/09/24 21:30:12 INFO CoarseGrainedExecutorBackend: Got assigned task 103
23/09/24 21:30:12 INFO Executor: Running task 103.0 in stage 0.0 (TID 103)
23/09/24 21:30:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13824425984-13958643712, partition values: [empty row]
23/09/24 21:30:12 INFO Executor: Finished task 88.0 in stage 0.0 (TID 88). 2195 bytes result sent to driver
23/09/24 21:30:12 INFO CoarseGrainedExecutorBackend: Got assigned task 104
23/09/24 21:30:12 INFO Executor: Running task 104.0 in stage 0.0 (TID 104)
23/09/24 21:30:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13958643712-14092861440, partition values: [empty row]
23/09/24 21:30:13 INFO Executor: Finished task 100.0 in stage 0.0 (TID 100). 2195 bytes result sent to driver
23/09/24 21:30:13 INFO CoarseGrainedExecutorBackend: Got assigned task 115
23/09/24 21:30:13 INFO Executor: Running task 115.0 in stage 0.0 (TID 115)
23/09/24 21:30:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15435038720-15569256448, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 101.0 in stage 0.0 (TID 101). 2195 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 116
23/09/24 21:30:14 INFO Executor: Running task 116.0 in stage 0.0 (TID 116)
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15569256448-15703474176, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 102.0 in stage 0.0 (TID 102). 2195 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 117
23/09/24 21:30:14 INFO Executor: Running task 117.0 in stage 0.0 (TID 117)
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15703474176-15837691904, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 103.0 in stage 0.0 (TID 103). 2145 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 118
23/09/24 21:30:14 INFO Executor: Running task 118.0 in stage 0.0 (TID 118)
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15837691904-15971909632, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 104.0 in stage 0.0 (TID 104). 2195 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 123
23/09/24 21:30:14 INFO Executor: Running task 123.0 in stage 0.0 (TID 123)
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16508780544-16642998272, partition values: [empty row]
23/09/24 21:30:15 INFO Executor: Finished task 115.0 in stage 0.0 (TID 115). 2145 bytes result sent to driver
23/09/24 21:30:15 INFO CoarseGrainedExecutorBackend: Got assigned task 130
23/09/24 21:30:15 INFO Executor: Running task 130.0 in stage 0.0 (TID 130)
23/09/24 21:30:15 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17448304640-17582522368, partition values: [empty row]
23/09/24 21:30:15 INFO Executor: Finished task 116.0 in stage 0.0 (TID 116). 2145 bytes result sent to driver
23/09/24 21:30:15 INFO Executor: Finished task 118.0 in stage 0.0 (TID 118). 2145 bytes result sent to driver
23/09/24 21:30:15 INFO CoarseGrainedExecutorBackend: Got assigned task 136
23/09/24 21:30:15 INFO Executor: Running task 136.0 in stage 0.0 (TID 136)
23/09/24 21:30:15 INFO CoarseGrainedExecutorBackend: Got assigned task 137
23/09/24 21:30:15 INFO Executor: Running task 137.0 in stage 0.0 (TID 137)
23/09/24 21:30:15 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18253611008-18387828736, partition values: [empty row]
23/09/24 21:30:15 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18387828736-18522046464, partition values: [empty row]
23/09/24 21:30:15 INFO Executor: Finished task 117.0 in stage 0.0 (TID 117). 2145 bytes result sent to driver
23/09/24 21:30:15 INFO CoarseGrainedExecutorBackend: Got assigned task 138
23/09/24 21:30:15 INFO Executor: Running task 138.0 in stage 0.0 (TID 138)
23/09/24 21:30:15 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18522046464-18656264192, partition values: [empty row]
23/09/24 21:30:15 INFO Executor: Finished task 123.0 in stage 0.0 (TID 123). 2195 bytes result sent to driver
23/09/24 21:30:15 INFO CoarseGrainedExecutorBackend: Got assigned task 139
23/09/24 21:30:15 INFO Executor: Running task 139.0 in stage 0.0 (TID 139)
23/09/24 21:30:15 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18656264192-18790481920, partition values: [empty row]
23/09/24 21:30:16 INFO Executor: Finished task 130.0 in stage 0.0 (TID 130). 2145 bytes result sent to driver
23/09/24 21:30:16 INFO CoarseGrainedExecutorBackend: Got assigned task 149
23/09/24 21:30:16 INFO Executor: Running task 149.0 in stage 0.0 (TID 149)
23/09/24 21:30:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19998441472-20012106932, partition values: [empty row]
23/09/24 21:30:16 INFO Executor: Finished task 149.0 in stage 0.0 (TID 149). 2121 bytes result sent to driver
23/09/24 21:30:17 INFO Executor: Finished task 137.0 in stage 0.0 (TID 137). 2195 bytes result sent to driver
23/09/24 21:30:17 INFO Executor: Finished task 136.0 in stage 0.0 (TID 136). 2195 bytes result sent to driver
23/09/24 21:30:17 INFO Executor: Finished task 138.0 in stage 0.0 (TID 138). 2195 bytes result sent to driver
23/09/24 21:30:17 INFO Executor: Finished task 139.0 in stage 0.0 (TID 139). 2145 bytes result sent to driver
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 152
23/09/24 21:30:18 INFO Executor: Running task 2.0 in stage 1.0 (TID 152)
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 155
23/09/24 21:30:18 INFO Executor: Running task 5.0 in stage 1.0 (TID 155)
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 158
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 161
23/09/24 21:30:18 INFO Executor: Running task 8.0 in stage 1.0 (TID 158)
23/09/24 21:30:18 INFO Executor: Running task 11.0 in stage 1.0 (TID 161)
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 164
23/09/24 21:30:18 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:18 INFO Executor: Running task 14.0 in stage 1.0 (TID 164)
23/09/24 21:30:18 INFO TransportClientFactory: Successfully created connection to static.154.188.161.5.clients.your-server.de/5.161.188.154:37905 after 2 ms (0 ms spent in bootstraps)
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 7.3 KiB, free 5.2 GiB)
23/09/24 21:30:18 INFO TorrentBroadcast: Reading broadcast variable 3 took 15 ms
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 14.3 KiB, free 5.2 GiB)
23/09/24 21:30:18 INFO CodeGenerator: Code generated in 27.757716 ms
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1476395008-1610612736, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 671088640-805306368, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 268435456-402653184, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1073741824-1207959552, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1879048192-2013265920, partition values: [empty row]
23/09/24 21:30:18 INFO CodeGenerator: Code generated in 10.807342 ms
23/09/24 21:30:18 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 24.8 KiB, free 5.2 GiB)
23/09/24 21:30:18 INFO TorrentBroadcast: Reading broadcast variable 2 took 8 ms
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 394.6 KiB, free 5.2 GiB)
23/09/24 21:30:19 INFO Executor: Finished task 14.0 in stage 1.0 (TID 164). 1844 bytes result sent to driver
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 165
23/09/24 21:30:19 INFO Executor: Running task 15.0 in stage 1.0 (TID 165)
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2013265920-2147483648, partition values: [empty row]
23/09/24 21:30:19 INFO Executor: Finished task 5.0 in stage 1.0 (TID 155). 1844 bytes result sent to driver
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 166
23/09/24 21:30:19 INFO Executor: Running task 16.0 in stage 1.0 (TID 166)
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2147483648-2281701376, partition values: [empty row]
23/09/24 21:30:19 INFO Executor: Finished task 8.0 in stage 1.0 (TID 158). 1844 bytes result sent to driver
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 167
23/09/24 21:30:19 INFO Executor: Running task 17.0 in stage 1.0 (TID 167)
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2281701376-2415919104, partition values: [empty row]
23/09/24 21:30:19 INFO Executor: Finished task 2.0 in stage 1.0 (TID 152). 1844 bytes result sent to driver
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 168
23/09/24 21:30:19 INFO Executor: Running task 18.0 in stage 1.0 (TID 168)
23/09/24 21:30:19 INFO Executor: Finished task 11.0 in stage 1.0 (TID 161). 1844 bytes result sent to driver
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2415919104-2550136832, partition values: [empty row]
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 169
23/09/24 21:30:19 INFO Executor: Running task 19.0 in stage 1.0 (TID 169)
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2550136832-2684354560, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 17.0 in stage 1.0 (TID 167). 1844 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 180
23/09/24 21:30:20 INFO Executor: Running task 30.0 in stage 1.0 (TID 180)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4026531840-4160749568, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 15.0 in stage 1.0 (TID 165). 1844 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 181
23/09/24 21:30:20 INFO Executor: Running task 31.0 in stage 1.0 (TID 181)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4160749568-4294967296, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 16.0 in stage 1.0 (TID 166). 1844 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 182
23/09/24 21:30:20 INFO Executor: Running task 32.0 in stage 1.0 (TID 182)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4294967296-4429185024, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 18.0 in stage 1.0 (TID 168). 1844 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 184
23/09/24 21:30:20 INFO Executor: Running task 34.0 in stage 1.0 (TID 184)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4563402752-4697620480, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 19.0 in stage 1.0 (TID 169). 1844 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 185
23/09/24 21:30:20 INFO Executor: Running task 35.0 in stage 1.0 (TID 185)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4697620480-4831838208, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 30.0 in stage 1.0 (TID 180). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 195
23/09/24 21:30:21 INFO Executor: Running task 45.0 in stage 1.0 (TID 195)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6039797760-6174015488, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 32.0 in stage 1.0 (TID 182). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 196
23/09/24 21:30:21 INFO Executor: Running task 46.0 in stage 1.0 (TID 196)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6174015488-6308233216, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 31.0 in stage 1.0 (TID 181). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 197
23/09/24 21:30:21 INFO Executor: Running task 47.0 in stage 1.0 (TID 197)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6308233216-6442450944, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 35.0 in stage 1.0 (TID 185). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 199
23/09/24 21:30:21 INFO Executor: Running task 49.0 in stage 1.0 (TID 199)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6576668672-6710886400, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 34.0 in stage 1.0 (TID 184). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 201
23/09/24 21:30:21 INFO Executor: Running task 51.0 in stage 1.0 (TID 201)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6845104128-6979321856, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 46.0 in stage 1.0 (TID 196). 1887 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 210
23/09/24 21:30:21 INFO Executor: Running task 60.0 in stage 1.0 (TID 210)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8053063680-8187281408, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 45.0 in stage 1.0 (TID 195). 1930 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 211
23/09/24 21:30:21 INFO Executor: Running task 61.0 in stage 1.0 (TID 211)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8187281408-8321499136, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 47.0 in stage 1.0 (TID 197). 1887 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 212
23/09/24 21:30:21 INFO Executor: Running task 62.0 in stage 1.0 (TID 212)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8321499136-8455716864, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 49.0 in stage 1.0 (TID 199). 1887 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 214
23/09/24 21:30:21 INFO Executor: Running task 64.0 in stage 1.0 (TID 214)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8589934592-8724152320, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 51.0 in stage 1.0 (TID 201). 1887 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 216
23/09/24 21:30:21 INFO Executor: Running task 66.0 in stage 1.0 (TID 216)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8858370048-8992587776, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 60.0 in stage 1.0 (TID 210). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 225
23/09/24 21:30:22 INFO Executor: Running task 75.0 in stage 1.0 (TID 225)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10066329600-10200547328, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 61.0 in stage 1.0 (TID 211). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 226
23/09/24 21:30:22 INFO Executor: Running task 76.0 in stage 1.0 (TID 226)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10200547328-10334765056, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 62.0 in stage 1.0 (TID 212). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 227
23/09/24 21:30:22 INFO Executor: Running task 77.0 in stage 1.0 (TID 227)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10334765056-10468982784, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 64.0 in stage 1.0 (TID 214). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 229
23/09/24 21:30:22 INFO Executor: Running task 79.0 in stage 1.0 (TID 229)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10603200512-10737418240, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 66.0 in stage 1.0 (TID 216). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 230
23/09/24 21:30:22 INFO Executor: Running task 80.0 in stage 1.0 (TID 230)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10737418240-10871635968, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 75.0 in stage 1.0 (TID 225). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 239
23/09/24 21:30:23 INFO Executor: Running task 89.0 in stage 1.0 (TID 239)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11945377792-12079595520, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 76.0 in stage 1.0 (TID 226). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 241
23/09/24 21:30:23 INFO Executor: Running task 91.0 in stage 1.0 (TID 241)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12213813248-12348030976, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 77.0 in stage 1.0 (TID 227). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 242
23/09/24 21:30:23 INFO Executor: Running task 92.0 in stage 1.0 (TID 242)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12348030976-12482248704, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 79.0 in stage 1.0 (TID 229). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 243
23/09/24 21:30:23 INFO Executor: Running task 93.0 in stage 1.0 (TID 243)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12482248704-12616466432, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 80.0 in stage 1.0 (TID 230). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 245
23/09/24 21:30:23 INFO Executor: Running task 95.0 in stage 1.0 (TID 245)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12750684160-12884901888, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 89.0 in stage 1.0 (TID 239). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 253
23/09/24 21:30:23 INFO Executor: Running task 103.0 in stage 1.0 (TID 253)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13824425984-13958643712, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 91.0 in stage 1.0 (TID 241). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 254
23/09/24 21:30:23 INFO Executor: Running task 104.0 in stage 1.0 (TID 254)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13958643712-14092861440, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 92.0 in stage 1.0 (TID 242). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 256
23/09/24 21:30:23 INFO Executor: Running task 106.0 in stage 1.0 (TID 256)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14227079168-14361296896, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 93.0 in stage 1.0 (TID 243). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 257
23/09/24 21:30:23 INFO Executor: Running task 107.0 in stage 1.0 (TID 257)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14361296896-14495514624, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 95.0 in stage 1.0 (TID 245). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 260
23/09/24 21:30:24 INFO Executor: Running task 110.0 in stage 1.0 (TID 260)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14763950080-14898167808, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 103.0 in stage 1.0 (TID 253). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 266
23/09/24 21:30:24 INFO Executor: Finished task 104.0 in stage 1.0 (TID 254). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO Executor: Running task 116.0 in stage 1.0 (TID 266)
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 267
23/09/24 21:30:24 INFO Executor: Running task 117.0 in stage 1.0 (TID 267)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15569256448-15703474176, partition values: [empty row]
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15703474176-15837691904, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 106.0 in stage 1.0 (TID 256). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 268
23/09/24 21:30:24 INFO Executor: Running task 118.0 in stage 1.0 (TID 268)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15837691904-15971909632, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 107.0 in stage 1.0 (TID 257). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 272
23/09/24 21:30:24 INFO Executor: Running task 122.0 in stage 1.0 (TID 272)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16374562816-16508780544, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 110.0 in stage 1.0 (TID 260). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 275
23/09/24 21:30:24 INFO Executor: Running task 125.0 in stage 1.0 (TID 275)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16777216000-16911433728, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 116.0 in stage 1.0 (TID 266). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 280
23/09/24 21:30:25 INFO Executor: Running task 130.0 in stage 1.0 (TID 280)
23/09/24 21:30:25 INFO Executor: Finished task 118.0 in stage 1.0 (TID 268). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17448304640-17582522368, partition values: [empty row]
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 281
23/09/24 21:30:25 INFO Executor: Running task 131.0 in stage 1.0 (TID 281)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17582522368-17716740096, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 117.0 in stage 1.0 (TID 267). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 282
23/09/24 21:30:25 INFO Executor: Running task 132.0 in stage 1.0 (TID 282)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17716740096-17850957824, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 122.0 in stage 1.0 (TID 272). 1887 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 286
23/09/24 21:30:25 INFO Executor: Running task 136.0 in stage 1.0 (TID 286)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18253611008-18387828736, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 125.0 in stage 1.0 (TID 275). 1887 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 289
23/09/24 21:30:25 INFO Executor: Running task 139.0 in stage 1.0 (TID 289)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18656264192-18790481920, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 132.0 in stage 1.0 (TID 282). 1887 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 295
23/09/24 21:30:25 INFO Executor: Running task 145.0 in stage 1.0 (TID 295)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19461570560-19595788288, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 130.0 in stage 1.0 (TID 280). 1887 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 296
23/09/24 21:30:25 INFO Executor: Running task 146.0 in stage 1.0 (TID 296)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19595788288-19730006016, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 131.0 in stage 1.0 (TID 281). 1887 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 297
23/09/24 21:30:25 INFO Executor: Running task 147.0 in stage 1.0 (TID 297)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19730006016-19864223744, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 136.0 in stage 1.0 (TID 286). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 299
23/09/24 21:30:25 INFO Executor: Running task 149.0 in stage 1.0 (TID 299)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19998441472-20012106932, partition values: [empty row]
23/09/24 21:30:26 INFO Executor: Finished task 139.0 in stage 1.0 (TID 289). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 149.0 in stage 1.0 (TID 299). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 145.0 in stage 1.0 (TID 295). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 146.0 in stage 1.0 (TID 296). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 147.0 in stage 1.0 (TID 297). 1844 bytes result sent to driver
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 303
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 306
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 309
23/09/24 21:30:27 INFO Executor: Running task 5.0 in stage 3.0 (TID 306)
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 312
23/09/24 21:30:27 INFO Executor: Running task 8.0 in stage 3.0 (TID 309)
23/09/24 21:30:27 INFO Executor: Running task 11.0 in stage 3.0 (TID 312)
23/09/24 21:30:27 INFO Executor: Running task 2.0 in stage 3.0 (TID 303)
23/09/24 21:30:27 INFO MapOutputTrackerWorker: Updating epoch to 1 and clearing cache
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 315
23/09/24 21:30:27 INFO Executor: Running task 14.0 in stage 3.0 (TID 315)
23/09/24 21:30:27 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:27 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 26.8 KiB, free 5.2 GiB)
23/09/24 21:30:27 INFO TorrentBroadcast: Reading broadcast variable 6 took 8 ms
23/09/24 21:30:27 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 92.6 KiB, free 5.2 GiB)
23/09/24 21:30:27 INFO CodeGenerator: Code generated in 112.13474 ms
23/09/24 21:30:28 INFO CodeGenerator: Code generated in 126.598272 ms
23/09/24 21:30:28 INFO CodeGenerator: Code generated in 30.606352 ms
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 268435456-402653184, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1073741824-1207959552, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 671088640-805306368, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1879048192-2013265920, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1476395008-1610612736, partition values: [empty row]
23/09/24 21:30:28 INFO CodeGenerator: Code generated in 51.398436 ms
23/09/24 21:30:28 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:28 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:42443 after 7 ms (0 ms spent in bootstraps)
23/09/24 21:30:28 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 24.8 KiB, free 5.2 GiB)
23/09/24 21:30:28 INFO TorrentBroadcast: Reading broadcast variable 5 took 31 ms
23/09/24 21:30:28 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 394.6 KiB, free 5.2 GiB)
23/09/24 21:30:29 INFO CodeGenerator: Code generated in 143.810439 ms
23/09/24 21:30:33 INFO MemoryStore: Block rdd_22_11 stored as values in memory (estimated size 87.1 MiB, free 5.1 GiB)
23/09/24 21:30:33 INFO MemoryStore: Block rdd_22_2 stored as values in memory (estimated size 116.9 MiB, free 5.0 GiB)
23/09/24 21:30:33 INFO CodeGenerator: Code generated in 12.858222 ms
23/09/24 21:30:33 INFO CodeGenerator: Code generated in 86.286376 ms
23/09/24 21:30:33 INFO Executor: Finished task 11.0 in stage 3.0 (TID 312). 2452 bytes result sent to driver
23/09/24 21:30:33 INFO CoarseGrainedExecutorBackend: Got assigned task 319
23/09/24 21:30:33 INFO Executor: Running task 18.0 in stage 3.0 (TID 319)
23/09/24 21:30:33 INFO Executor: Finished task 2.0 in stage 3.0 (TID 303). 2452 bytes result sent to driver
23/09/24 21:30:33 INFO CoarseGrainedExecutorBackend: Got assigned task 321
23/09/24 21:30:33 INFO Executor: Running task 20.0 in stage 3.0 (TID 321)
23/09/24 21:30:33 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2684354560-2818572288, partition values: [empty row]
23/09/24 21:30:34 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2415919104-2550136832, partition values: [empty row]
23/09/24 21:30:34 INFO MemoryStore: Block rdd_22_5 stored as values in memory (estimated size 116.9 MiB, free 4.8 GiB)
23/09/24 21:30:34 INFO Executor: Finished task 5.0 in stage 3.0 (TID 306). 2452 bytes result sent to driver
23/09/24 21:30:34 INFO CoarseGrainedExecutorBackend: Got assigned task 323
23/09/24 21:30:34 INFO Executor: Running task 22.0 in stage 3.0 (TID 323)
23/09/24 21:30:34 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2952790016-3087007744, partition values: [empty row]
23/09/24 21:30:34 INFO MemoryStore: Block rdd_22_14 stored as values in memory (estimated size 116.6 MiB, free 4.7 GiB)
23/09/24 21:30:34 INFO Executor: Finished task 14.0 in stage 3.0 (TID 315). 2452 bytes result sent to driver
23/09/24 21:30:34 INFO CoarseGrainedExecutorBackend: Got assigned task 325
23/09/24 21:30:34 INFO Executor: Running task 24.0 in stage 3.0 (TID 325)
23/09/24 21:30:34 INFO MemoryStore: Block rdd_22_8 stored as values in memory (estimated size 116.9 MiB, free 4.6 GiB)
23/09/24 21:30:34 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3221225472-3355443200, partition values: [empty row]
23/09/24 21:30:34 INFO Executor: Finished task 8.0 in stage 3.0 (TID 309). 2452 bytes result sent to driver
23/09/24 21:30:34 INFO CoarseGrainedExecutorBackend: Got assigned task 327
23/09/24 21:30:34 INFO Executor: Running task 26.0 in stage 3.0 (TID 327)
23/09/24 21:30:34 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3489660928-3623878656, partition values: [empty row]
23/09/24 21:30:37 INFO MemoryStore: Block rdd_22_18 stored as values in memory (estimated size 116.6 MiB, free 4.5 GiB)
23/09/24 21:30:37 INFO Executor: Finished task 18.0 in stage 3.0 (TID 319). 2452 bytes result sent to driver
23/09/24 21:30:37 INFO CoarseGrainedExecutorBackend: Got assigned task 332
23/09/24 21:30:37 INFO Executor: Running task 31.0 in stage 3.0 (TID 332)
23/09/24 21:30:37 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4160749568-4294967296, partition values: [empty row]
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_20 stored as values in memory (estimated size 116.6 MiB, free 4.4 GiB)
23/09/24 21:30:38 INFO Executor: Finished task 20.0 in stage 3.0 (TID 321). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 336
23/09/24 21:30:38 INFO Executor: Running task 35.0 in stage 3.0 (TID 336)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4697620480-4831838208, partition values: [empty row]
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_26 stored as values in memory (estimated size 116.9 MiB, free 4.3 GiB)
23/09/24 21:30:38 INFO Executor: Finished task 26.0 in stage 3.0 (TID 327). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 337
23/09/24 21:30:38 INFO Executor: Running task 36.0 in stage 3.0 (TID 337)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4831838208-4966055936, partition values: [empty row]
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_22 stored as values in memory (estimated size 119.4 MiB, free 4.2 GiB)
23/09/24 21:30:38 INFO Executor: Finished task 22.0 in stage 3.0 (TID 323). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 340
23/09/24 21:30:38 INFO Executor: Running task 39.0 in stage 3.0 (TID 340)
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_24 stored as values in memory (estimated size 118.9 MiB, free 4.0 GiB)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5234491392-5368709120, partition values: [empty row]
23/09/24 21:30:38 INFO Executor: Finished task 24.0 in stage 3.0 (TID 325). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 342
23/09/24 21:30:38 INFO Executor: Running task 41.0 in stage 3.0 (TID 342)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5502926848-5637144576, partition values: [empty row]
23/09/24 21:30:41 INFO MemoryStore: Block rdd_22_31 stored as values in memory (estimated size 116.7 MiB, free 3.9 GiB)
23/09/24 21:30:41 INFO Executor: Finished task 31.0 in stage 3.0 (TID 332). 2452 bytes result sent to driver
23/09/24 21:30:41 INFO CoarseGrainedExecutorBackend: Got assigned task 347
23/09/24 21:30:41 INFO Executor: Running task 46.0 in stage 3.0 (TID 347)
23/09/24 21:30:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6174015488-6308233216, partition values: [empty row]
23/09/24 21:30:41 INFO MemoryStore: Block rdd_22_35 stored as values in memory (estimated size 116.7 MiB, free 3.8 GiB)
23/09/24 21:30:41 INFO Executor: Finished task 35.0 in stage 3.0 (TID 336). 2452 bytes result sent to driver
23/09/24 21:30:41 INFO CoarseGrainedExecutorBackend: Got assigned task 351
23/09/24 21:30:41 INFO Executor: Running task 50.0 in stage 3.0 (TID 351)
23/09/24 21:30:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6710886400-6845104128, partition values: [empty row]
23/09/24 21:30:41 INFO MemoryStore: Block rdd_22_36 stored as values in memory (estimated size 116.7 MiB, free 3.7 GiB)
23/09/24 21:30:41 INFO Executor: Finished task 36.0 in stage 3.0 (TID 337). 2452 bytes result sent to driver
23/09/24 21:30:41 INFO CoarseGrainedExecutorBackend: Got assigned task 353
23/09/24 21:30:41 INFO Executor: Running task 52.0 in stage 3.0 (TID 353)
23/09/24 21:30:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6979321856-7113539584, partition values: [empty row]
23/09/24 21:30:42 INFO MemoryStore: Block rdd_22_39 stored as values in memory (estimated size 116.7 MiB, free 3.6 GiB)
23/09/24 21:30:42 INFO Executor: Finished task 39.0 in stage 3.0 (TID 340). 2452 bytes result sent to driver
23/09/24 21:30:42 INFO CoarseGrainedExecutorBackend: Got assigned task 357
23/09/24 21:30:42 INFO Executor: Running task 56.0 in stage 3.0 (TID 357)
23/09/24 21:30:42 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7516192768-7650410496, partition values: [empty row]
23/09/24 21:30:42 INFO MemoryStore: Block rdd_22_41 stored as values in memory (estimated size 116.7 MiB, free 3.5 GiB)
23/09/24 21:30:42 INFO Executor: Finished task 41.0 in stage 3.0 (TID 342). 2452 bytes result sent to driver
23/09/24 21:30:42 INFO CoarseGrainedExecutorBackend: Got assigned task 359
23/09/24 21:30:42 INFO Executor: Running task 58.0 in stage 3.0 (TID 359)
23/09/24 21:30:42 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7784628224-7918845952, partition values: [empty row]
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_46 stored as values in memory (estimated size 114.5 MiB, free 3.4 GiB)
23/09/24 21:30:45 INFO Executor: Finished task 46.0 in stage 3.0 (TID 347). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 362
23/09/24 21:30:45 INFO Executor: Running task 61.0 in stage 3.0 (TID 362)
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8187281408-8321499136, partition values: [empty row]
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_50 stored as values in memory (estimated size 114.0 MiB, free 3.2 GiB)
23/09/24 21:30:45 INFO Executor: Finished task 50.0 in stage 3.0 (TID 351). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 363
23/09/24 21:30:45 INFO Executor: Running task 62.0 in stage 3.0 (TID 363)
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8321499136-8455716864, partition values: [empty row]
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_52 stored as values in memory (estimated size 110.0 MiB, free 3.1 GiB)
23/09/24 21:30:45 INFO Executor: Finished task 52.0 in stage 3.0 (TID 353). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 366
23/09/24 21:30:45 INFO Executor: Running task 65.0 in stage 3.0 (TID 366)
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8724152320-8858370048, partition values: [empty row]
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_58 stored as values in memory (estimated size 116.8 MiB, free 3.0 GiB)
23/09/24 21:30:45 INFO Executor: Finished task 58.0 in stage 3.0 (TID 359). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 369
23/09/24 21:30:45 INFO Executor: Running task 68.0 in stage 3.0 (TID 369)
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9126805504-9261023232, partition values: [empty row]
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_56 stored as values in memory (estimated size 115.2 MiB, free 2.9 GiB)
23/09/24 21:30:45 INFO Executor: Finished task 56.0 in stage 3.0 (TID 357). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 371
23/09/24 21:30:45 INFO Executor: Running task 70.0 in stage 3.0 (TID 371)
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9395240960-9529458688, partition values: [empty row]
23/09/24 21:30:48 INFO MemoryStore: Block rdd_22_61 stored as values in memory (estimated size 116.8 MiB, free 2.8 GiB)
23/09/24 21:30:48 INFO Executor: Finished task 61.0 in stage 3.0 (TID 362). 2452 bytes result sent to driver
23/09/24 21:30:48 INFO CoarseGrainedExecutorBackend: Got assigned task 376
23/09/24 21:30:48 INFO Executor: Running task 75.0 in stage 3.0 (TID 376)
23/09/24 21:30:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10066329600-10200547328, partition values: [empty row]
23/09/24 21:30:48 INFO MemoryStore: Block rdd_22_62 stored as values in memory (estimated size 116.9 MiB, free 2.7 GiB)
23/09/24 21:30:48 INFO Executor: Finished task 62.0 in stage 3.0 (TID 363). 2452 bytes result sent to driver
23/09/24 21:30:48 INFO CoarseGrainedExecutorBackend: Got assigned task 377
23/09/24 21:30:48 INFO Executor: Running task 76.0 in stage 3.0 (TID 377)
23/09/24 21:30:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10200547328-10334765056, partition values: [empty row]
23/09/24 21:30:49 INFO MemoryStore: Block rdd_22_65 stored as values in memory (estimated size 116.7 MiB, free 2.6 GiB)
23/09/24 21:30:49 INFO Executor: Finished task 65.0 in stage 3.0 (TID 366). 2452 bytes result sent to driver
23/09/24 21:30:49 INFO CoarseGrainedExecutorBackend: Got assigned task 381
23/09/24 21:30:49 INFO Executor: Running task 80.0 in stage 3.0 (TID 381)
23/09/24 21:30:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10737418240-10871635968, partition values: [empty row]
23/09/24 21:30:49 INFO MemoryStore: Block rdd_22_68 stored as values in memory (estimated size 116.7 MiB, free 2.5 GiB)
23/09/24 21:30:49 INFO Executor: Finished task 68.0 in stage 3.0 (TID 369). 2452 bytes result sent to driver
23/09/24 21:30:49 INFO CoarseGrainedExecutorBackend: Got assigned task 383
23/09/24 21:30:49 INFO Executor: Running task 82.0 in stage 3.0 (TID 383)
23/09/24 21:30:49 INFO MemoryStore: Block rdd_22_70 stored as values in memory (estimated size 116.7 MiB, free 2.3 GiB)
23/09/24 21:30:49 INFO Executor: Finished task 70.0 in stage 3.0 (TID 371). 2452 bytes result sent to driver
23/09/24 21:30:49 INFO CoarseGrainedExecutorBackend: Got assigned task 384
23/09/24 21:30:49 INFO Executor: Running task 83.0 in stage 3.0 (TID 384)
23/09/24 21:30:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11005853696-11140071424, partition values: [empty row]
23/09/24 21:30:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11140071424-11274289152, partition values: [empty row]
23/09/24 21:30:52 INFO MemoryStore: Block rdd_22_75 stored as values in memory (estimated size 116.8 MiB, free 2.2 GiB)
23/09/24 21:30:52 INFO Executor: Finished task 75.0 in stage 3.0 (TID 376). 2452 bytes result sent to driver
23/09/24 21:30:52 INFO CoarseGrainedExecutorBackend: Got assigned task 394
23/09/24 21:30:52 INFO Executor: Running task 93.0 in stage 3.0 (TID 394)
23/09/24 21:30:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12482248704-12616466432, partition values: [empty row]
23/09/24 21:30:52 INFO MemoryStore: Block rdd_22_76 stored as values in memory (estimated size 116.8 MiB, free 2.1 GiB)
23/09/24 21:30:52 INFO Executor: Finished task 76.0 in stage 3.0 (TID 377). 2452 bytes result sent to driver
23/09/24 21:30:52 INFO CoarseGrainedExecutorBackend: Got assigned task 395
23/09/24 21:30:52 INFO Executor: Running task 94.0 in stage 3.0 (TID 395)
23/09/24 21:30:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12616466432-12750684160, partition values: [empty row]
23/09/24 21:30:53 INFO MemoryStore: Block rdd_22_80 stored as values in memory (estimated size 116.6 MiB, free 2.0 GiB)
23/09/24 21:30:53 INFO Executor: Finished task 80.0 in stage 3.0 (TID 381). 2452 bytes result sent to driver
23/09/24 21:30:53 INFO CoarseGrainedExecutorBackend: Got assigned task 397
23/09/24 21:30:53 INFO Executor: Running task 96.0 in stage 3.0 (TID 397)
23/09/24 21:30:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12884901888-13019119616, partition values: [empty row]
23/09/24 21:30:53 INFO MemoryStore: Block rdd_22_82 stored as values in memory (estimated size 116.9 MiB, free 1932.1 MiB)
23/09/24 21:30:53 INFO Executor: Finished task 82.0 in stage 3.0 (TID 383). 2452 bytes result sent to driver
23/09/24 21:30:53 INFO CoarseGrainedExecutorBackend: Got assigned task 398
23/09/24 21:30:53 INFO Executor: Running task 97.0 in stage 3.0 (TID 398)
23/09/24 21:30:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13019119616-13153337344, partition values: [empty row]
23/09/24 21:30:53 INFO MemoryStore: Block rdd_22_83 stored as values in memory (estimated size 116.9 MiB, free 1815.2 MiB)
23/09/24 21:30:53 INFO Executor: Finished task 83.0 in stage 3.0 (TID 384). 2452 bytes result sent to driver
23/09/24 21:30:53 INFO CoarseGrainedExecutorBackend: Got assigned task 399
23/09/24 21:30:53 INFO Executor: Running task 98.0 in stage 3.0 (TID 399)
23/09/24 21:30:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13153337344-13287555072, partition values: [empty row]
23/09/24 21:30:56 INFO MemoryStore: Block rdd_22_93 stored as values in memory (estimated size 116.7 MiB, free 1698.6 MiB)
23/09/24 21:30:56 INFO Executor: Finished task 93.0 in stage 3.0 (TID 394). 2452 bytes result sent to driver
23/09/24 21:30:56 INFO CoarseGrainedExecutorBackend: Got assigned task 408
23/09/24 21:30:56 INFO Executor: Running task 107.0 in stage 3.0 (TID 408)
23/09/24 21:30:56 INFO MemoryStore: Block rdd_22_94 stored as values in memory (estimated size 116.6 MiB, free 1582.0 MiB)
23/09/24 21:30:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14361296896-14495514624, partition values: [empty row]
23/09/24 21:30:56 INFO Executor: Finished task 94.0 in stage 3.0 (TID 395). 2452 bytes result sent to driver
23/09/24 21:30:56 INFO CoarseGrainedExecutorBackend: Got assigned task 410
23/09/24 21:30:56 INFO Executor: Running task 109.0 in stage 3.0 (TID 410)
23/09/24 21:30:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14629732352-14763950080, partition values: [empty row]
23/09/24 21:30:57 INFO MemoryStore: Block rdd_22_96 stored as values in memory (estimated size 116.7 MiB, free 1465.3 MiB)
23/09/24 21:30:57 INFO Executor: Finished task 96.0 in stage 3.0 (TID 397). 2452 bytes result sent to driver
23/09/24 21:30:57 INFO CoarseGrainedExecutorBackend: Got assigned task 414
23/09/24 21:30:57 INFO Executor: Running task 113.0 in stage 3.0 (TID 414)
23/09/24 21:30:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15166603264-15300820992, partition values: [empty row]
23/09/24 21:30:57 INFO MemoryStore: Block rdd_22_97 stored as values in memory (estimated size 116.8 MiB, free 1348.5 MiB)
23/09/24 21:30:57 INFO Executor: Finished task 97.0 in stage 3.0 (TID 398). 2452 bytes result sent to driver
23/09/24 21:30:57 INFO CoarseGrainedExecutorBackend: Got assigned task 416
23/09/24 21:30:57 INFO Executor: Running task 115.0 in stage 3.0 (TID 416)
23/09/24 21:30:57 INFO MemoryStore: Block rdd_22_98 stored as values in memory (estimated size 116.6 MiB, free 1231.8 MiB)
23/09/24 21:30:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15435038720-15569256448, partition values: [empty row]
23/09/24 21:30:57 INFO Executor: Finished task 98.0 in stage 3.0 (TID 399). 2452 bytes result sent to driver
23/09/24 21:30:57 INFO CoarseGrainedExecutorBackend: Got assigned task 417
23/09/24 21:30:57 INFO Executor: Running task 116.0 in stage 3.0 (TID 417)
23/09/24 21:30:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15569256448-15703474176, partition values: [empty row]
23/09/24 21:31:00 INFO MemoryStore: Block rdd_22_109 stored as values in memory (estimated size 116.9 MiB, free 1114.9 MiB)
23/09/24 21:31:00 INFO Executor: Finished task 109.0 in stage 3.0 (TID 410). 2452 bytes result sent to driver
23/09/24 21:31:00 INFO CoarseGrainedExecutorBackend: Got assigned task 421
23/09/24 21:31:00 INFO Executor: Running task 120.0 in stage 3.0 (TID 421)
23/09/24 21:31:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16106127360-16240345088, partition values: [empty row]
23/09/24 21:31:00 INFO MemoryStore: Block rdd_22_107 stored as values in memory (estimated size 116.9 MiB, free 998.0 MiB)
23/09/24 21:31:00 INFO Executor: Finished task 107.0 in stage 3.0 (TID 408). 2452 bytes result sent to driver
23/09/24 21:31:00 INFO CoarseGrainedExecutorBackend: Got assigned task 423
23/09/24 21:31:00 INFO Executor: Running task 122.0 in stage 3.0 (TID 423)
23/09/24 21:31:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16374562816-16508780544, partition values: [empty row]
23/09/24 21:31:01 INFO MemoryStore: Block rdd_22_116 stored as values in memory (estimated size 116.9 MiB, free 881.1 MiB)
23/09/24 21:31:01 INFO Executor: Finished task 116.0 in stage 3.0 (TID 417). 2452 bytes result sent to driver
23/09/24 21:31:01 INFO CoarseGrainedExecutorBackend: Got assigned task 427
23/09/24 21:31:01 INFO Executor: Running task 126.0 in stage 3.0 (TID 427)
23/09/24 21:31:01 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16911433728-17045651456, partition values: [empty row]
23/09/24 21:31:01 INFO MemoryStore: Block rdd_22_115 stored as values in memory (estimated size 116.9 MiB, free 764.2 MiB)
23/09/24 21:31:01 INFO Executor: Finished task 115.0 in stage 3.0 (TID 416). 2452 bytes result sent to driver
23/09/24 21:31:01 INFO CoarseGrainedExecutorBackend: Got assigned task 428
23/09/24 21:31:01 INFO Executor: Running task 127.0 in stage 3.0 (TID 428)
23/09/24 21:31:01 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17045651456-17179869184, partition values: [empty row]
23/09/24 21:31:01 INFO MemoryStore: Block rdd_22_113 stored as values in memory (estimated size 116.9 MiB, free 647.3 MiB)
23/09/24 21:31:01 INFO Executor: Finished task 113.0 in stage 3.0 (TID 414). 2452 bytes result sent to driver
23/09/24 21:31:01 INFO CoarseGrainedExecutorBackend: Got assigned task 429
23/09/24 21:31:01 INFO Executor: Running task 128.0 in stage 3.0 (TID 429)
23/09/24 21:31:01 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17179869184-17314086912, partition values: [empty row]
23/09/24 21:31:04 INFO MemoryStore: Block rdd_22_120 stored as values in memory (estimated size 116.9 MiB, free 530.4 MiB)
23/09/24 21:31:04 INFO Executor: Finished task 120.0 in stage 3.0 (TID 421). 2452 bytes result sent to driver
23/09/24 21:31:04 INFO CoarseGrainedExecutorBackend: Got assigned task 439
23/09/24 21:31:04 INFO Executor: Running task 138.0 in stage 3.0 (TID 439)
23/09/24 21:31:04 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18522046464-18656264192, partition values: [empty row]
23/09/24 21:31:05 INFO MemoryStore: Block rdd_22_122 stored as values in memory (estimated size 116.9 MiB, free 413.5 MiB)
23/09/24 21:31:05 INFO Executor: Finished task 122.0 in stage 3.0 (TID 423). 2452 bytes result sent to driver
23/09/24 21:31:05 INFO CoarseGrainedExecutorBackend: Got assigned task 441
23/09/24 21:31:05 INFO Executor: Running task 140.0 in stage 3.0 (TID 441)
23/09/24 21:31:05 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18790481920-18924699648, partition values: [empty row]
23/09/24 21:31:05 INFO MemoryStore: Block rdd_22_126 stored as values in memory (estimated size 116.9 MiB, free 296.5 MiB)
23/09/24 21:31:05 INFO Executor: Finished task 126.0 in stage 3.0 (TID 427). 2452 bytes result sent to driver
23/09/24 21:31:05 INFO CoarseGrainedExecutorBackend: Got assigned task 442
23/09/24 21:31:05 INFO Executor: Running task 141.0 in stage 3.0 (TID 442)
23/09/24 21:31:05 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18924699648-19058917376, partition values: [empty row]
23/09/24 21:31:05 INFO MemoryStore: Block rdd_22_127 stored as values in memory (estimated size 116.9 MiB, free 179.6 MiB)
23/09/24 21:31:05 INFO Executor: Finished task 127.0 in stage 3.0 (TID 428). 2452 bytes result sent to driver
23/09/24 21:31:05 INFO CoarseGrainedExecutorBackend: Got assigned task 443
23/09/24 21:31:05 INFO Executor: Running task 142.0 in stage 3.0 (TID 443)
23/09/24 21:31:05 INFO MemoryStore: Block rdd_22_128 stored as values in memory (estimated size 116.9 MiB, free 62.7 MiB)
23/09/24 21:31:05 INFO Executor: Finished task 128.0 in stage 3.0 (TID 429). 2452 bytes result sent to driver
23/09/24 21:31:05 INFO CoarseGrainedExecutorBackend: Got assigned task 444
23/09/24 21:31:05 INFO Executor: Running task 143.0 in stage 3.0 (TID 444)
23/09/24 21:31:05 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19058917376-19193135104, partition values: [empty row]
23/09/24 21:31:05 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19193135104-19327352832, partition values: [empty row]
23/09/24 21:31:07 INFO MemoryStore: Will not store rdd_22_138
23/09/24 21:31:07 WARN MemoryStore: Not enough space to cache rdd_22_138 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:07 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:07 INFO MemoryStore: Will not store rdd_22_140
23/09/24 21:31:07 WARN MemoryStore: Not enough space to cache rdd_22_140 in memory! (computed 64.9 MiB so far)
23/09/24 21:31:07 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:07 WARN BlockManager: Block rdd_22_138 could not be removed as it was not found on disk or in memory
23/09/24 21:31:07 WARN BlockManager: Block rdd_22_140 could not be removed as it was not found on disk or in memory
23/09/24 21:31:07 INFO MemoryStore: Will not store rdd_22_141
23/09/24 21:31:07 WARN BlockManager: Putting block rdd_22_138 failed
23/09/24 21:31:07 WARN BlockManager: Putting block rdd_22_140 failed
23/09/24 21:31:07 WARN MemoryStore: Not enough space to cache rdd_22_141 in memory! (computed 64.9 MiB so far)
23/09/24 21:31:07 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:07 WARN BlockManager: Block rdd_22_141 could not be removed as it was not found on disk or in memory
23/09/24 21:31:07 WARN BlockManager: Putting block rdd_22_141 failed
23/09/24 21:31:07 INFO MemoryStore: Will not store rdd_22_142
23/09/24 21:31:07 WARN MemoryStore: Not enough space to cache rdd_22_142 in memory! (computed 64.9 MiB so far)
23/09/24 21:31:07 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.4 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:07 WARN BlockManager: Block rdd_22_142 could not be removed as it was not found on disk or in memory
23/09/24 21:31:07 WARN BlockManager: Putting block rdd_22_142 failed