3.1.3 stderr log page for app-20230924213329-0006/0

Back to Master

Showing 102400 Bytes: 25914 - 128314 of 128314
544, partition values: [empty row]
23/09/24 21:33:47 INFO Executor: Finished task 106.0 in stage 0.0 (TID 106). 2195 bytes result sent to driver
23/09/24 21:33:47 INFO CoarseGrainedExecutorBackend: Got assigned task 123
23/09/24 21:33:47 INFO Executor: Running task 123.0 in stage 0.0 (TID 123)
23/09/24 21:33:47 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16508780544-16642998272, partition values: [empty row]
23/09/24 21:33:47 INFO Executor: Finished task 109.0 in stage 0.0 (TID 109). 2195 bytes result sent to driver
23/09/24 21:33:47 INFO CoarseGrainedExecutorBackend: Got assigned task 124
23/09/24 21:33:47 INFO Executor: Running task 124.0 in stage 0.0 (TID 124)
23/09/24 21:33:47 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16642998272-16777216000, partition values: [empty row]
23/09/24 21:33:48 INFO Executor: Finished task 120.0 in stage 0.0 (TID 120). 2145 bytes result sent to driver
23/09/24 21:33:48 INFO CoarseGrainedExecutorBackend: Got assigned task 135
23/09/24 21:33:48 INFO Executor: Running task 135.0 in stage 0.0 (TID 135)
23/09/24 21:33:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18119393280-18253611008, partition values: [empty row]
23/09/24 21:33:48 INFO Executor: Finished task 121.0 in stage 0.0 (TID 121). 2145 bytes result sent to driver
23/09/24 21:33:48 INFO CoarseGrainedExecutorBackend: Got assigned task 136
23/09/24 21:33:48 INFO Executor: Running task 136.0 in stage 0.0 (TID 136)
23/09/24 21:33:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18253611008-18387828736, partition values: [empty row]
23/09/24 21:33:48 INFO Executor: Finished task 122.0 in stage 0.0 (TID 122). 2195 bytes result sent to driver
23/09/24 21:33:48 INFO Executor: Finished task 123.0 in stage 0.0 (TID 123). 2195 bytes result sent to driver
23/09/24 21:33:48 INFO CoarseGrainedExecutorBackend: Got assigned task 137
23/09/24 21:33:48 INFO Executor: Running task 137.0 in stage 0.0 (TID 137)
23/09/24 21:33:48 INFO CoarseGrainedExecutorBackend: Got assigned task 138
23/09/24 21:33:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18387828736-18522046464, partition values: [empty row]
23/09/24 21:33:48 INFO Executor: Running task 138.0 in stage 0.0 (TID 138)
23/09/24 21:33:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18522046464-18656264192, partition values: [empty row]
23/09/24 21:33:48 INFO Executor: Finished task 124.0 in stage 0.0 (TID 124). 2195 bytes result sent to driver
23/09/24 21:33:48 INFO CoarseGrainedExecutorBackend: Got assigned task 139
23/09/24 21:33:48 INFO Executor: Running task 139.0 in stage 0.0 (TID 139)
23/09/24 21:33:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18656264192-18790481920, partition values: [empty row]
23/09/24 21:33:49 INFO Executor: Finished task 135.0 in stage 0.0 (TID 135). 2195 bytes result sent to driver
23/09/24 21:33:49 INFO CoarseGrainedExecutorBackend: Got assigned task 149
23/09/24 21:33:49 INFO Executor: Running task 149.0 in stage 0.0 (TID 149)
23/09/24 21:33:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19998441472-20012106932, partition values: [empty row]
23/09/24 21:33:49 INFO Executor: Finished task 136.0 in stage 0.0 (TID 136). 2195 bytes result sent to driver
23/09/24 21:33:49 INFO Executor: Finished task 138.0 in stage 0.0 (TID 138). 2195 bytes result sent to driver
23/09/24 21:33:50 INFO Executor: Finished task 137.0 in stage 0.0 (TID 137). 2195 bytes result sent to driver
23/09/24 21:33:50 INFO Executor: Finished task 149.0 in stage 0.0 (TID 149). 2121 bytes result sent to driver
23/09/24 21:33:50 INFO Executor: Finished task 139.0 in stage 0.0 (TID 139). 2145 bytes result sent to driver
23/09/24 21:33:52 INFO CoarseGrainedExecutorBackend: Got assigned task 150
23/09/24 21:33:52 INFO CoarseGrainedExecutorBackend: Got assigned task 153
23/09/24 21:33:52 INFO CoarseGrainedExecutorBackend: Got assigned task 156
23/09/24 21:33:52 INFO Executor: Running task 0.0 in stage 1.0 (TID 150)
23/09/24 21:33:52 INFO Executor: Running task 3.0 in stage 1.0 (TID 153)
23/09/24 21:33:52 INFO CoarseGrainedExecutorBackend: Got assigned task 159
23/09/24 21:33:52 INFO Executor: Running task 6.0 in stage 1.0 (TID 156)
23/09/24 21:33:52 INFO CoarseGrainedExecutorBackend: Got assigned task 162
23/09/24 21:33:52 INFO Executor: Running task 9.0 in stage 1.0 (TID 159)
23/09/24 21:33:52 INFO Executor: Running task 12.0 in stage 1.0 (TID 162)
23/09/24 21:33:52 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:33:52 INFO TransportClientFactory: Successfully created connection to static.154.188.161.5.clients.your-server.de/5.161.188.154:41733 after 1 ms (0 ms spent in bootstraps)
23/09/24 21:33:52 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 7.3 KiB, free 5.2 GiB)
23/09/24 21:33:52 INFO TorrentBroadcast: Reading broadcast variable 3 took 12 ms
23/09/24 21:33:52 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 14.3 KiB, free 5.2 GiB)
23/09/24 21:33:52 INFO CodeGenerator: Code generated in 38.467295 ms
23/09/24 21:33:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 805306368-939524096, partition values: [empty row]
23/09/24 21:33:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 402653184-536870912, partition values: [empty row]
23/09/24 21:33:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 0-134217728, partition values: [empty row]
23/09/24 21:33:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1610612736-1744830464, partition values: [empty row]
23/09/24 21:33:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1207959552-1342177280, partition values: [empty row]
23/09/24 21:33:52 INFO CodeGenerator: Code generated in 8.771236 ms
23/09/24 21:33:52 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:33:52 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 24.8 KiB, free 5.2 GiB)
23/09/24 21:33:52 INFO TorrentBroadcast: Reading broadcast variable 2 took 17 ms
23/09/24 21:33:52 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 394.6 KiB, free 5.2 GiB)
23/09/24 21:33:52 INFO Executor: Finished task 6.0 in stage 1.0 (TID 156). 1844 bytes result sent to driver
23/09/24 21:33:52 INFO CoarseGrainedExecutorBackend: Got assigned task 165
23/09/24 21:33:52 INFO Executor: Running task 15.0 in stage 1.0 (TID 165)
23/09/24 21:33:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2013265920-2147483648, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 9.0 in stage 1.0 (TID 159). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 166
23/09/24 21:33:53 INFO Executor: Running task 16.0 in stage 1.0 (TID 166)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2147483648-2281701376, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 0.0 in stage 1.0 (TID 150). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 167
23/09/24 21:33:53 INFO Executor: Running task 17.0 in stage 1.0 (TID 167)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2281701376-2415919104, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 3.0 in stage 1.0 (TID 153). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 168
23/09/24 21:33:53 INFO Executor: Running task 18.0 in stage 1.0 (TID 168)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2415919104-2550136832, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 12.0 in stage 1.0 (TID 162). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 170
23/09/24 21:33:53 INFO Executor: Running task 20.0 in stage 1.0 (TID 170)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2684354560-2818572288, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 15.0 in stage 1.0 (TID 165). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 178
23/09/24 21:33:53 INFO Executor: Running task 28.0 in stage 1.0 (TID 178)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3758096384-3892314112, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 16.0 in stage 1.0 (TID 166). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 181
23/09/24 21:33:53 INFO Executor: Running task 31.0 in stage 1.0 (TID 181)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4160749568-4294967296, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 17.0 in stage 1.0 (TID 167). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 182
23/09/24 21:33:53 INFO Executor: Running task 32.0 in stage 1.0 (TID 182)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4294967296-4429185024, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 18.0 in stage 1.0 (TID 168). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 183
23/09/24 21:33:53 INFO Executor: Running task 33.0 in stage 1.0 (TID 183)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4429185024-4563402752, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 20.0 in stage 1.0 (TID 170). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 184
23/09/24 21:33:53 INFO Executor: Running task 34.0 in stage 1.0 (TID 184)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4563402752-4697620480, partition values: [empty row]
23/09/24 21:33:54 INFO Executor: Finished task 31.0 in stage 1.0 (TID 181). 1844 bytes result sent to driver
23/09/24 21:33:54 INFO CoarseGrainedExecutorBackend: Got assigned task 186
23/09/24 21:33:54 INFO Executor: Running task 36.0 in stage 1.0 (TID 186)
23/09/24 21:33:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4831838208-4966055936, partition values: [empty row]
23/09/24 21:33:54 INFO Executor: Finished task 32.0 in stage 1.0 (TID 182). 1844 bytes result sent to driver
23/09/24 21:33:54 INFO CoarseGrainedExecutorBackend: Got assigned task 188
23/09/24 21:33:54 INFO Executor: Running task 38.0 in stage 1.0 (TID 188)
23/09/24 21:33:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5100273664-5234491392, partition values: [empty row]
23/09/24 21:33:54 INFO Executor: Finished task 34.0 in stage 1.0 (TID 184). 1844 bytes result sent to driver
23/09/24 21:33:54 INFO Executor: Finished task 33.0 in stage 1.0 (TID 183). 1887 bytes result sent to driver
23/09/24 21:33:54 INFO CoarseGrainedExecutorBackend: Got assigned task 190
23/09/24 21:33:54 INFO Executor: Running task 40.0 in stage 1.0 (TID 190)
23/09/24 21:33:54 INFO CoarseGrainedExecutorBackend: Got assigned task 191
23/09/24 21:33:54 INFO Executor: Running task 41.0 in stage 1.0 (TID 191)
23/09/24 21:33:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5502926848-5637144576, partition values: [empty row]
23/09/24 21:33:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5368709120-5502926848, partition values: [empty row]
23/09/24 21:33:54 INFO Executor: Finished task 28.0 in stage 1.0 (TID 178). 1844 bytes result sent to driver
23/09/24 21:33:54 INFO CoarseGrainedExecutorBackend: Got assigned task 193
23/09/24 21:33:54 INFO Executor: Running task 43.0 in stage 1.0 (TID 193)
23/09/24 21:33:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5771362304-5905580032, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 36.0 in stage 1.0 (TID 186). 1844 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 201
23/09/24 21:33:55 INFO Executor: Running task 51.0 in stage 1.0 (TID 201)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6845104128-6979321856, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 38.0 in stage 1.0 (TID 188). 1844 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 202
23/09/24 21:33:55 INFO Executor: Running task 52.0 in stage 1.0 (TID 202)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6979321856-7113539584, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 40.0 in stage 1.0 (TID 190). 1844 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 203
23/09/24 21:33:55 INFO Executor: Running task 53.0 in stage 1.0 (TID 203)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7113539584-7247757312, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 41.0 in stage 1.0 (TID 191). 1844 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 204
23/09/24 21:33:55 INFO Executor: Running task 54.0 in stage 1.0 (TID 204)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7247757312-7381975040, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 43.0 in stage 1.0 (TID 193). 1844 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 205
23/09/24 21:33:55 INFO Executor: Running task 55.0 in stage 1.0 (TID 205)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7381975040-7516192768, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 51.0 in stage 1.0 (TID 201). 1887 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 216
23/09/24 21:33:55 INFO Executor: Running task 66.0 in stage 1.0 (TID 216)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8858370048-8992587776, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 52.0 in stage 1.0 (TID 202). 1887 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 217
23/09/24 21:33:55 INFO Executor: Running task 67.0 in stage 1.0 (TID 217)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8992587776-9126805504, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 54.0 in stage 1.0 (TID 204). 1887 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 218
23/09/24 21:33:55 INFO Executor: Running task 68.0 in stage 1.0 (TID 218)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9126805504-9261023232, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 53.0 in stage 1.0 (TID 203). 1887 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 219
23/09/24 21:33:55 INFO Executor: Running task 69.0 in stage 1.0 (TID 219)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9261023232-9395240960, partition values: [empty row]
23/09/24 21:33:56 INFO Executor: Finished task 55.0 in stage 1.0 (TID 205). 1887 bytes result sent to driver
23/09/24 21:33:56 INFO CoarseGrainedExecutorBackend: Got assigned task 220
23/09/24 21:33:56 INFO Executor: Running task 70.0 in stage 1.0 (TID 220)
23/09/24 21:33:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9395240960-9529458688, partition values: [empty row]
23/09/24 21:33:56 INFO Executor: Finished task 67.0 in stage 1.0 (TID 217). 1844 bytes result sent to driver
23/09/24 21:33:56 INFO CoarseGrainedExecutorBackend: Got assigned task 231
23/09/24 21:33:56 INFO Executor: Running task 81.0 in stage 1.0 (TID 231)
23/09/24 21:33:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10871635968-11005853696, partition values: [empty row]
23/09/24 21:33:56 INFO Executor: Finished task 66.0 in stage 1.0 (TID 216). 1844 bytes result sent to driver
23/09/24 21:33:56 INFO CoarseGrainedExecutorBackend: Got assigned task 232
23/09/24 21:33:56 INFO Executor: Running task 82.0 in stage 1.0 (TID 232)
23/09/24 21:33:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11005853696-11140071424, partition values: [empty row]
23/09/24 21:33:56 INFO Executor: Finished task 68.0 in stage 1.0 (TID 218). 1844 bytes result sent to driver
23/09/24 21:33:56 INFO CoarseGrainedExecutorBackend: Got assigned task 233
23/09/24 21:33:56 INFO Executor: Finished task 70.0 in stage 1.0 (TID 220). 1844 bytes result sent to driver
23/09/24 21:33:56 INFO CoarseGrainedExecutorBackend: Got assigned task 234
23/09/24 21:33:56 INFO Executor: Running task 84.0 in stage 1.0 (TID 234)
23/09/24 21:33:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11274289152-11408506880, partition values: [empty row]
23/09/24 21:33:56 INFO Executor: Running task 83.0 in stage 1.0 (TID 233)
23/09/24 21:33:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11140071424-11274289152, partition values: [empty row]
23/09/24 21:33:56 INFO Executor: Finished task 69.0 in stage 1.0 (TID 219). 1844 bytes result sent to driver
23/09/24 21:33:56 INFO CoarseGrainedExecutorBackend: Got assigned task 235
23/09/24 21:33:56 INFO Executor: Running task 85.0 in stage 1.0 (TID 235)
23/09/24 21:33:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11408506880-11542724608, partition values: [empty row]
23/09/24 21:33:57 INFO Executor: Finished task 81.0 in stage 1.0 (TID 231). 1844 bytes result sent to driver
23/09/24 21:33:57 INFO CoarseGrainedExecutorBackend: Got assigned task 242
23/09/24 21:33:57 INFO Executor: Running task 92.0 in stage 1.0 (TID 242)
23/09/24 21:33:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12348030976-12482248704, partition values: [empty row]
23/09/24 21:33:57 INFO Executor: Finished task 85.0 in stage 1.0 (TID 235). 1844 bytes result sent to driver
23/09/24 21:33:57 INFO CoarseGrainedExecutorBackend: Got assigned task 244
23/09/24 21:33:57 INFO Executor: Running task 94.0 in stage 1.0 (TID 244)
23/09/24 21:33:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12616466432-12750684160, partition values: [empty row]
23/09/24 21:33:57 INFO Executor: Finished task 83.0 in stage 1.0 (TID 233). 1844 bytes result sent to driver
23/09/24 21:33:57 INFO CoarseGrainedExecutorBackend: Got assigned task 246
23/09/24 21:33:57 INFO Executor: Running task 96.0 in stage 1.0 (TID 246)
23/09/24 21:33:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12884901888-13019119616, partition values: [empty row]
23/09/24 21:33:57 INFO Executor: Finished task 82.0 in stage 1.0 (TID 232). 1844 bytes result sent to driver
23/09/24 21:33:57 INFO CoarseGrainedExecutorBackend: Got assigned task 247
23/09/24 21:33:57 INFO Executor: Running task 97.0 in stage 1.0 (TID 247)
23/09/24 21:33:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13019119616-13153337344, partition values: [empty row]
23/09/24 21:33:57 INFO Executor: Finished task 84.0 in stage 1.0 (TID 234). 1844 bytes result sent to driver
23/09/24 21:33:57 INFO CoarseGrainedExecutorBackend: Got assigned task 248
23/09/24 21:33:57 INFO Executor: Running task 98.0 in stage 1.0 (TID 248)
23/09/24 21:33:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13153337344-13287555072, partition values: [empty row]
23/09/24 21:33:58 INFO Executor: Finished task 96.0 in stage 1.0 (TID 246). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 251
23/09/24 21:33:58 INFO Executor: Running task 101.0 in stage 1.0 (TID 251)
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13555990528-13690208256, partition values: [empty row]
23/09/24 21:33:58 INFO Executor: Finished task 97.0 in stage 1.0 (TID 247). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO Executor: Finished task 94.0 in stage 1.0 (TID 244). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 252
23/09/24 21:33:58 INFO Executor: Running task 102.0 in stage 1.0 (TID 252)
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 253
23/09/24 21:33:58 INFO Executor: Running task 103.0 in stage 1.0 (TID 253)
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13690208256-13824425984, partition values: [empty row]
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13824425984-13958643712, partition values: [empty row]
23/09/24 21:33:58 INFO Executor: Finished task 92.0 in stage 1.0 (TID 242). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 256
23/09/24 21:33:58 INFO Executor: Running task 106.0 in stage 1.0 (TID 256)
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14227079168-14361296896, partition values: [empty row]
23/09/24 21:33:58 INFO Executor: Finished task 98.0 in stage 1.0 (TID 248). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 257
23/09/24 21:33:58 INFO Executor: Running task 107.0 in stage 1.0 (TID 257)
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14361296896-14495514624, partition values: [empty row]
23/09/24 21:33:58 INFO Executor: Finished task 101.0 in stage 1.0 (TID 251). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 266
23/09/24 21:33:58 INFO Executor: Running task 116.0 in stage 1.0 (TID 266)
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15569256448-15703474176, partition values: [empty row]
23/09/24 21:33:58 INFO Executor: Finished task 102.0 in stage 1.0 (TID 252). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 267
23/09/24 21:33:58 INFO Executor: Running task 117.0 in stage 1.0 (TID 267)
23/09/24 21:33:58 INFO Executor: Finished task 103.0 in stage 1.0 (TID 253). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15703474176-15837691904, partition values: [empty row]
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 268
23/09/24 21:33:58 INFO Executor: Running task 118.0 in stage 1.0 (TID 268)
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15837691904-15971909632, partition values: [empty row]
23/09/24 21:33:59 INFO Executor: Finished task 106.0 in stage 1.0 (TID 256). 1844 bytes result sent to driver
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 269
23/09/24 21:33:59 INFO Executor: Finished task 107.0 in stage 1.0 (TID 257). 1844 bytes result sent to driver
23/09/24 21:33:59 INFO Executor: Running task 119.0 in stage 1.0 (TID 269)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15971909632-16106127360, partition values: [empty row]
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 270
23/09/24 21:33:59 INFO Executor: Running task 120.0 in stage 1.0 (TID 270)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16106127360-16240345088, partition values: [empty row]
23/09/24 21:33:59 INFO Executor: Finished task 116.0 in stage 1.0 (TID 266). 1844 bytes result sent to driver
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 279
23/09/24 21:33:59 INFO Executor: Running task 129.0 in stage 1.0 (TID 279)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17314086912-17448304640, partition values: [empty row]
23/09/24 21:33:59 INFO Executor: Finished task 117.0 in stage 1.0 (TID 267). 1844 bytes result sent to driver
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 281
23/09/24 21:33:59 INFO Executor: Running task 131.0 in stage 1.0 (TID 281)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17582522368-17716740096, partition values: [empty row]
23/09/24 21:33:59 INFO Executor: Finished task 118.0 in stage 1.0 (TID 268). 1844 bytes result sent to driver
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 282
23/09/24 21:33:59 INFO Executor: Running task 132.0 in stage 1.0 (TID 282)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17716740096-17850957824, partition values: [empty row]
23/09/24 21:33:59 INFO Executor: Finished task 120.0 in stage 1.0 (TID 270). 1844 bytes result sent to driver
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 283
23/09/24 21:33:59 INFO Executor: Running task 133.0 in stage 1.0 (TID 283)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17850957824-17985175552, partition values: [empty row]
23/09/24 21:33:59 INFO Executor: Finished task 119.0 in stage 1.0 (TID 269). 1844 bytes result sent to driver
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 284
23/09/24 21:33:59 INFO Executor: Running task 134.0 in stage 1.0 (TID 284)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17985175552-18119393280, partition values: [empty row]
23/09/24 21:34:00 INFO Executor: Finished task 129.0 in stage 1.0 (TID 279). 1887 bytes result sent to driver
23/09/24 21:34:00 INFO Executor: Finished task 131.0 in stage 1.0 (TID 281). 1887 bytes result sent to driver
23/09/24 21:34:00 INFO CoarseGrainedExecutorBackend: Got assigned task 290
23/09/24 21:34:00 INFO Executor: Running task 140.0 in stage 1.0 (TID 290)
23/09/24 21:34:00 INFO CoarseGrainedExecutorBackend: Got assigned task 291
23/09/24 21:34:00 INFO Executor: Running task 141.0 in stage 1.0 (TID 291)
23/09/24 21:34:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18790481920-18924699648, partition values: [empty row]
23/09/24 21:34:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18924699648-19058917376, partition values: [empty row]
23/09/24 21:34:00 INFO Executor: Finished task 132.0 in stage 1.0 (TID 282). 1887 bytes result sent to driver
23/09/24 21:34:00 INFO CoarseGrainedExecutorBackend: Got assigned task 293
23/09/24 21:34:00 INFO Executor: Running task 143.0 in stage 1.0 (TID 293)
23/09/24 21:34:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19193135104-19327352832, partition values: [empty row]
23/09/24 21:34:00 INFO Executor: Finished task 133.0 in stage 1.0 (TID 283). 1887 bytes result sent to driver
23/09/24 21:34:00 INFO CoarseGrainedExecutorBackend: Got assigned task 297
23/09/24 21:34:00 INFO Executor: Running task 147.0 in stage 1.0 (TID 297)
23/09/24 21:34:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19730006016-19864223744, partition values: [empty row]
23/09/24 21:34:00 INFO Executor: Finished task 134.0 in stage 1.0 (TID 284). 1887 bytes result sent to driver
23/09/24 21:34:00 INFO CoarseGrainedExecutorBackend: Got assigned task 298
23/09/24 21:34:00 INFO Executor: Running task 148.0 in stage 1.0 (TID 298)
23/09/24 21:34:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19864223744-19998441472, partition values: [empty row]
23/09/24 21:34:00 INFO Executor: Finished task 143.0 in stage 1.0 (TID 293). 1844 bytes result sent to driver
23/09/24 21:34:00 INFO Executor: Finished task 141.0 in stage 1.0 (TID 291). 1844 bytes result sent to driver
23/09/24 21:34:01 INFO Executor: Finished task 140.0 in stage 1.0 (TID 290). 1844 bytes result sent to driver
23/09/24 21:34:01 INFO Executor: Finished task 147.0 in stage 1.0 (TID 297). 1844 bytes result sent to driver
23/09/24 21:34:01 INFO Executor: Finished task 148.0 in stage 1.0 (TID 298). 1844 bytes result sent to driver
23/09/24 21:34:01 INFO CoarseGrainedExecutorBackend: Got assigned task 300
23/09/24 21:34:01 INFO Executor: Running task 0.0 in stage 2.0 (TID 300)
23/09/24 21:34:01 INFO MapOutputTrackerWorker: Updating epoch to 1 and clearing cache
23/09/24 21:34:01 INFO TorrentBroadcast: Started reading broadcast variable 4 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:34:01 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 5.0 KiB, free 5.2 GiB)
23/09/24 21:34:01 INFO TorrentBroadcast: Reading broadcast variable 4 took 6 ms
23/09/24 21:34:01 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 10.1 KiB, free 5.2 GiB)
23/09/24 21:34:01 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 0, fetching them
23/09/24 21:34:01 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@static.154.188.161.5.clients.your-server.de:46637)
23/09/24 21:34:01 INFO MapOutputTrackerWorker: Got the output locations
23/09/24 21:34:01 INFO ShuffleBlockFetcherIterator: Getting 150 (8.8 KiB) non-empty blocks including 60 (3.5 KiB) local and 90 (5.3 KiB) host-local and 0 (0.0 B) remote blocks
23/09/24 21:34:01 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 20 ms
23/09/24 21:34:01 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:39921 after 1 ms (0 ms spent in bootstraps)
23/09/24 21:34:01 INFO CodeGenerator: Code generated in 11.65205 ms
23/09/24 21:34:01 INFO Executor: Finished task 0.0 in stage 2.0 (TID 300). 2450 bytes result sent to driver
23/09/24 21:34:02 INFO CoarseGrainedExecutorBackend: Got assigned task 301
23/09/24 21:34:02 INFO CoarseGrainedExecutorBackend: Got assigned task 304
23/09/24 21:34:02 INFO Executor: Running task 0.0 in stage 3.0 (TID 301)
23/09/24 21:34:02 INFO CoarseGrainedExecutorBackend: Got assigned task 307
23/09/24 21:34:02 INFO Executor: Running task 3.0 in stage 3.0 (TID 304)
23/09/24 21:34:02 INFO CoarseGrainedExecutorBackend: Got assigned task 310
23/09/24 21:34:02 INFO CoarseGrainedExecutorBackend: Got assigned task 313
23/09/24 21:34:02 INFO Executor: Running task 6.0 in stage 3.0 (TID 307)
23/09/24 21:34:02 INFO Executor: Running task 12.0 in stage 3.0 (TID 313)
23/09/24 21:34:02 INFO Executor: Running task 9.0 in stage 3.0 (TID 310)
23/09/24 21:34:02 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:34:02 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 26.8 KiB, free 5.2 GiB)
23/09/24 21:34:02 INFO TorrentBroadcast: Reading broadcast variable 6 took 7 ms
23/09/24 21:34:02 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 92.6 KiB, free 5.2 GiB)
23/09/24 21:34:02 INFO CodeGenerator: Code generated in 125.812437 ms
23/09/24 21:34:03 INFO CodeGenerator: Code generated in 130.866928 ms
23/09/24 21:34:03 INFO CodeGenerator: Code generated in 29.246529 ms
23/09/24 21:34:03 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 805306368-939524096, partition values: [empty row]
23/09/24 21:34:03 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1610612736-1744830464, partition values: [empty row]
23/09/24 21:34:03 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 402653184-536870912, partition values: [empty row]
23/09/24 21:34:03 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1207959552-1342177280, partition values: [empty row]
23/09/24 21:34:03 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 0-134217728, partition values: [empty row]
23/09/24 21:34:03 INFO CodeGenerator: Code generated in 27.40042 ms
23/09/24 21:34:03 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:34:03 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 24.8 KiB, free 5.2 GiB)
23/09/24 21:34:03 INFO TorrentBroadcast: Reading broadcast variable 5 took 6 ms
23/09/24 21:34:03 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 394.6 KiB, free 5.2 GiB)
23/09/24 21:34:04 INFO CodeGenerator: Code generated in 223.029575 ms
23/09/24 21:34:08 INFO MemoryStore: Block rdd_22_12 stored as values in memory (estimated size 110.4 MiB, free 5.0 GiB)
23/09/24 21:34:08 INFO CodeGenerator: Code generated in 4.662851 ms
23/09/24 21:34:08 INFO CodeGenerator: Code generated in 23.077701 ms
23/09/24 21:34:08 INFO MemoryStore: Block rdd_22_3 stored as values in memory (estimated size 116.9 MiB, free 4.9 GiB)
23/09/24 21:34:08 INFO Executor: Finished task 12.0 in stage 3.0 (TID 313). 2452 bytes result sent to driver
23/09/24 21:34:08 INFO CoarseGrainedExecutorBackend: Got assigned task 316
23/09/24 21:34:08 INFO Executor: Running task 15.0 in stage 3.0 (TID 316)
23/09/24 21:34:08 INFO Executor: Finished task 3.0 in stage 3.0 (TID 304). 2452 bytes result sent to driver
23/09/24 21:34:08 INFO CoarseGrainedExecutorBackend: Got assigned task 317
23/09/24 21:34:08 INFO Executor: Running task 16.0 in stage 3.0 (TID 317)
23/09/24 21:34:08 INFO MemoryStore: Block rdd_22_0 stored as values in memory (estimated size 117.0 MiB, free 4.8 GiB)
23/09/24 21:34:08 INFO Executor: Finished task 0.0 in stage 3.0 (TID 301). 2452 bytes result sent to driver
23/09/24 21:34:08 INFO CoarseGrainedExecutorBackend: Got assigned task 319
23/09/24 21:34:08 INFO Executor: Running task 18.0 in stage 3.0 (TID 319)
23/09/24 21:34:08 INFO MemoryStore: Block rdd_22_9 stored as values in memory (estimated size 102.3 MiB, free 4.7 GiB)
23/09/24 21:34:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2013265920-2147483648, partition values: [empty row]
23/09/24 21:34:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2147483648-2281701376, partition values: [empty row]
23/09/24 21:34:08 INFO MemoryStore: Block rdd_22_6 stored as values in memory (estimated size 116.9 MiB, free 4.6 GiB)
23/09/24 21:34:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2415919104-2550136832, partition values: [empty row]
23/09/24 21:34:08 INFO Executor: Finished task 9.0 in stage 3.0 (TID 310). 2452 bytes result sent to driver
23/09/24 21:34:08 INFO CoarseGrainedExecutorBackend: Got assigned task 320
23/09/24 21:34:08 INFO Executor: Running task 19.0 in stage 3.0 (TID 320)
23/09/24 21:34:08 INFO Executor: Finished task 6.0 in stage 3.0 (TID 307). 2452 bytes result sent to driver
23/09/24 21:34:08 INFO CoarseGrainedExecutorBackend: Got assigned task 321
23/09/24 21:34:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2550136832-2684354560, partition values: [empty row]
23/09/24 21:34:08 INFO Executor: Running task 20.0 in stage 3.0 (TID 321)
23/09/24 21:34:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2684354560-2818572288, partition values: [empty row]
23/09/24 21:34:12 INFO MemoryStore: Block rdd_22_18 stored as values in memory (estimated size 116.6 MiB, free 4.5 GiB)
23/09/24 21:34:12 INFO Executor: Finished task 18.0 in stage 3.0 (TID 319). 2452 bytes result sent to driver
23/09/24 21:34:12 INFO CoarseGrainedExecutorBackend: Got assigned task 332
23/09/24 21:34:12 INFO Executor: Running task 31.0 in stage 3.0 (TID 332)
23/09/24 21:34:12 INFO MemoryStore: Block rdd_22_20 stored as values in memory (estimated size 116.6 MiB, free 4.4 GiB)
23/09/24 21:34:12 INFO Executor: Finished task 20.0 in stage 3.0 (TID 321). 2452 bytes result sent to driver
23/09/24 21:34:12 INFO CoarseGrainedExecutorBackend: Got assigned task 333
23/09/24 21:34:12 INFO Executor: Running task 32.0 in stage 3.0 (TID 333)
23/09/24 21:34:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4160749568-4294967296, partition values: [empty row]
23/09/24 21:34:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4294967296-4429185024, partition values: [empty row]
23/09/24 21:34:12 INFO MemoryStore: Block rdd_22_16 stored as values in memory (estimated size 116.6 MiB, free 4.3 GiB)
23/09/24 21:34:12 INFO Executor: Finished task 16.0 in stage 3.0 (TID 317). 2452 bytes result sent to driver
23/09/24 21:34:12 INFO CoarseGrainedExecutorBackend: Got assigned task 336
23/09/24 21:34:12 INFO MemoryStore: Block rdd_22_15 stored as values in memory (estimated size 116.6 MiB, free 4.2 GiB)
23/09/24 21:34:12 INFO Executor: Running task 35.0 in stage 3.0 (TID 336)
23/09/24 21:34:12 INFO Executor: Finished task 15.0 in stage 3.0 (TID 316). 2452 bytes result sent to driver
23/09/24 21:34:12 INFO CoarseGrainedExecutorBackend: Got assigned task 337
23/09/24 21:34:12 INFO Executor: Running task 36.0 in stage 3.0 (TID 337)
23/09/24 21:34:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4697620480-4831838208, partition values: [empty row]
23/09/24 21:34:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4831838208-4966055936, partition values: [empty row]
23/09/24 21:34:12 INFO MemoryStore: Block rdd_22_19 stored as values in memory (estimated size 116.9 MiB, free 4.0 GiB)
23/09/24 21:34:12 INFO Executor: Finished task 19.0 in stage 3.0 (TID 320). 2452 bytes result sent to driver
23/09/24 21:34:12 INFO CoarseGrainedExecutorBackend: Got assigned task 339
23/09/24 21:34:12 INFO Executor: Running task 38.0 in stage 3.0 (TID 339)
23/09/24 21:34:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5100273664-5234491392, partition values: [empty row]
23/09/24 21:34:16 INFO MemoryStore: Block rdd_22_35 stored as values in memory (estimated size 116.7 MiB, free 3.9 GiB)
23/09/24 21:34:16 INFO Executor: Finished task 35.0 in stage 3.0 (TID 336). 2452 bytes result sent to driver
23/09/24 21:34:16 INFO CoarseGrainedExecutorBackend: Got assigned task 351
23/09/24 21:34:16 INFO Executor: Running task 50.0 in stage 3.0 (TID 351)
23/09/24 21:34:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6710886400-6845104128, partition values: [empty row]
23/09/24 21:34:16 INFO MemoryStore: Block rdd_22_32 stored as values in memory (estimated size 117.0 MiB, free 3.8 GiB)
23/09/24 21:34:16 INFO Executor: Finished task 32.0 in stage 3.0 (TID 333). 2452 bytes result sent to driver
23/09/24 21:34:16 INFO CoarseGrainedExecutorBackend: Got assigned task 352
23/09/24 21:34:16 INFO Executor: Running task 51.0 in stage 3.0 (TID 352)
23/09/24 21:34:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6845104128-6979321856, partition values: [empty row]
23/09/24 21:34:16 INFO MemoryStore: Block rdd_22_31 stored as values in memory (estimated size 116.7 MiB, free 3.7 GiB)
23/09/24 21:34:16 INFO Executor: Finished task 31.0 in stage 3.0 (TID 332). 2452 bytes result sent to driver
23/09/24 21:34:16 INFO CoarseGrainedExecutorBackend: Got assigned task 353
23/09/24 21:34:16 INFO Executor: Running task 52.0 in stage 3.0 (TID 353)
23/09/24 21:34:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6979321856-7113539584, partition values: [empty row]
23/09/24 21:34:16 INFO MemoryStore: Block rdd_22_36 stored as values in memory (estimated size 116.7 MiB, free 3.6 GiB)
23/09/24 21:34:16 INFO Executor: Finished task 36.0 in stage 3.0 (TID 337). 2452 bytes result sent to driver
23/09/24 21:34:16 INFO CoarseGrainedExecutorBackend: Got assigned task 354
23/09/24 21:34:16 INFO Executor: Running task 53.0 in stage 3.0 (TID 354)
23/09/24 21:34:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7113539584-7247757312, partition values: [empty row]
23/09/24 21:34:16 INFO MemoryStore: Block rdd_22_38 stored as values in memory (estimated size 116.7 MiB, free 3.5 GiB)
23/09/24 21:34:16 INFO Executor: Finished task 38.0 in stage 3.0 (TID 339). 2452 bytes result sent to driver
23/09/24 21:34:16 INFO CoarseGrainedExecutorBackend: Got assigned task 355
23/09/24 21:34:16 INFO Executor: Running task 54.0 in stage 3.0 (TID 355)
23/09/24 21:34:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7247757312-7381975040, partition values: [empty row]
23/09/24 21:34:20 INFO MemoryStore: Block rdd_22_50 stored as values in memory (estimated size 114.0 MiB, free 3.4 GiB)
23/09/24 21:34:20 INFO Executor: Finished task 50.0 in stage 3.0 (TID 351). 2452 bytes result sent to driver
23/09/24 21:34:20 INFO CoarseGrainedExecutorBackend: Got assigned task 366
23/09/24 21:34:20 INFO Executor: Running task 65.0 in stage 3.0 (TID 366)
23/09/24 21:34:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8724152320-8858370048, partition values: [empty row]
23/09/24 21:34:20 INFO MemoryStore: Block rdd_22_51 stored as values in memory (estimated size 115.4 MiB, free 3.2 GiB)
23/09/24 21:34:20 INFO Executor: Finished task 51.0 in stage 3.0 (TID 352). 2452 bytes result sent to driver
23/09/24 21:34:20 INFO CoarseGrainedExecutorBackend: Got assigned task 367
23/09/24 21:34:20 INFO Executor: Running task 66.0 in stage 3.0 (TID 367)
23/09/24 21:34:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8858370048-8992587776, partition values: [empty row]
23/09/24 21:34:20 INFO MemoryStore: Block rdd_22_53 stored as values in memory (estimated size 115.7 MiB, free 3.1 GiB)
23/09/24 21:34:20 INFO Executor: Finished task 53.0 in stage 3.0 (TID 354). 2452 bytes result sent to driver
23/09/24 21:34:20 INFO CoarseGrainedExecutorBackend: Got assigned task 368
23/09/24 21:34:20 INFO Executor: Running task 67.0 in stage 3.0 (TID 368)
23/09/24 21:34:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8992587776-9126805504, partition values: [empty row]
23/09/24 21:34:20 INFO MemoryStore: Block rdd_22_52 stored as values in memory (estimated size 110.0 MiB, free 3.0 GiB)
23/09/24 21:34:20 INFO Executor: Finished task 52.0 in stage 3.0 (TID 353). 2452 bytes result sent to driver
23/09/24 21:34:20 INFO CoarseGrainedExecutorBackend: Got assigned task 369
23/09/24 21:34:20 INFO Executor: Running task 68.0 in stage 3.0 (TID 369)
23/09/24 21:34:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9126805504-9261023232, partition values: [empty row]
23/09/24 21:34:20 INFO MemoryStore: Block rdd_22_54 stored as values in memory (estimated size 115.8 MiB, free 2.9 GiB)
23/09/24 21:34:20 INFO Executor: Finished task 54.0 in stage 3.0 (TID 355). 2452 bytes result sent to driver
23/09/24 21:34:20 INFO CoarseGrainedExecutorBackend: Got assigned task 370
23/09/24 21:34:20 INFO Executor: Running task 69.0 in stage 3.0 (TID 370)
23/09/24 21:34:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9261023232-9395240960, partition values: [empty row]
23/09/24 21:34:23 INFO MemoryStore: Block rdd_22_66 stored as values in memory (estimated size 116.9 MiB, free 2.8 GiB)
23/09/24 21:34:23 INFO Executor: Finished task 66.0 in stage 3.0 (TID 367). 2452 bytes result sent to driver
23/09/24 21:34:23 INFO CoarseGrainedExecutorBackend: Got assigned task 381
23/09/24 21:34:23 INFO Executor: Running task 80.0 in stage 3.0 (TID 381)
23/09/24 21:34:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10737418240-10871635968, partition values: [empty row]
23/09/24 21:34:23 INFO MemoryStore: Block rdd_22_65 stored as values in memory (estimated size 116.7 MiB, free 2.7 GiB)
23/09/24 21:34:23 INFO Executor: Finished task 65.0 in stage 3.0 (TID 366). 2452 bytes result sent to driver
23/09/24 21:34:23 INFO CoarseGrainedExecutorBackend: Got assigned task 382
23/09/24 21:34:23 INFO Executor: Running task 81.0 in stage 3.0 (TID 382)
23/09/24 21:34:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10871635968-11005853696, partition values: [empty row]
23/09/24 21:34:24 INFO MemoryStore: Block rdd_22_67 stored as values in memory (estimated size 116.9 MiB, free 2.6 GiB)
23/09/24 21:34:24 INFO Executor: Finished task 67.0 in stage 3.0 (TID 368). 2452 bytes result sent to driver
23/09/24 21:34:24 INFO CoarseGrainedExecutorBackend: Got assigned task 383
23/09/24 21:34:24 INFO Executor: Running task 82.0 in stage 3.0 (TID 383)
23/09/24 21:34:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11005853696-11140071424, partition values: [empty row]
23/09/24 21:34:24 INFO MemoryStore: Block rdd_22_68 stored as values in memory (estimated size 116.7 MiB, free 2.5 GiB)
23/09/24 21:34:24 INFO Executor: Finished task 68.0 in stage 3.0 (TID 369). 2452 bytes result sent to driver
23/09/24 21:34:24 INFO CoarseGrainedExecutorBackend: Got assigned task 384
23/09/24 21:34:24 INFO Executor: Running task 83.0 in stage 3.0 (TID 384)
23/09/24 21:34:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11140071424-11274289152, partition values: [empty row]
23/09/24 21:34:24 INFO MemoryStore: Block rdd_22_69 stored as values in memory (estimated size 116.8 MiB, free 2.3 GiB)
23/09/24 21:34:24 INFO Executor: Finished task 69.0 in stage 3.0 (TID 370). 2452 bytes result sent to driver
23/09/24 21:34:24 INFO CoarseGrainedExecutorBackend: Got assigned task 386
23/09/24 21:34:24 INFO Executor: Running task 85.0 in stage 3.0 (TID 386)
23/09/24 21:34:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11408506880-11542724608, partition values: [empty row]
23/09/24 21:34:27 INFO MemoryStore: Block rdd_22_80 stored as values in memory (estimated size 116.6 MiB, free 2.2 GiB)
23/09/24 21:34:27 INFO Executor: Finished task 80.0 in stage 3.0 (TID 381). 2452 bytes result sent to driver
23/09/24 21:34:27 INFO CoarseGrainedExecutorBackend: Got assigned task 396
23/09/24 21:34:27 INFO Executor: Running task 95.0 in stage 3.0 (TID 396)
23/09/24 21:34:27 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12750684160-12884901888, partition values: [empty row]
23/09/24 21:34:27 INFO MemoryStore: Block rdd_22_81 stored as values in memory (estimated size 116.8 MiB, free 2.1 GiB)
23/09/24 21:34:27 INFO Executor: Finished task 81.0 in stage 3.0 (TID 382). 2452 bytes result sent to driver
23/09/24 21:34:27 INFO CoarseGrainedExecutorBackend: Got assigned task 397
23/09/24 21:34:27 INFO Executor: Running task 96.0 in stage 3.0 (TID 397)
23/09/24 21:34:27 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12884901888-13019119616, partition values: [empty row]
23/09/24 21:34:28 INFO MemoryStore: Block rdd_22_82 stored as values in memory (estimated size 116.9 MiB, free 2044.2 MiB)
23/09/24 21:34:28 INFO Executor: Finished task 82.0 in stage 3.0 (TID 383). 2452 bytes result sent to driver
23/09/24 21:34:28 INFO CoarseGrainedExecutorBackend: Got assigned task 398
23/09/24 21:34:28 INFO Executor: Running task 97.0 in stage 3.0 (TID 398)
23/09/24 21:34:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13019119616-13153337344, partition values: [empty row]
23/09/24 21:34:28 INFO MemoryStore: Block rdd_22_83 stored as values in memory (estimated size 116.9 MiB, free 1927.4 MiB)
23/09/24 21:34:28 INFO Executor: Finished task 83.0 in stage 3.0 (TID 384). 2452 bytes result sent to driver
23/09/24 21:34:28 INFO CoarseGrainedExecutorBackend: Got assigned task 399
23/09/24 21:34:28 INFO Executor: Running task 98.0 in stage 3.0 (TID 399)
23/09/24 21:34:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13153337344-13287555072, partition values: [empty row]
23/09/24 21:34:28 INFO MemoryStore: Block rdd_22_85 stored as values in memory (estimated size 116.9 MiB, free 1810.5 MiB)
23/09/24 21:34:28 INFO Executor: Finished task 85.0 in stage 3.0 (TID 386). 2452 bytes result sent to driver
23/09/24 21:34:28 INFO CoarseGrainedExecutorBackend: Got assigned task 401
23/09/24 21:34:28 INFO Executor: Running task 100.0 in stage 3.0 (TID 401)
23/09/24 21:34:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13421772800-13555990528, partition values: [empty row]
23/09/24 21:34:31 INFO MemoryStore: Block rdd_22_95 stored as values in memory (estimated size 116.9 MiB, free 1693.6 MiB)
23/09/24 21:34:31 INFO Executor: Finished task 95.0 in stage 3.0 (TID 396). 2452 bytes result sent to driver
23/09/24 21:34:31 INFO CoarseGrainedExecutorBackend: Got assigned task 411
23/09/24 21:34:31 INFO Executor: Running task 110.0 in stage 3.0 (TID 411)
23/09/24 21:34:31 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14763950080-14898167808, partition values: [empty row]
23/09/24 21:34:31 INFO MemoryStore: Block rdd_22_96 stored as values in memory (estimated size 116.7 MiB, free 1576.9 MiB)
23/09/24 21:34:31 INFO Executor: Finished task 96.0 in stage 3.0 (TID 397). 2452 bytes result sent to driver
23/09/24 21:34:31 INFO CoarseGrainedExecutorBackend: Got assigned task 412
23/09/24 21:34:31 INFO Executor: Running task 111.0 in stage 3.0 (TID 412)
23/09/24 21:34:31 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14898167808-15032385536, partition values: [empty row]
23/09/24 21:34:31 INFO MemoryStore: Block rdd_22_97 stored as values in memory (estimated size 116.8 MiB, free 1460.1 MiB)
23/09/24 21:34:31 INFO Executor: Finished task 97.0 in stage 3.0 (TID 398). 2452 bytes result sent to driver
23/09/24 21:34:31 INFO CoarseGrainedExecutorBackend: Got assigned task 413
23/09/24 21:34:31 INFO Executor: Running task 112.0 in stage 3.0 (TID 413)
23/09/24 21:34:31 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15032385536-15166603264, partition values: [empty row]
23/09/24 21:34:31 INFO MemoryStore: Block rdd_22_98 stored as values in memory (estimated size 116.6 MiB, free 1343.5 MiB)
23/09/24 21:34:31 INFO Executor: Finished task 98.0 in stage 3.0 (TID 399). 2452 bytes result sent to driver
23/09/24 21:34:31 INFO CoarseGrainedExecutorBackend: Got assigned task 414
23/09/24 21:34:31 INFO Executor: Running task 113.0 in stage 3.0 (TID 414)
23/09/24 21:34:31 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15166603264-15300820992, partition values: [empty row]
23/09/24 21:34:32 INFO MemoryStore: Block rdd_22_100 stored as values in memory (estimated size 116.8 MiB, free 1226.7 MiB)
23/09/24 21:34:32 INFO Executor: Finished task 100.0 in stage 3.0 (TID 401). 2452 bytes result sent to driver
23/09/24 21:34:32 INFO CoarseGrainedExecutorBackend: Got assigned task 415
23/09/24 21:34:32 INFO Executor: Running task 114.0 in stage 3.0 (TID 415)
23/09/24 21:34:32 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15300820992-15435038720, partition values: [empty row]
23/09/24 21:34:35 INFO MemoryStore: Block rdd_22_110 stored as values in memory (estimated size 116.9 MiB, free 1109.8 MiB)
23/09/24 21:34:35 INFO Executor: Finished task 110.0 in stage 3.0 (TID 411). 2452 bytes result sent to driver
23/09/24 21:34:35 INFO CoarseGrainedExecutorBackend: Got assigned task 426
23/09/24 21:34:35 INFO Executor: Running task 125.0 in stage 3.0 (TID 426)
23/09/24 21:34:35 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16777216000-16911433728, partition values: [empty row]
23/09/24 21:34:35 INFO MemoryStore: Block rdd_22_111 stored as values in memory (estimated size 116.9 MiB, free 992.9 MiB)
23/09/24 21:34:35 INFO Executor: Finished task 111.0 in stage 3.0 (TID 412). 2452 bytes result sent to driver
23/09/24 21:34:36 INFO CoarseGrainedExecutorBackend: Got assigned task 427
23/09/24 21:34:36 INFO Executor: Running task 126.0 in stage 3.0 (TID 427)
23/09/24 21:34:36 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16911433728-17045651456, partition values: [empty row]
23/09/24 21:34:36 INFO MemoryStore: Block rdd_22_112 stored as values in memory (estimated size 117.0 MiB, free 875.9 MiB)
23/09/24 21:34:36 INFO MemoryStore: Block rdd_22_113 stored as values in memory (estimated size 116.9 MiB, free 759.0 MiB)
23/09/24 21:34:36 INFO Executor: Finished task 113.0 in stage 3.0 (TID 414). 2452 bytes result sent to driver
23/09/24 21:34:36 INFO Executor: Finished task 112.0 in stage 3.0 (TID 413). 2452 bytes result sent to driver
23/09/24 21:34:36 INFO CoarseGrainedExecutorBackend: Got assigned task 428
23/09/24 21:34:36 INFO CoarseGrainedExecutorBackend: Got assigned task 429
23/09/24 21:34:36 INFO Executor: Running task 127.0 in stage 3.0 (TID 428)
23/09/24 21:34:36 INFO Executor: Running task 128.0 in stage 3.0 (TID 429)
23/09/24 21:34:36 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17045651456-17179869184, partition values: [empty row]
23/09/24 21:34:36 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17179869184-17314086912, partition values: [empty row]
23/09/24 21:34:36 INFO MemoryStore: Block rdd_22_114 stored as values in memory (estimated size 116.9 MiB, free 642.0 MiB)
23/09/24 21:34:36 INFO Executor: Finished task 114.0 in stage 3.0 (TID 415). 2452 bytes result sent to driver
23/09/24 21:34:36 INFO CoarseGrainedExecutorBackend: Got assigned task 431
23/09/24 21:34:36 INFO Executor: Running task 130.0 in stage 3.0 (TID 431)
23/09/24 21:34:36 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17448304640-17582522368, partition values: [empty row]
23/09/24 21:34:39 INFO MemoryStore: Block rdd_22_125 stored as values in memory (estimated size 116.9 MiB, free 525.1 MiB)
23/09/24 21:34:39 INFO Executor: Finished task 125.0 in stage 3.0 (TID 426). 2452 bytes result sent to driver
23/09/24 21:34:39 INFO CoarseGrainedExecutorBackend: Got assigned task 441
23/09/24 21:34:39 INFO Executor: Running task 140.0 in stage 3.0 (TID 441)
23/09/24 21:34:39 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18790481920-18924699648, partition values: [empty row]
23/09/24 21:34:39 INFO MemoryStore: Block rdd_22_126 stored as values in memory (estimated size 116.9 MiB, free 408.2 MiB)
23/09/24 21:34:39 INFO Executor: Finished task 126.0 in stage 3.0 (TID 427). 2452 bytes result sent to driver
23/09/24 21:34:39 INFO CoarseGrainedExecutorBackend: Got assigned task 442
23/09/24 21:34:39 INFO Executor: Running task 141.0 in stage 3.0 (TID 442)
23/09/24 21:34:39 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18924699648-19058917376, partition values: [empty row]
23/09/24 21:34:40 INFO MemoryStore: Block rdd_22_127 stored as values in memory (estimated size 116.9 MiB, free 291.3 MiB)
23/09/24 21:34:40 INFO Executor: Finished task 127.0 in stage 3.0 (TID 428). 2452 bytes result sent to driver
23/09/24 21:34:40 INFO CoarseGrainedExecutorBackend: Got assigned task 443
23/09/24 21:34:40 INFO Executor: Running task 142.0 in stage 3.0 (TID 443)
23/09/24 21:34:40 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19058917376-19193135104, partition values: [empty row]
23/09/24 21:34:40 INFO MemoryStore: Block rdd_22_130 stored as values in memory (estimated size 116.9 MiB, free 174.3 MiB)
23/09/24 21:34:40 INFO Executor: Finished task 130.0 in stage 3.0 (TID 431). 2452 bytes result sent to driver
23/09/24 21:34:40 INFO CoarseGrainedExecutorBackend: Got assigned task 444
23/09/24 21:34:40 INFO Executor: Running task 143.0 in stage 3.0 (TID 444)
23/09/24 21:34:40 INFO MemoryStore: Block rdd_22_128 stored as values in memory (estimated size 116.9 MiB, free 57.4 MiB)
23/09/24 21:34:40 INFO Executor: Finished task 128.0 in stage 3.0 (TID 429). 2452 bytes result sent to driver
23/09/24 21:34:40 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19193135104-19327352832, partition values: [empty row]
23/09/24 21:34:40 INFO CoarseGrainedExecutorBackend: Got assigned task 445
23/09/24 21:34:40 INFO Executor: Running task 144.0 in stage 3.0 (TID 445)
23/09/24 21:34:40 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19327352832-19461570560, partition values: [empty row]
23/09/24 21:34:42 INFO MemoryStore: Will not store rdd_22_140
23/09/24 21:34:42 INFO MemoryStore: Will not store rdd_22_141
23/09/24 21:34:42 WARN MemoryStore: Not enough space to cache rdd_22_140 in memory! (computed 64.9 MiB so far)
23/09/24 21:34:42 WARN MemoryStore: Not enough space to cache rdd_22_141 in memory! (computed 64.9 MiB so far)
23/09/24 21:34:42 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:42 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:42 WARN BlockManager: Block rdd_22_140 could not be removed as it was not found on disk or in memory
23/09/24 21:34:42 WARN BlockManager: Block rdd_22_141 could not be removed as it was not found on disk or in memory
23/09/24 21:34:42 WARN BlockManager: Putting block rdd_22_140 failed
23/09/24 21:34:42 WARN BlockManager: Putting block rdd_22_141 failed
23/09/24 21:34:42 INFO MemoryStore: Will not store rdd_22_142
23/09/24 21:34:42 WARN MemoryStore: Not enough space to cache rdd_22_142 in memory! (computed 64.9 MiB so far)
23/09/24 21:34:42 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.1 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:42 WARN BlockManager: Block rdd_22_142 could not be removed as it was not found on disk or in memory
23/09/24 21:34:42 WARN BlockManager: Putting block rdd_22_142 failed
23/09/24 21:34:43 INFO MemoryStore: Will not store rdd_22_143
23/09/24 21:34:43 WARN MemoryStore: Not enough space to cache rdd_22_143 in memory! (computed 64.5 MiB so far)
23/09/24 21:34:43 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.4 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:43 WARN BlockManager: Block rdd_22_143 could not be removed as it was not found on disk or in memory
23/09/24 21:34:43 WARN BlockManager: Putting block rdd_22_143 failed
23/09/24 21:34:43 INFO MemoryStore: Will not store rdd_22_144
23/09/24 21:34:43 WARN MemoryStore: Not enough space to cache rdd_22_144 in memory! (computed 64.6 MiB so far)
23/09/24 21:34:43 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:43 WARN BlockManager: Block rdd_22_144 could not be removed as it was not found on disk or in memory
23/09/24 21:34:43 WARN BlockManager: Putting block rdd_22_144 failed
23/09/24 21:34:43 INFO Executor: Finished task 141.0 in stage 3.0 (TID 442). 2452 bytes result sent to driver
23/09/24 21:34:43 INFO CoarseGrainedExecutorBackend: Got assigned task 452
23/09/24 21:34:43 INFO Executor: Running task 136.1 in stage 3.0 (TID 452)
23/09/24 21:34:43 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18253611008-18387828736, partition values: [empty row]
23/09/24 21:34:43 INFO Executor: Finished task 140.0 in stage 3.0 (TID 441). 2452 bytes result sent to driver
23/09/24 21:34:43 INFO CoarseGrainedExecutorBackend: Got assigned task 453
23/09/24 21:34:43 INFO Executor: Running task 137.1 in stage 3.0 (TID 453)
23/09/24 21:34:43 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18387828736-18522046464, partition values: [empty row]
23/09/24 21:34:44 INFO Executor: Finished task 142.0 in stage 3.0 (TID 443). 2452 bytes result sent to driver
23/09/24 21:34:44 INFO CoarseGrainedExecutorBackend: Got assigned task 454
23/09/24 21:34:44 INFO Executor: Running task 138.1 in stage 3.0 (TID 454)
23/09/24 21:34:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18522046464-18656264192, partition values: [empty row]
23/09/24 21:34:44 INFO Executor: Finished task 144.0 in stage 3.0 (TID 445). 2452 bytes result sent to driver
23/09/24 21:34:44 INFO CoarseGrainedExecutorBackend: Got assigned task 458
23/09/24 21:34:44 INFO Executor: Running task 64.1 in stage 3.0 (TID 458)
23/09/24 21:34:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8589934592-8724152320, partition values: [empty row]
23/09/24 21:34:44 INFO Executor: Finished task 143.0 in stage 3.0 (TID 444). 2452 bytes result sent to driver
23/09/24 21:34:44 INFO CoarseGrainedExecutorBackend: Got assigned task 459
23/09/24 21:34:44 INFO Executor: Running task 10.1 in stage 3.0 (TID 459)
23/09/24 21:34:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1342177280-1476395008, partition values: [empty row]
23/09/24 21:34:45 INFO MemoryStore: Will not store rdd_22_136
23/09/24 21:34:45 WARN MemoryStore: Not enough space to cache rdd_22_136 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:45 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:45 WARN BlockManager: Block rdd_22_136 could not be removed as it was not found on disk or in memory
23/09/24 21:34:45 WARN BlockManager: Putting block rdd_22_136 failed
23/09/24 21:34:45 INFO MemoryStore: Will not store rdd_22_137
23/09/24 21:34:45 WARN MemoryStore: Not enough space to cache rdd_22_137 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:45 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:45 WARN BlockManager: Block rdd_22_137 could not be removed as it was not found on disk or in memory
23/09/24 21:34:45 WARN BlockManager: Putting block rdd_22_137 failed
23/09/24 21:34:45 INFO MemoryStore: Will not store rdd_22_138
23/09/24 21:34:45 WARN MemoryStore: Not enough space to cache rdd_22_138 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:45 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:45 WARN BlockManager: Block rdd_22_138 could not be removed as it was not found on disk or in memory
23/09/24 21:34:45 WARN BlockManager: Putting block rdd_22_138 failed
23/09/24 21:34:46 INFO MemoryStore: Will not store rdd_22_64
23/09/24 21:34:46 WARN MemoryStore: Not enough space to cache rdd_22_64 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:46 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.4 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:46 WARN BlockManager: Block rdd_22_64 could not be removed as it was not found on disk or in memory
23/09/24 21:34:46 WARN BlockManager: Putting block rdd_22_64 failed
23/09/24 21:34:47 INFO MemoryStore: Will not store rdd_22_10
23/09/24 21:34:47 WARN MemoryStore: Not enough space to cache rdd_22_10 in memory! (computed 64.6 MiB so far)
23/09/24 21:34:47 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:47 WARN BlockManager: Block rdd_22_10 could not be removed as it was not found on disk or in memory
23/09/24 21:34:47 WARN BlockManager: Putting block rdd_22_10 failed
23/09/24 21:34:47 INFO Executor: Finished task 136.1 in stage 3.0 (TID 452). 2452 bytes result sent to driver
23/09/24 21:34:47 INFO CoarseGrainedExecutorBackend: Got assigned task 467
23/09/24 21:34:47 INFO Executor: Running task 124.1 in stage 3.0 (TID 467)
23/09/24 21:34:47 INFO Executor: Finished task 137.1 in stage 3.0 (TID 453). 2452 bytes result sent to driver
23/09/24 21:34:47 INFO CoarseGrainedExecutorBackend: Got assigned task 468
23/09/24 21:34:47 INFO Executor: Running task 61.1 in stage 3.0 (TID 468)
23/09/24 21:34:47 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16642998272-16777216000, partition values: [empty row]
23/09/24 21:34:47 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8187281408-8321499136, partition values: [empty row]
23/09/24 21:34:47 INFO Executor: Finished task 138.1 in stage 3.0 (TID 454). 2452 bytes result sent to driver
23/09/24 21:34:47 INFO CoarseGrainedExecutorBackend: Got assigned task 469
23/09/24 21:34:47 INFO Executor: Running task 49.1 in stage 3.0 (TID 469)
23/09/24 21:34:47 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6576668672-6710886400, partition values: [empty row]
23/09/24 21:34:47 INFO Executor: Finished task 10.1 in stage 3.0 (TID 459). 2452 bytes result sent to driver
23/09/24 21:34:47 INFO CoarseGrainedExecutorBackend: Got assigned task 470
23/09/24 21:34:47 INFO Executor: Running task 22.1 in stage 3.0 (TID 470)
23/09/24 21:34:47 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2952790016-3087007744, partition values: [empty row]
23/09/24 21:34:48 INFO Executor: Finished task 64.1 in stage 3.0 (TID 458). 2452 bytes result sent to driver
23/09/24 21:34:48 INFO CoarseGrainedExecutorBackend: Got assigned task 473
23/09/24 21:34:48 INFO Executor: Running task 94.1 in stage 3.0 (TID 473)
23/09/24 21:34:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12616466432-12750684160, partition values: [empty row]
23/09/24 21:34:49 INFO MemoryStore: Will not store rdd_22_61
23/09/24 21:34:49 WARN MemoryStore: Not enough space to cache rdd_22_61 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:49 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:49 WARN BlockManager: Block rdd_22_61 could not be removed as it was not found on disk or in memory
23/09/24 21:34:49 WARN BlockManager: Putting block rdd_22_61 failed
23/09/24 21:34:49 INFO MemoryStore: Will not store rdd_22_124
23/09/24 21:34:49 WARN MemoryStore: Not enough space to cache rdd_22_124 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:49 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:49 WARN BlockManager: Block rdd_22_124 could not be removed as it was not found on disk or in memory
23/09/24 21:34:49 WARN BlockManager: Putting block rdd_22_124 failed
23/09/24 21:34:49 INFO MemoryStore: Will not store rdd_22_49
23/09/24 21:34:49 WARN MemoryStore: Not enough space to cache rdd_22_49 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:49 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:49 WARN BlockManager: Block rdd_22_49 could not be removed as it was not found on disk or in memory
23/09/24 21:34:49 WARN BlockManager: Putting block rdd_22_49 failed
23/09/24 21:34:50 INFO MemoryStore: Will not store rdd_22_22
23/09/24 21:34:50 WARN MemoryStore: Not enough space to cache rdd_22_22 in memory! (computed 65.1 MiB so far)
23/09/24 21:34:50 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.5 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:50 WARN BlockManager: Block rdd_22_22 could not be removed as it was not found on disk or in memory
23/09/24 21:34:50 WARN BlockManager: Putting block rdd_22_22 failed
23/09/24 21:34:50 INFO MemoryStore: Will not store rdd_22_94
23/09/24 21:34:50 WARN MemoryStore: Not enough space to cache rdd_22_94 in memory! (computed 64.7 MiB so far)
23/09/24 21:34:50 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:50 WARN BlockManager: Block rdd_22_94 could not be removed as it was not found on disk or in memory
23/09/24 21:34:50 WARN BlockManager: Putting block rdd_22_94 failed
23/09/24 21:34:50 INFO Executor: Finished task 61.1 in stage 3.0 (TID 468). 2452 bytes result sent to driver
23/09/24 21:34:50 INFO CoarseGrainedExecutorBackend: Got assigned task 477
23/09/24 21:34:50 INFO Executor: Running task 92.1 in stage 3.0 (TID 477)
23/09/24 21:34:50 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12348030976-12482248704, partition values: [empty row]
23/09/24 21:34:51 INFO Executor: Finished task 124.1 in stage 3.0 (TID 467). 2452 bytes result sent to driver
23/09/24 21:34:51 INFO CoarseGrainedExecutorBackend: Got assigned task 478
23/09/24 21:34:51 INFO Executor: Running task 47.1 in stage 3.0 (TID 478)
23/09/24 21:34:51 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6308233216-6442450944, partition values: [empty row]
23/09/24 21:34:51 INFO Executor: Finished task 49.1 in stage 3.0 (TID 469). 2452 bytes result sent to driver
23/09/24 21:34:51 INFO CoarseGrainedExecutorBackend: Got assigned task 479
23/09/24 21:34:51 INFO Executor: Running task 17.1 in stage 3.0 (TID 479)
23/09/24 21:34:51 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2281701376-2415919104, partition values: [empty row]
23/09/24 21:34:51 INFO Executor: Finished task 94.1 in stage 3.0 (TID 473). 2452 bytes result sent to driver
23/09/24 21:34:51 INFO CoarseGrainedExecutorBackend: Got assigned task 482
23/09/24 21:34:51 INFO Executor: Running task 77.1 in stage 3.0 (TID 482)
23/09/24 21:34:51 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10334765056-10468982784, partition values: [empty row]
23/09/24 21:34:51 INFO Executor: Finished task 22.1 in stage 3.0 (TID 470). 2452 bytes result sent to driver
23/09/24 21:34:51 INFO CoarseGrainedExecutorBackend: Got assigned task 483
23/09/24 21:34:51 INFO Executor: Running task 122.1 in stage 3.0 (TID 483)
23/09/24 21:34:51 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16374562816-16508780544, partition values: [empty row]
23/09/24 21:34:52 INFO MemoryStore: Will not store rdd_22_92
23/09/24 21:34:52 WARN MemoryStore: Not enough space to cache rdd_22_92 in memory! (computed 64.9 MiB so far)
23/09/24 21:34:52 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.7 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:52 WARN BlockManager: Block rdd_22_92 could not be removed as it was not found on disk or in memory
23/09/24 21:34:52 WARN BlockManager: Putting block rdd_22_92 failed
23/09/24 21:34:52 INFO MemoryStore: Will not store rdd_22_17
23/09/24 21:34:52 WARN MemoryStore: Not enough space to cache rdd_22_17 in memory! (computed 65.1 MiB so far)
23/09/24 21:34:52 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:52 WARN BlockManager: Block rdd_22_17 could not be removed as it was not found on disk or in memory
23/09/24 21:34:52 WARN BlockManager: Putting block rdd_22_17 failed
23/09/24 21:34:52 INFO MemoryStore: Will not store rdd_22_47
23/09/24 21:34:53 WARN MemoryStore: Not enough space to cache rdd_22_47 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:53 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:53 WARN BlockManager: Block rdd_22_47 could not be removed as it was not found on disk or in memory
23/09/24 21:34:53 WARN BlockManager: Putting block rdd_22_47 failed
23/09/24 21:34:53 INFO MemoryStore: Will not store rdd_22_77
23/09/24 21:34:53 WARN MemoryStore: Not enough space to cache rdd_22_77 in memory! (computed 64.9 MiB so far)
23/09/24 21:34:53 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.4 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:53 WARN BlockManager: Block rdd_22_77 could not be removed as it was not found on disk or in memory
23/09/24 21:34:53 WARN BlockManager: Putting block rdd_22_77 failed
23/09/24 21:34:53 INFO MemoryStore: Will not store rdd_22_122
23/09/24 21:34:53 WARN MemoryStore: Not enough space to cache rdd_22_122 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:53 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:53 WARN BlockManager: Block rdd_22_122 could not be removed as it was not found on disk or in memory
23/09/24 21:34:53 WARN BlockManager: Putting block rdd_22_122 failed
23/09/24 21:34:54 INFO Executor: Finished task 92.1 in stage 3.0 (TID 477). 2452 bytes result sent to driver
23/09/24 21:34:54 INFO CoarseGrainedExecutorBackend: Got assigned task 487
23/09/24 21:34:54 INFO Executor: Running task 78.1 in stage 3.0 (TID 487)
23/09/24 21:34:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10468982784-10603200512, partition values: [empty row]
23/09/24 21:34:54 INFO Executor: Finished task 17.1 in stage 3.0 (TID 479). 2452 bytes result sent to driver
23/09/24 21:34:54 INFO CoarseGrainedExecutorBackend: Got assigned task 488
23/09/24 21:34:54 INFO Executor: Running task 21.1 in stage 3.0 (TID 488)
23/09/24 21:34:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2818572288-2952790016, partition values: [empty row]
23/09/24 21:34:54 INFO Executor: Finished task 47.1 in stage 3.0 (TID 478). 2495 bytes result sent to driver
23/09/24 21:34:54 INFO CoarseGrainedExecutorBackend: Got assigned task 489
23/09/24 21:34:54 INFO Executor: Running task 39.1 in stage 3.0 (TID 489)
23/09/24 21:34:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5234491392-5368709120, partition values: [empty row]
23/09/24 21:34:55 INFO Executor: Finished task 77.1 in stage 3.0 (TID 482). 2452 bytes result sent to driver
23/09/24 21:34:55 INFO CoarseGrainedExecutorBackend: Got assigned task 496
23/09/24 21:34:55 INFO Executor: Running task 63.1 in stage 3.0 (TID 496)
23/09/24 21:34:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8455716864-8589934592, partition values: [empty row]
23/09/24 21:34:55 INFO Executor: Finished task 122.1 in stage 3.0 (TID 483). 2452 bytes result sent to driver
23/09/24 21:34:55 INFO CoarseGrainedExecutorBackend: Got assigned task 498
23/09/24 21:34:55 INFO Executor: Running task 90.1 in stage 3.0 (TID 498)
23/09/24 21:34:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12079595520-12213813248, partition values: [empty row]
23/09/24 21:34:56 INFO MemoryStore: Will not store rdd_22_78
23/09/24 21:34:56 WARN MemoryStore: Not enough space to cache rdd_22_78 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:56 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.7 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:56 WARN BlockManager: Block rdd_22_78 could not be removed as it was not found on disk or in memory
23/09/24 21:34:56 WARN BlockManager: Putting block rdd_22_78 failed
23/09/24 21:34:56 INFO MemoryStore: Will not store rdd_22_21
23/09/24 21:34:56 WARN MemoryStore: Not enough space to cache rdd_22_21 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:56 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:56 WARN BlockManager: Block rdd_22_21 could not be removed as it was not found on disk or in memory
23/09/24 21:34:56 WARN BlockManager: Putting block rdd_22_21 failed
23/09/24 21:34:56 INFO MemoryStore: Will not store rdd_22_39
23/09/24 21:34:56 WARN MemoryStore: Not enough space to cache rdd_22_39 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:56 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:56 WARN BlockManager: Block rdd_22_39 could not be removed as it was not found on disk or in memory
23/09/24 21:34:56 WARN BlockManager: Putting block rdd_22_39 failed
23/09/24 21:34:57 INFO MemoryStore: Will not store rdd_22_63
23/09/24 21:34:57 WARN MemoryStore: Not enough space to cache rdd_22_63 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:57 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.5 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:57 INFO MemoryStore: Will not store rdd_22_90
23/09/24 21:34:57 WARN MemoryStore: Not enough space to cache rdd_22_90 in memory! (computed 64.9 MiB so far)
23/09/24 21:34:57 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.5 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:57 WARN BlockManager: Block rdd_22_90 could not be removed as it was not found on disk or in memory
23/09/24 21:34:57 WARN BlockManager: Putting block rdd_22_90 failed
23/09/24 21:34:57 WARN BlockManager: Block rdd_22_63 could not be removed as it was not found on disk or in memory
23/09/24 21:34:57 WARN BlockManager: Putting block rdd_22_63 failed
23/09/24 21:34:57 INFO Executor: Finished task 78.1 in stage 3.0 (TID 487). 2452 bytes result sent to driver
23/09/24 21:34:58 INFO Executor: Finished task 39.1 in stage 3.0 (TID 489). 2452 bytes result sent to driver
23/09/24 21:34:58 INFO Executor: Finished task 21.1 in stage 3.0 (TID 488). 2452 bytes result sent to driver
23/09/24 21:34:58 INFO Executor: Finished task 63.1 in stage 3.0 (TID 496). 2452 bytes result sent to driver
23/09/24 21:34:58 INFO Executor: Finished task 90.1 in stage 3.0 (TID 498). 2452 bytes result sent to driver
23/09/24 21:34:59 INFO CoarseGrainedExecutorBackend: Got assigned task 505
23/09/24 21:34:59 INFO Executor: Running task 2.0 in stage 6.0 (TID 505)
23/09/24 21:34:59 INFO MapOutputTrackerWorker: Updating epoch to 3 and clearing cache
23/09/24 21:34:59 INFO TorrentBroadcast: Started reading broadcast variable 10 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:34:59 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 7.0 KiB, free 57.4 MiB)
23/09/24 21:34:59 INFO TorrentBroadcast: Reading broadcast variable 10 took 5 ms
23/09/24 21:34:59 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 14.7 KiB, free 57.4 MiB)
23/09/24 21:34:59 INFO CodeGenerator: Code generated in 11.909794 ms
23/09/24 21:34:59 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00038-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4078, partition values: [empty row]
23/09/24 21:34:59 INFO TorrentBroadcast: Started reading broadcast variable 9 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:34:59 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 25.1 KiB, free 57.4 MiB)
23/09/24 21:34:59 INFO TorrentBroadcast: Reading broadcast variable 9 took 6 ms
23/09/24 21:34:59 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 398.2 KiB, free 57.0 MiB)
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00044-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4078, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00015-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4075, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00009-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4062, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00085-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4057, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00105-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4037, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00004-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4030, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00064-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4018, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00082-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4010, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00071-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4009, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00101-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-3992, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00059-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-3992, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00000-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-1531, partition values: [empty row]
23/09/24 21:35:00 INFO Executor: Finished task 2.0 in stage 6.0 (TID 505). 2058 bytes result sent to driver
23/09/24 21:35:00 INFO CoarseGrainedExecutorBackend: Got assigned task 506
23/09/24 21:35:00 INFO Executor: Running task 0.0 in stage 7.0 (TID 506)
23/09/24 21:35:00 INFO MapOutputTrackerWorker: Updating epoch to 4 and clearing cache
23/09/24 21:35:00 INFO TorrentBroadcast: Started reading broadcast variable 11 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:00 INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 5.0 KiB, free 57.0 MiB)
23/09/24 21:35:00 INFO TorrentBroadcast: Reading broadcast variable 11 took 4 ms
23/09/24 21:35:00 INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 10.1 KiB, free 57.0 MiB)
23/09/24 21:35:00 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 2, fetching them
23/09/24 21:35:00 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@static.154.188.161.5.clients.your-server.de:46637)
23/09/24 21:35:00 INFO MapOutputTrackerWorker: Got the output locations
23/09/24 21:35:00 INFO ShuffleBlockFetcherIterator: Getting 3 (180.0 B) non-empty blocks including 1 (60.0 B) local and 2 (120.0 B) host-local and 0 (0.0 B) remote blocks
23/09/24 21:35:00 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
23/09/24 21:35:00 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:45879 after 1 ms (0 ms spent in bootstraps)
23/09/24 21:35:00 INFO Executor: Finished task 0.0 in stage 7.0 (TID 506). 2450 bytes result sent to driver
23/09/24 21:35:00 INFO CoarseGrainedExecutorBackend: Got assigned task 507
23/09/24 21:35:00 INFO Executor: Running task 0.0 in stage 8.0 (TID 507)
23/09/24 21:35:00 INFO TorrentBroadcast: Started reading broadcast variable 13 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:00 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 10.0 KiB, free 57.5 MiB)
23/09/24 21:35:00 INFO TorrentBroadcast: Reading broadcast variable 13 took 4 ms
23/09/24 21:35:00 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 29.8 KiB, free 57.5 MiB)
23/09/24 21:35:00 INFO CodeGenerator: Code generated in 12.477155 ms
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00056-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4526, partition values: [empty row]
23/09/24 21:35:00 INFO TorrentBroadcast: Started reading broadcast variable 12 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:00 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 25.8 KiB, free 57.5 MiB)
23/09/24 21:35:00 INFO TorrentBroadcast: Reading broadcast variable 12 took 10 ms
23/09/24 21:35:00 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 398.2 KiB, free 57.1 MiB)
23/09/24 21:35:00 INFO CodecPool: Got brand-new decompressor [.snappy]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00136-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4489, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00000-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4486, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00072-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4485, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00016-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4480, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00145-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4447, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00024-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4420, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00097-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4419, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00090-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4387, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00105-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4380, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00074-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4364, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00154-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4340, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00066-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4281, partition values: [empty row]
23/09/24 21:35:00 INFO MemoryStore: Block rdd_44_0 stored as values in memory (estimated size 5.4 KiB, free 57.1 MiB)
23/09/24 21:35:00 INFO CodeGenerator: Code generated in 4.407989 ms
23/09/24 21:35:00 INFO CodeGenerator: Code generated in 15.182678 ms
23/09/24 21:35:00 INFO CodeGenerator: Code generated in 6.131235 ms
23/09/24 21:35:00 INFO Executor: Finished task 0.0 in stage 8.0 (TID 507). 2124 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 512
23/09/24 21:35:01 INFO Executor: Running task 0.0 in stage 9.0 (TID 512)
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 15 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 57.1 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 15 took 4 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 36.8 KiB, free 57.0 MiB)
23/09/24 21:35:01 INFO BlockManager: Found block rdd_44_0 locally
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 6.564735 ms
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 10.89195 ms
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 13.25172 ms
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 14 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 1669.0 B, free 57.0 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 14 took 6 ms
23/09/24 21:35:01 INFO MemoryStore: 7 blocks selected for dropping (111.2 MiB bytes)
23/09/24 21:35:01 INFO BlockManager: Dropping block broadcast_1_piece0 from memory
23/09/24 21:35:01 INFO BlockManager: Writing block broadcast_1_piece0 to disk
23/09/24 21:35:01 INFO BlockManager: Dropping block broadcast_1 from memory
23/09/24 21:35:01 INFO BlockManager: Writing block broadcast_1 to disk
23/09/24 21:35:01 INFO BlockManager: Dropping block broadcast_0_piece0 from memory
23/09/24 21:35:01 INFO BlockManager: Writing block broadcast_0_piece0 to disk
23/09/24 21:35:01 INFO BlockManager: Dropping block broadcast_0 from memory
23/09/24 21:35:01 INFO BlockManager: Writing block broadcast_0 to disk
23/09/24 21:35:01 INFO BlockManager: Dropping block broadcast_5 from memory
23/09/24 21:35:01 INFO BlockManager: Writing block broadcast_5 to disk
23/09/24 21:35:01 INFO BlockManager: Dropping block broadcast_5_piece0 from memory
23/09/24 21:35:01 INFO BlockManager: Writing block broadcast_5_piece0 to disk
23/09/24 21:35:01 INFO BlockManager: Dropping block rdd_22_12 from memory
23/09/24 21:35:01 INFO MemoryStore: After dropping 7 blocks, free memory is 168.2 MiB
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 64.0 MiB, free 104.2 MiB)
23/09/24 21:35:01 INFO Executor: Finished task 0.0 in stage 9.0 (TID 512). 2435 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 516
23/09/24 21:35:01 INFO Executor: Running task 0.0 in stage 11.0 (TID 516)
23/09/24 21:35:01 INFO MapOutputTrackerWorker: Updating epoch to 5 and clearing cache
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 17 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 104.2 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 17 took 4 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 30.5 KiB, free 104.2 MiB)
23/09/24 21:35:01 INFO BlockManager: Found block rdd_44_0 locally
23/09/24 21:35:01 INFO Executor: Finished task 0.0 in stage 11.0 (TID 516). 2124 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 517
23/09/24 21:35:01 INFO Executor: Running task 0.0 in stage 12.0 (TID 517)
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 19 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 104.2 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 19 took 4 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_19 stored as values in memory (estimated size 36.8 KiB, free 104.2 MiB)
23/09/24 21:35:01 INFO BlockManager: Found block rdd_44_0 locally
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 7.255881 ms
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 9.580873 ms
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 18 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 1669.0 B, free 104.2 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 18 took 4 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_18 stored as values in memory (estimated size 64.0 MiB, free 40.2 MiB)
23/09/24 21:35:01 INFO Executor: Finished task 0.0 in stage 12.0 (TID 517). 2435 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 522
23/09/24 21:35:01 INFO Executor: Running task 0.0 in stage 14.0 (TID 522)
23/09/24 21:35:01 INFO MapOutputTrackerWorker: Updating epoch to 6 and clearing cache
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 21 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_21_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 40.1 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 21 took 5 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_21 stored as values in memory (estimated size 30.5 KiB, free 40.1 MiB)
23/09/24 21:35:01 INFO BlockManager: Found block rdd_44_0 locally
23/09/24 21:35:01 INFO Executor: Finished task 0.0 in stage 14.0 (TID 522). 2124 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 525
23/09/24 21:35:01 INFO Executor: Running task 0.0 in stage 15.0 (TID 525)
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 23 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 40.1 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 23 took 4 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_23 stored as values in memory (estimated size 36.8 KiB, free 40.1 MiB)
23/09/24 21:35:01 INFO BlockManager: Found block rdd_44_0 locally
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 22 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 1669.0 B, free 40.1 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 22 took 4 ms
23/09/24 21:35:01 INFO MemoryStore: 1 blocks selected for dropping (116.9 MiB bytes)
23/09/24 21:35:01 INFO BlockManager: Dropping block rdd_22_3 from memory
23/09/24 21:35:01 INFO MemoryStore: After dropping 1 blocks, free memory is 157.0 MiB
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_22 stored as values in memory (estimated size 64.0 MiB, free 93.0 MiB)
23/09/24 21:35:01 INFO Executor: Finished task 0.0 in stage 15.0 (TID 525). 2435 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 527
23/09/24 21:35:01 INFO Executor: Running task 0.0 in stage 16.0 (TID 527)
23/09/24 21:35:01 INFO MapOutputTrackerWorker: Updating epoch to 7 and clearing cache
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 24 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_24_piece0 stored as bytes in memory (estimated size 5.0 KiB, free 93.0 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 24 took 3 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_24 stored as values in memory (estimated size 10.1 KiB, free 93.0 MiB)
23/09/24 21:35:01 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 5, fetching them
23/09/24 21:35:01 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@static.154.188.161.5.clients.your-server.de:46637)
23/09/24 21:35:01 INFO MapOutputTrackerWorker: Got the output locations
23/09/24 21:35:01 INFO ShuffleBlockFetcherIterator: Getting 3 (180.0 B) non-empty blocks including 1 (60.0 B) local and 2 (120.0 B) host-local and 0 (0.0 B) remote blocks
23/09/24 21:35:01 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 6.36171 ms
23/09/24 21:35:01 INFO Executor: Finished task 0.0 in stage 16.0 (TID 527). 2450 bytes result sent to driver
23/09/24 21:35:06 INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown
23/09/24 21:35:06 ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
tdown