3:41 INFO Executor: Finished task 52.0 in stage 0.0 (TID 52). 2195 bytes result sent to driver
23/09/24 21:33:41 INFO CoarseGrainedExecutorBackend: Got assigned task 67
23/09/24 21:33:41 INFO Executor: Running task 67.0 in stage 0.0 (TID 67)
23/09/24 21:33:41 INFO Executor: Finished task 53.0 in stage 0.0 (TID 53). 2195 bytes result sent to driver
23/09/24 21:33:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8992587776-9126805504, partition values: [empty row]
23/09/24 21:33:41 INFO CoarseGrainedExecutorBackend: Got assigned task 68
23/09/24 21:33:41 INFO Executor: Running task 68.0 in stage 0.0 (TID 68)
23/09/24 21:33:41 INFO Executor: Finished task 54.0 in stage 0.0 (TID 54). 2195 bytes result sent to driver
23/09/24 21:33:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9126805504-9261023232, partition values: [empty row]
23/09/24 21:33:41 INFO CoarseGrainedExecutorBackend: Got assigned task 69
23/09/24 21:33:41 INFO Executor: Running task 69.0 in stage 0.0 (TID 69)
23/09/24 21:33:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9261023232-9395240960, partition values: [empty row]
23/09/24 21:33:42 INFO Executor: Finished task 65.0 in stage 0.0 (TID 65). 2195 bytes result sent to driver
23/09/24 21:33:42 INFO CoarseGrainedExecutorBackend: Got assigned task 80
23/09/24 21:33:42 INFO Executor: Running task 80.0 in stage 0.0 (TID 80)
23/09/24 21:33:42 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10737418240-10871635968, partition values: [empty row]
23/09/24 21:33:43 INFO Executor: Finished task 66.0 in stage 0.0 (TID 66). 2195 bytes result sent to driver
23/09/24 21:33:43 INFO CoarseGrainedExecutorBackend: Got assigned task 81
23/09/24 21:33:43 INFO Executor: Running task 81.0 in stage 0.0 (TID 81)
23/09/24 21:33:43 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10871635968-11005853696, partition values: [empty row]
23/09/24 21:33:43 INFO Executor: Finished task 67.0 in stage 0.0 (TID 67). 2195 bytes result sent to driver
23/09/24 21:33:43 INFO CoarseGrainedExecutorBackend: Got assigned task 82
23/09/24 21:33:43 INFO Executor: Running task 82.0 in stage 0.0 (TID 82)
23/09/24 21:33:43 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11005853696-11140071424, partition values: [empty row]
23/09/24 21:33:43 INFO Executor: Finished task 68.0 in stage 0.0 (TID 68). 2195 bytes result sent to driver
23/09/24 21:33:43 INFO Executor: Finished task 69.0 in stage 0.0 (TID 69). 2195 bytes result sent to driver
23/09/24 21:33:43 INFO CoarseGrainedExecutorBackend: Got assigned task 83
23/09/24 21:33:43 INFO CoarseGrainedExecutorBackend: Got assigned task 84
23/09/24 21:33:43 INFO Executor: Running task 83.0 in stage 0.0 (TID 83)
23/09/24 21:33:43 INFO Executor: Running task 84.0 in stage 0.0 (TID 84)
23/09/24 21:33:43 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11274289152-11408506880, partition values: [empty row]
23/09/24 21:33:43 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11140071424-11274289152, partition values: [empty row]
23/09/24 21:33:44 INFO Executor: Finished task 80.0 in stage 0.0 (TID 80). 2195 bytes result sent to driver
23/09/24 21:33:44 INFO CoarseGrainedExecutorBackend: Got assigned task 95
23/09/24 21:33:44 INFO Executor: Running task 95.0 in stage 0.0 (TID 95)
23/09/24 21:33:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12750684160-12884901888, partition values: [empty row]
23/09/24 21:33:44 INFO Executor: Finished task 81.0 in stage 0.0 (TID 81). 2238 bytes result sent to driver
23/09/24 21:33:44 INFO CoarseGrainedExecutorBackend: Got assigned task 96
23/09/24 21:33:44 INFO Executor: Finished task 84.0 in stage 0.0 (TID 84). 2195 bytes result sent to driver
23/09/24 21:33:44 INFO CoarseGrainedExecutorBackend: Got assigned task 97
23/09/24 21:33:44 INFO Executor: Running task 96.0 in stage 0.0 (TID 96)
23/09/24 21:33:44 INFO Executor: Running task 97.0 in stage 0.0 (TID 97)
23/09/24 21:33:44 INFO Executor: Finished task 82.0 in stage 0.0 (TID 82). 2195 bytes result sent to driver
23/09/24 21:33:44 INFO CoarseGrainedExecutorBackend: Got assigned task 98
23/09/24 21:33:44 INFO Executor: Running task 98.0 in stage 0.0 (TID 98)
23/09/24 21:33:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12884901888-13019119616, partition values: [empty row]
23/09/24 21:33:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13019119616-13153337344, partition values: [empty row]
23/09/24 21:33:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13153337344-13287555072, partition values: [empty row]
23/09/24 21:33:44 INFO Executor: Finished task 83.0 in stage 0.0 (TID 83). 2195 bytes result sent to driver
23/09/24 21:33:44 INFO CoarseGrainedExecutorBackend: Got assigned task 99
23/09/24 21:33:44 INFO Executor: Running task 99.0 in stage 0.0 (TID 99)
23/09/24 21:33:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13287555072-13421772800, partition values: [empty row]
23/09/24 21:33:46 INFO Executor: Finished task 95.0 in stage 0.0 (TID 95). 2195 bytes result sent to driver
23/09/24 21:33:46 INFO CoarseGrainedExecutorBackend: Got assigned task 110
23/09/24 21:33:46 INFO Executor: Running task 110.0 in stage 0.0 (TID 110)
23/09/24 21:33:46 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14763950080-14898167808, partition values: [empty row]
23/09/24 21:33:46 INFO Executor: Finished task 97.0 in stage 0.0 (TID 97). 2195 bytes result sent to driver
23/09/24 21:33:46 INFO CoarseGrainedExecutorBackend: Got assigned task 111
23/09/24 21:33:46 INFO Executor: Running task 111.0 in stage 0.0 (TID 111)
23/09/24 21:33:46 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14898167808-15032385536, partition values: [empty row]
23/09/24 21:33:46 INFO Executor: Finished task 96.0 in stage 0.0 (TID 96). 2195 bytes result sent to driver
23/09/24 21:33:46 INFO CoarseGrainedExecutorBackend: Got assigned task 112
23/09/24 21:33:46 INFO Executor: Running task 112.0 in stage 0.0 (TID 112)
23/09/24 21:33:46 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15032385536-15166603264, partition values: [empty row]
23/09/24 21:33:46 INFO Executor: Finished task 98.0 in stage 0.0 (TID 98). 2195 bytes result sent to driver
23/09/24 21:33:46 INFO CoarseGrainedExecutorBackend: Got assigned task 113
23/09/24 21:33:46 INFO Executor: Running task 113.0 in stage 0.0 (TID 113)
23/09/24 21:33:46 INFO Executor: Finished task 99.0 in stage 0.0 (TID 99). 2195 bytes result sent to driver
23/09/24 21:33:46 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15166603264-15300820992, partition values: [empty row]
23/09/24 21:33:46 INFO CoarseGrainedExecutorBackend: Got assigned task 114
23/09/24 21:33:46 INFO Executor: Running task 114.0 in stage 0.0 (TID 114)
23/09/24 21:33:46 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15300820992-15435038720, partition values: [empty row]
23/09/24 21:33:47 INFO Executor: Finished task 110.0 in stage 0.0 (TID 110). 2195 bytes result sent to driver
23/09/24 21:33:47 INFO CoarseGrainedExecutorBackend: Got assigned task 125
23/09/24 21:33:47 INFO Executor: Running task 125.0 in stage 0.0 (TID 125)
23/09/24 21:33:47 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16777216000-16911433728, partition values: [empty row]
23/09/24 21:33:47 INFO Executor: Finished task 111.0 in stage 0.0 (TID 111). 2145 bytes result sent to driver
23/09/24 21:33:47 INFO CoarseGrainedExecutorBackend: Got assigned task 126
23/09/24 21:33:47 INFO Executor: Running task 126.0 in stage 0.0 (TID 126)
23/09/24 21:33:47 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16911433728-17045651456, partition values: [empty row]
23/09/24 21:33:47 INFO Executor: Finished task 113.0 in stage 0.0 (TID 113). 2145 bytes result sent to driver
23/09/24 21:33:47 INFO CoarseGrainedExecutorBackend: Got assigned task 127
23/09/24 21:33:47 INFO Executor: Running task 127.0 in stage 0.0 (TID 127)
23/09/24 21:33:47 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17045651456-17179869184, partition values: [empty row]
23/09/24 21:33:47 INFO Executor: Finished task 114.0 in stage 0.0 (TID 114). 2195 bytes result sent to driver
23/09/24 21:33:47 INFO CoarseGrainedExecutorBackend: Got assigned task 128
23/09/24 21:33:47 INFO Executor: Running task 128.0 in stage 0.0 (TID 128)
23/09/24 21:33:47 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17179869184-17314086912, partition values: [empty row]
23/09/24 21:33:48 INFO Executor: Finished task 112.0 in stage 0.0 (TID 112). 2145 bytes result sent to driver
23/09/24 21:33:48 INFO CoarseGrainedExecutorBackend: Got assigned task 129
23/09/24 21:33:48 INFO Executor: Running task 129.0 in stage 0.0 (TID 129)
23/09/24 21:33:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17314086912-17448304640, partition values: [empty row]
23/09/24 21:33:49 INFO Executor: Finished task 125.0 in stage 0.0 (TID 125). 2145 bytes result sent to driver
23/09/24 21:33:49 INFO CoarseGrainedExecutorBackend: Got assigned task 140
23/09/24 21:33:49 INFO Executor: Running task 140.0 in stage 0.0 (TID 140)
23/09/24 21:33:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18790481920-18924699648, partition values: [empty row]
23/09/24 21:33:49 INFO Executor: Finished task 127.0 in stage 0.0 (TID 127). 2195 bytes result sent to driver
23/09/24 21:33:49 INFO Executor: Finished task 126.0 in stage 0.0 (TID 126). 2195 bytes result sent to driver
23/09/24 21:33:49 INFO CoarseGrainedExecutorBackend: Got assigned task 141
23/09/24 21:33:49 INFO Executor: Running task 141.0 in stage 0.0 (TID 141)
23/09/24 21:33:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18924699648-19058917376, partition values: [empty row]
23/09/24 21:33:49 INFO CoarseGrainedExecutorBackend: Got assigned task 142
23/09/24 21:33:49 INFO Executor: Running task 142.0 in stage 0.0 (TID 142)
23/09/24 21:33:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19058917376-19193135104, partition values: [empty row]
23/09/24 21:33:49 INFO Executor: Finished task 129.0 in stage 0.0 (TID 129). 2195 bytes result sent to driver
23/09/24 21:33:49 INFO CoarseGrainedExecutorBackend: Got assigned task 143
23/09/24 21:33:49 INFO Executor: Running task 143.0 in stage 0.0 (TID 143)
23/09/24 21:33:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19193135104-19327352832, partition values: [empty row]
23/09/24 21:33:49 INFO Executor: Finished task 128.0 in stage 0.0 (TID 128). 2145 bytes result sent to driver
23/09/24 21:33:49 INFO CoarseGrainedExecutorBackend: Got assigned task 144
23/09/24 21:33:49 INFO Executor: Running task 144.0 in stage 0.0 (TID 144)
23/09/24 21:33:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19327352832-19461570560, partition values: [empty row]
23/09/24 21:33:50 INFO Executor: Finished task 140.0 in stage 0.0 (TID 140). 2195 bytes result sent to driver
23/09/24 21:33:50 INFO Executor: Finished task 141.0 in stage 0.0 (TID 141). 2195 bytes result sent to driver
23/09/24 21:33:50 INFO Executor: Finished task 142.0 in stage 0.0 (TID 142). 2195 bytes result sent to driver
23/09/24 21:33:51 INFO Executor: Finished task 144.0 in stage 0.0 (TID 144). 2145 bytes result sent to driver
23/09/24 21:33:51 INFO Executor: Finished task 143.0 in stage 0.0 (TID 143). 2195 bytes result sent to driver
23/09/24 21:33:52 INFO CoarseGrainedExecutorBackend: Got assigned task 152
23/09/24 21:33:52 INFO CoarseGrainedExecutorBackend: Got assigned task 155
23/09/24 21:33:52 INFO Executor: Running task 2.0 in stage 1.0 (TID 152)
23/09/24 21:33:52 INFO CoarseGrainedExecutorBackend: Got assigned task 158
23/09/24 21:33:52 INFO Executor: Running task 5.0 in stage 1.0 (TID 155)
23/09/24 21:33:52 INFO CoarseGrainedExecutorBackend: Got assigned task 161
23/09/24 21:33:52 INFO CoarseGrainedExecutorBackend: Got assigned task 164
23/09/24 21:33:52 INFO Executor: Running task 11.0 in stage 1.0 (TID 161)
23/09/24 21:33:52 INFO Executor: Running task 14.0 in stage 1.0 (TID 164)
23/09/24 21:33:52 INFO Executor: Running task 8.0 in stage 1.0 (TID 158)
23/09/24 21:33:52 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:33:52 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 7.3 KiB, free 5.2 GiB)
23/09/24 21:33:52 INFO TorrentBroadcast: Reading broadcast variable 3 took 9 ms
23/09/24 21:33:52 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 14.3 KiB, free 5.2 GiB)
23/09/24 21:33:52 INFO CodeGenerator: Code generated in 22.34065 ms
23/09/24 21:33:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 671088640-805306368, partition values: [empty row]
23/09/24 21:33:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1073741824-1207959552, partition values: [empty row]
23/09/24 21:33:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1476395008-1610612736, partition values: [empty row]
23/09/24 21:33:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 268435456-402653184, partition values: [empty row]
23/09/24 21:33:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1879048192-2013265920, partition values: [empty row]
23/09/24 21:33:52 INFO CodeGenerator: Code generated in 7.933443 ms
23/09/24 21:33:52 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:33:52 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 24.8 KiB, free 5.2 GiB)
23/09/24 21:33:52 INFO TorrentBroadcast: Reading broadcast variable 2 took 9 ms
23/09/24 21:33:52 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 394.6 KiB, free 5.2 GiB)
23/09/24 21:33:53 INFO Executor: Finished task 2.0 in stage 1.0 (TID 152). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 169
23/09/24 21:33:53 INFO Executor: Running task 19.0 in stage 1.0 (TID 169)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2550136832-2684354560, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 5.0 in stage 1.0 (TID 155). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 171
23/09/24 21:33:53 INFO Executor: Running task 21.0 in stage 1.0 (TID 171)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2818572288-2952790016, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 8.0 in stage 1.0 (TID 158). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 172
23/09/24 21:33:53 INFO Executor: Running task 22.0 in stage 1.0 (TID 172)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2952790016-3087007744, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 14.0 in stage 1.0 (TID 164). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 173
23/09/24 21:33:53 INFO Executor: Running task 23.0 in stage 1.0 (TID 173)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3087007744-3221225472, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 11.0 in stage 1.0 (TID 161). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 177
23/09/24 21:33:53 INFO Executor: Running task 27.0 in stage 1.0 (TID 177)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3623878656-3758096384, partition values: [empty row]
23/09/24 21:33:53 INFO Executor: Finished task 19.0 in stage 1.0 (TID 169). 1844 bytes result sent to driver
23/09/24 21:33:53 INFO CoarseGrainedExecutorBackend: Got assigned task 185
23/09/24 21:33:53 INFO Executor: Running task 35.0 in stage 1.0 (TID 185)
23/09/24 21:33:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4697620480-4831838208, partition values: [empty row]
23/09/24 21:33:54 INFO Executor: Finished task 22.0 in stage 1.0 (TID 172). 1887 bytes result sent to driver
23/09/24 21:33:54 INFO CoarseGrainedExecutorBackend: Got assigned task 187
23/09/24 21:33:54 INFO Executor: Running task 37.0 in stage 1.0 (TID 187)
23/09/24 21:33:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4966055936-5100273664, partition values: [empty row]
23/09/24 21:33:54 INFO Executor: Finished task 21.0 in stage 1.0 (TID 171). 1887 bytes result sent to driver
23/09/24 21:33:54 INFO CoarseGrainedExecutorBackend: Got assigned task 189
23/09/24 21:33:54 INFO Executor: Running task 39.0 in stage 1.0 (TID 189)
23/09/24 21:33:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5234491392-5368709120, partition values: [empty row]
23/09/24 21:33:54 INFO Executor: Finished task 23.0 in stage 1.0 (TID 173). 1887 bytes result sent to driver
23/09/24 21:33:54 INFO CoarseGrainedExecutorBackend: Got assigned task 194
23/09/24 21:33:54 INFO Executor: Running task 44.0 in stage 1.0 (TID 194)
23/09/24 21:33:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5905580032-6039797760, partition values: [empty row]
23/09/24 21:33:54 INFO Executor: Finished task 27.0 in stage 1.0 (TID 177). 1887 bytes result sent to driver
23/09/24 21:33:54 INFO CoarseGrainedExecutorBackend: Got assigned task 199
23/09/24 21:33:54 INFO Executor: Running task 49.0 in stage 1.0 (TID 199)
23/09/24 21:33:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6576668672-6710886400, partition values: [empty row]
23/09/24 21:33:54 INFO Executor: Finished task 35.0 in stage 1.0 (TID 185). 1887 bytes result sent to driver
23/09/24 21:33:54 INFO CoarseGrainedExecutorBackend: Got assigned task 200
23/09/24 21:33:54 INFO Executor: Running task 50.0 in stage 1.0 (TID 200)
23/09/24 21:33:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6710886400-6845104128, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 37.0 in stage 1.0 (TID 187). 1844 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 208
23/09/24 21:33:55 INFO Executor: Running task 58.0 in stage 1.0 (TID 208)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7784628224-7918845952, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 39.0 in stage 1.0 (TID 189). 1844 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 212
23/09/24 21:33:55 INFO Executor: Running task 62.0 in stage 1.0 (TID 212)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8321499136-8455716864, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 49.0 in stage 1.0 (TID 199). 1844 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 213
23/09/24 21:33:55 INFO Executor: Running task 63.0 in stage 1.0 (TID 213)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8455716864-8589934592, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 44.0 in stage 1.0 (TID 194). 1844 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 214
23/09/24 21:33:55 INFO Executor: Running task 64.0 in stage 1.0 (TID 214)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8589934592-8724152320, partition values: [empty row]
23/09/24 21:33:55 INFO Executor: Finished task 50.0 in stage 1.0 (TID 200). 1844 bytes result sent to driver
23/09/24 21:33:55 INFO CoarseGrainedExecutorBackend: Got assigned task 215
23/09/24 21:33:55 INFO Executor: Running task 65.0 in stage 1.0 (TID 215)
23/09/24 21:33:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8724152320-8858370048, partition values: [empty row]
23/09/24 21:33:56 INFO Executor: Finished task 62.0 in stage 1.0 (TID 212). 1844 bytes result sent to driver
23/09/24 21:33:56 INFO CoarseGrainedExecutorBackend: Got assigned task 223
23/09/24 21:33:56 INFO Executor: Running task 73.0 in stage 1.0 (TID 223)
23/09/24 21:33:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9797894144-9932111872, partition values: [empty row]
23/09/24 21:33:56 INFO Executor: Finished task 58.0 in stage 1.0 (TID 208). 1844 bytes result sent to driver
23/09/24 21:33:56 INFO CoarseGrainedExecutorBackend: Got assigned task 226
23/09/24 21:33:56 INFO Executor: Running task 76.0 in stage 1.0 (TID 226)
23/09/24 21:33:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10200547328-10334765056, partition values: [empty row]
23/09/24 21:33:56 INFO Executor: Finished task 63.0 in stage 1.0 (TID 213). 1844 bytes result sent to driver
23/09/24 21:33:56 INFO CoarseGrainedExecutorBackend: Got assigned task 228
23/09/24 21:33:56 INFO Executor: Running task 78.0 in stage 1.0 (TID 228)
23/09/24 21:33:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10468982784-10603200512, partition values: [empty row]
23/09/24 21:33:56 INFO Executor: Finished task 64.0 in stage 1.0 (TID 214). 1844 bytes result sent to driver
23/09/24 21:33:56 INFO CoarseGrainedExecutorBackend: Got assigned task 229
23/09/24 21:33:56 INFO Executor: Running task 79.0 in stage 1.0 (TID 229)
23/09/24 21:33:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10603200512-10737418240, partition values: [empty row]
23/09/24 21:33:56 INFO Executor: Finished task 65.0 in stage 1.0 (TID 215). 1844 bytes result sent to driver
23/09/24 21:33:56 INFO CoarseGrainedExecutorBackend: Got assigned task 230
23/09/24 21:33:56 INFO Executor: Running task 80.0 in stage 1.0 (TID 230)
23/09/24 21:33:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10737418240-10871635968, partition values: [empty row]
23/09/24 21:33:57 INFO Executor: Finished task 73.0 in stage 1.0 (TID 223). 1844 bytes result sent to driver
23/09/24 21:33:57 INFO CoarseGrainedExecutorBackend: Got assigned task 238
23/09/24 21:33:57 INFO Executor: Running task 88.0 in stage 1.0 (TID 238)
23/09/24 21:33:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11811160064-11945377792, partition values: [empty row]
23/09/24 21:33:57 INFO Executor: Finished task 76.0 in stage 1.0 (TID 226). 1844 bytes result sent to driver
23/09/24 21:33:57 INFO CoarseGrainedExecutorBackend: Got assigned task 241
23/09/24 21:33:57 INFO Executor: Running task 91.0 in stage 1.0 (TID 241)
23/09/24 21:33:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12213813248-12348030976, partition values: [empty row]
23/09/24 21:33:57 INFO Executor: Finished task 78.0 in stage 1.0 (TID 228). 1844 bytes result sent to driver
23/09/24 21:33:57 INFO CoarseGrainedExecutorBackend: Got assigned task 245
23/09/24 21:33:57 INFO Executor: Running task 95.0 in stage 1.0 (TID 245)
23/09/24 21:33:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12750684160-12884901888, partition values: [empty row]
23/09/24 21:33:57 INFO Executor: Finished task 80.0 in stage 1.0 (TID 230). 1844 bytes result sent to driver
23/09/24 21:33:57 INFO CoarseGrainedExecutorBackend: Got assigned task 249
23/09/24 21:33:57 INFO Executor: Running task 99.0 in stage 1.0 (TID 249)
23/09/24 21:33:57 INFO Executor: Finished task 79.0 in stage 1.0 (TID 229). 1844 bytes result sent to driver
23/09/24 21:33:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13287555072-13421772800, partition values: [empty row]
23/09/24 21:33:57 INFO CoarseGrainedExecutorBackend: Got assigned task 250
23/09/24 21:33:57 INFO Executor: Running task 100.0 in stage 1.0 (TID 250)
23/09/24 21:33:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13421772800-13555990528, partition values: [empty row]
23/09/24 21:33:58 INFO Executor: Finished task 88.0 in stage 1.0 (TID 238). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 259
23/09/24 21:33:58 INFO Executor: Running task 109.0 in stage 1.0 (TID 259)
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14629732352-14763950080, partition values: [empty row]
23/09/24 21:33:58 INFO Executor: Finished task 91.0 in stage 1.0 (TID 241). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 261
23/09/24 21:33:58 INFO Executor: Running task 111.0 in stage 1.0 (TID 261)
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14898167808-15032385536, partition values: [empty row]
23/09/24 21:33:58 INFO Executor: Finished task 100.0 in stage 1.0 (TID 250). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 262
23/09/24 21:33:58 INFO Executor: Running task 112.0 in stage 1.0 (TID 262)
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15032385536-15166603264, partition values: [empty row]
23/09/24 21:33:58 INFO Executor: Finished task 95.0 in stage 1.0 (TID 245). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 264
23/09/24 21:33:58 INFO Executor: Running task 114.0 in stage 1.0 (TID 264)
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15300820992-15435038720, partition values: [empty row]
23/09/24 21:33:58 INFO Executor: Finished task 99.0 in stage 1.0 (TID 249). 1844 bytes result sent to driver
23/09/24 21:33:58 INFO CoarseGrainedExecutorBackend: Got assigned task 265
23/09/24 21:33:58 INFO Executor: Running task 115.0 in stage 1.0 (TID 265)
23/09/24 21:33:58 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15435038720-15569256448, partition values: [empty row]
23/09/24 21:33:59 INFO Executor: Finished task 111.0 in stage 1.0 (TID 261). 1887 bytes result sent to driver
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 275
23/09/24 21:33:59 INFO Executor: Running task 125.0 in stage 1.0 (TID 275)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16777216000-16911433728, partition values: [empty row]
23/09/24 21:33:59 INFO Executor: Finished task 109.0 in stage 1.0 (TID 259). 1887 bytes result sent to driver
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 276
23/09/24 21:33:59 INFO Executor: Running task 126.0 in stage 1.0 (TID 276)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16911433728-17045651456, partition values: [empty row]
23/09/24 21:33:59 INFO Executor: Finished task 112.0 in stage 1.0 (TID 262). 1887 bytes result sent to driver
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 278
23/09/24 21:33:59 INFO Executor: Running task 128.0 in stage 1.0 (TID 278)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17179869184-17314086912, partition values: [empty row]
23/09/24 21:33:59 INFO Executor: Finished task 114.0 in stage 1.0 (TID 264). 1887 bytes result sent to driver
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 280
23/09/24 21:33:59 INFO Executor: Running task 130.0 in stage 1.0 (TID 280)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17448304640-17582522368, partition values: [empty row]
23/09/24 21:33:59 INFO Executor: Finished task 115.0 in stage 1.0 (TID 265). 1887 bytes result sent to driver
23/09/24 21:33:59 INFO CoarseGrainedExecutorBackend: Got assigned task 285
23/09/24 21:33:59 INFO Executor: Running task 135.0 in stage 1.0 (TID 285)
23/09/24 21:33:59 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18119393280-18253611008, partition values: [empty row]
23/09/24 21:34:00 INFO Executor: Finished task 125.0 in stage 1.0 (TID 275). 1844 bytes result sent to driver
23/09/24 21:34:00 INFO CoarseGrainedExecutorBackend: Got assigned task 294
23/09/24 21:34:00 INFO Executor: Running task 144.0 in stage 1.0 (TID 294)
23/09/24 21:34:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19327352832-19461570560, partition values: [empty row]
23/09/24 21:34:00 INFO Executor: Finished task 126.0 in stage 1.0 (TID 276). 1844 bytes result sent to driver
23/09/24 21:34:00 INFO CoarseGrainedExecutorBackend: Got assigned task 295
23/09/24 21:34:00 INFO Executor: Running task 145.0 in stage 1.0 (TID 295)
23/09/24 21:34:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19461570560-19595788288, partition values: [empty row]
23/09/24 21:34:00 INFO Executor: Finished task 128.0 in stage 1.0 (TID 278). 1844 bytes result sent to driver
23/09/24 21:34:00 INFO CoarseGrainedExecutorBackend: Got assigned task 296
23/09/24 21:34:00 INFO Executor: Running task 146.0 in stage 1.0 (TID 296)
23/09/24 21:34:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19595788288-19730006016, partition values: [empty row]
23/09/24 21:34:00 INFO Executor: Finished task 130.0 in stage 1.0 (TID 280). 1844 bytes result sent to driver
23/09/24 21:34:00 INFO CoarseGrainedExecutorBackend: Got assigned task 299
23/09/24 21:34:00 INFO Executor: Running task 149.0 in stage 1.0 (TID 299)
23/09/24 21:34:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19998441472-20012106932, partition values: [empty row]
23/09/24 21:34:00 INFO Executor: Finished task 149.0 in stage 1.0 (TID 299). 1844 bytes result sent to driver
23/09/24 21:34:00 INFO Executor: Finished task 135.0 in stage 1.0 (TID 285). 1844 bytes result sent to driver
23/09/24 21:34:01 INFO Executor: Finished task 145.0 in stage 1.0 (TID 295). 1844 bytes result sent to driver
23/09/24 21:34:01 INFO Executor: Finished task 144.0 in stage 1.0 (TID 294). 1844 bytes result sent to driver
23/09/24 21:34:01 INFO Executor: Finished task 146.0 in stage 1.0 (TID 296). 1844 bytes result sent to driver
23/09/24 21:34:02 INFO CoarseGrainedExecutorBackend: Got assigned task 303
23/09/24 21:34:02 INFO Executor: Running task 2.0 in stage 3.0 (TID 303)
23/09/24 21:34:02 INFO CoarseGrainedExecutorBackend: Got assigned task 306
23/09/24 21:34:02 INFO Executor: Running task 5.0 in stage 3.0 (TID 306)
23/09/24 21:34:02 INFO CoarseGrainedExecutorBackend: Got assigned task 309
23/09/24 21:34:02 INFO MapOutputTrackerWorker: Updating epoch to 1 and clearing cache
23/09/24 21:34:02 INFO CoarseGrainedExecutorBackend: Got assigned task 312
23/09/24 21:34:02 INFO Executor: Running task 8.0 in stage 3.0 (TID 309)
23/09/24 21:34:02 INFO CoarseGrainedExecutorBackend: Got assigned task 315
23/09/24 21:34:02 INFO Executor: Running task 11.0 in stage 3.0 (TID 312)
23/09/24 21:34:02 INFO Executor: Running task 14.0 in stage 3.0 (TID 315)
23/09/24 21:34:02 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:34:02 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 26.8 KiB, free 5.2 GiB)
23/09/24 21:34:02 INFO TorrentBroadcast: Reading broadcast variable 6 took 7 ms
23/09/24 21:34:02 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 92.6 KiB, free 5.2 GiB)
23/09/24 21:34:02 INFO CodeGenerator: Code generated in 123.358169 ms
23/09/24 21:34:03 INFO CodeGenerator: Code generated in 122.230788 ms
23/09/24 21:34:03 INFO CodeGenerator: Code generated in 43.278718 ms
23/09/24 21:34:03 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 671088640-805306368, partition values: [empty row]
23/09/24 21:34:03 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1073741824-1207959552, partition values: [empty row]
23/09/24 21:34:03 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1879048192-2013265920, partition values: [empty row]
23/09/24 21:34:03 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 268435456-402653184, partition values: [empty row]
23/09/24 21:34:03 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1476395008-1610612736, partition values: [empty row]
23/09/24 21:34:03 INFO CodeGenerator: Code generated in 40.859476 ms
23/09/24 21:34:03 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:34:03 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:45925 after 2 ms (0 ms spent in bootstraps)
23/09/24 21:34:03 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 24.8 KiB, free 5.2 GiB)
23/09/24 21:34:03 INFO TorrentBroadcast: Reading broadcast variable 5 took 21 ms
23/09/24 21:34:03 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 394.6 KiB, free 5.2 GiB)
23/09/24 21:34:03 INFO CodeGenerator: Code generated in 113.260625 ms
23/09/24 21:34:08 INFO MemoryStore: Block rdd_22_11 stored as values in memory (estimated size 87.1 MiB, free 5.1 GiB)
23/09/24 21:34:08 INFO CodeGenerator: Code generated in 28.064735 ms
23/09/24 21:34:08 INFO MemoryStore: Block rdd_22_2 stored as values in memory (estimated size 116.9 MiB, free 5.0 GiB)
23/09/24 21:34:08 INFO CodeGenerator: Code generated in 73.361224 ms
23/09/24 21:34:08 INFO Executor: Finished task 11.0 in stage 3.0 (TID 312). 2452 bytes result sent to driver
23/09/24 21:34:08 INFO CoarseGrainedExecutorBackend: Got assigned task 325
23/09/24 21:34:08 INFO Executor: Running task 24.0 in stage 3.0 (TID 325)
23/09/24 21:34:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3221225472-3355443200, partition values: [empty row]
23/09/24 21:34:08 INFO Executor: Finished task 2.0 in stage 3.0 (TID 303). 2452 bytes result sent to driver
23/09/24 21:34:08 INFO CoarseGrainedExecutorBackend: Got assigned task 326
23/09/24 21:34:08 INFO Executor: Running task 25.0 in stage 3.0 (TID 326)
23/09/24 21:34:08 INFO MemoryStore: Block rdd_22_14 stored as values in memory (estimated size 116.6 MiB, free 4.8 GiB)
23/09/24 21:34:08 INFO Executor: Finished task 14.0 in stage 3.0 (TID 315). 2452 bytes result sent to driver
23/09/24 21:34:08 INFO CoarseGrainedExecutorBackend: Got assigned task 327
23/09/24 21:34:08 INFO Executor: Running task 26.0 in stage 3.0 (TID 327)
23/09/24 21:34:08 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3355443200-3489660928, partition values: [empty row]
23/09/24 21:34:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3489660928-3623878656, partition values: [empty row]
23/09/24 21:34:09 INFO MemoryStore: Block rdd_22_8 stored as values in memory (estimated size 116.9 MiB, free 4.7 GiB)
23/09/24 21:34:09 INFO Executor: Finished task 8.0 in stage 3.0 (TID 309). 2452 bytes result sent to driver
23/09/24 21:34:09 INFO CoarseGrainedExecutorBackend: Got assigned task 329
23/09/24 21:34:09 INFO Executor: Running task 28.0 in stage 3.0 (TID 329)
23/09/24 21:34:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3758096384-3892314112, partition values: [empty row]
23/09/24 21:34:09 INFO MemoryStore: Block rdd_22_5 stored as values in memory (estimated size 116.9 MiB, free 4.6 GiB)
23/09/24 21:34:09 INFO Executor: Finished task 5.0 in stage 3.0 (TID 306). 2452 bytes result sent to driver
23/09/24 21:34:09 INFO CoarseGrainedExecutorBackend: Got assigned task 330
23/09/24 21:34:09 INFO Executor: Running task 29.0 in stage 3.0 (TID 330)
23/09/24 21:34:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3892314112-4026531840, partition values: [empty row]
23/09/24 21:34:13 INFO MemoryStore: Block rdd_22_28 stored as values in memory (estimated size 116.7 MiB, free 4.5 GiB)
23/09/24 21:34:13 INFO MemoryStore: Block rdd_22_26 stored as values in memory (estimated size 116.9 MiB, free 4.4 GiB)
23/09/24 21:34:13 INFO Executor: Finished task 28.0 in stage 3.0 (TID 329). 2452 bytes result sent to driver
23/09/24 21:34:13 INFO CoarseGrainedExecutorBackend: Got assigned task 341
23/09/24 21:34:13 INFO Executor: Running task 40.0 in stage 3.0 (TID 341)
23/09/24 21:34:13 INFO Executor: Finished task 26.0 in stage 3.0 (TID 327). 2452 bytes result sent to driver
23/09/24 21:34:13 INFO CoarseGrainedExecutorBackend: Got assigned task 342
23/09/24 21:34:13 INFO Executor: Running task 41.0 in stage 3.0 (TID 342)
23/09/24 21:34:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5368709120-5502926848, partition values: [empty row]
23/09/24 21:34:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5502926848-5637144576, partition values: [empty row]
23/09/24 21:34:13 INFO MemoryStore: Block rdd_22_24 stored as values in memory (estimated size 118.9 MiB, free 4.3 GiB)
23/09/24 21:34:13 INFO Executor: Finished task 24.0 in stage 3.0 (TID 325). 2452 bytes result sent to driver
23/09/24 21:34:13 INFO CoarseGrainedExecutorBackend: Got assigned task 343
23/09/24 21:34:13 INFO Executor: Running task 42.0 in stage 3.0 (TID 343)
23/09/24 21:34:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5637144576-5771362304, partition values: [empty row]
23/09/24 21:34:13 INFO MemoryStore: Block rdd_22_29 stored as values in memory (estimated size 116.6 MiB, free 4.2 GiB)
23/09/24 21:34:13 INFO Executor: Finished task 29.0 in stage 3.0 (TID 330). 2452 bytes result sent to driver
23/09/24 21:34:13 INFO CoarseGrainedExecutorBackend: Got assigned task 344
23/09/24 21:34:13 INFO Executor: Running task 43.0 in stage 3.0 (TID 344)
23/09/24 21:34:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5771362304-5905580032, partition values: [empty row]
23/09/24 21:34:13 INFO MemoryStore: Block rdd_22_25 stored as values in memory (estimated size 118.4 MiB, free 4.0 GiB)
23/09/24 21:34:13 INFO Executor: Finished task 25.0 in stage 3.0 (TID 326). 2452 bytes result sent to driver
23/09/24 21:34:13 INFO CoarseGrainedExecutorBackend: Got assigned task 345
23/09/24 21:34:13 INFO Executor: Running task 44.0 in stage 3.0 (TID 345)
23/09/24 21:34:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5905580032-6039797760, partition values: [empty row]
23/09/24 21:34:16 INFO MemoryStore: Block rdd_22_43 stored as values in memory (estimated size 102.3 MiB, free 3.9 GiB)
23/09/24 21:34:16 INFO Executor: Finished task 43.0 in stage 3.0 (TID 344). 2452 bytes result sent to driver
23/09/24 21:34:16 INFO CoarseGrainedExecutorBackend: Got assigned task 356
23/09/24 21:34:16 INFO Executor: Running task 55.0 in stage 3.0 (TID 356)
23/09/24 21:34:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7381975040-7516192768, partition values: [empty row]
23/09/24 21:34:16 INFO MemoryStore: Block rdd_22_41 stored as values in memory (estimated size 116.7 MiB, free 3.8 GiB)
23/09/24 21:34:16 INFO Executor: Finished task 41.0 in stage 3.0 (TID 342). 2452 bytes result sent to driver
23/09/24 21:34:16 INFO CoarseGrainedExecutorBackend: Got assigned task 357
23/09/24 21:34:16 INFO Executor: Running task 56.0 in stage 3.0 (TID 357)
23/09/24 21:34:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7516192768-7650410496, partition values: [empty row]
23/09/24 21:34:16 INFO MemoryStore: Block rdd_22_40 stored as values in memory (estimated size 116.8 MiB, free 3.7 GiB)
23/09/24 21:34:16 INFO Executor: Finished task 40.0 in stage 3.0 (TID 341). 2452 bytes result sent to driver
23/09/24 21:34:16 INFO CoarseGrainedExecutorBackend: Got assigned task 358
23/09/24 21:34:16 INFO Executor: Running task 57.0 in stage 3.0 (TID 358)
23/09/24 21:34:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7650410496-7784628224, partition values: [empty row]
23/09/24 21:34:16 INFO MemoryStore: Block rdd_22_44 stored as values in memory (estimated size 86.9 MiB, free 3.6 GiB)
23/09/24 21:34:16 INFO MemoryStore: Block rdd_22_42 stored as values in memory (estimated size 116.7 MiB, free 3.5 GiB)
23/09/24 21:34:16 INFO Executor: Finished task 44.0 in stage 3.0 (TID 345). 2452 bytes result sent to driver
23/09/24 21:34:16 INFO CoarseGrainedExecutorBackend: Got assigned task 359
23/09/24 21:34:16 INFO Executor: Finished task 42.0 in stage 3.0 (TID 343). 2452 bytes result sent to driver
23/09/24 21:34:16 INFO Executor: Running task 58.0 in stage 3.0 (TID 359)
23/09/24 21:34:16 INFO CoarseGrainedExecutorBackend: Got assigned task 360
23/09/24 21:34:16 INFO Executor: Running task 59.0 in stage 3.0 (TID 360)
23/09/24 21:34:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7918845952-8053063680, partition values: [empty row]
23/09/24 21:34:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7784628224-7918845952, partition values: [empty row]
23/09/24 21:34:20 INFO MemoryStore: Block rdd_22_55 stored as values in memory (estimated size 113.7 MiB, free 3.4 GiB)
23/09/24 21:34:20 INFO Executor: Finished task 55.0 in stage 3.0 (TID 356). 2452 bytes result sent to driver
23/09/24 21:34:20 INFO CoarseGrainedExecutorBackend: Got assigned task 371
23/09/24 21:34:20 INFO Executor: Running task 70.0 in stage 3.0 (TID 371)
23/09/24 21:34:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9395240960-9529458688, partition values: [empty row]
23/09/24 21:34:20 INFO MemoryStore: Block rdd_22_58 stored as values in memory (estimated size 116.8 MiB, free 3.3 GiB)
23/09/24 21:34:20 INFO Executor: Finished task 58.0 in stage 3.0 (TID 359). 2452 bytes result sent to driver
23/09/24 21:34:21 INFO CoarseGrainedExecutorBackend: Got assigned task 372
23/09/24 21:34:21 INFO Executor: Running task 71.0 in stage 3.0 (TID 372)
23/09/24 21:34:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9529458688-9663676416, partition values: [empty row]
23/09/24 21:34:21 INFO MemoryStore: Block rdd_22_59 stored as values in memory (estimated size 116.9 MiB, free 3.2 GiB)
23/09/24 21:34:21 INFO Executor: Finished task 59.0 in stage 3.0 (TID 360). 2452 bytes result sent to driver
23/09/24 21:34:21 INFO CoarseGrainedExecutorBackend: Got assigned task 373
23/09/24 21:34:21 INFO Executor: Running task 72.0 in stage 3.0 (TID 373)
23/09/24 21:34:21 INFO MemoryStore: Block rdd_22_57 stored as values in memory (estimated size 116.8 MiB, free 3.1 GiB)
23/09/24 21:34:21 INFO Executor: Finished task 57.0 in stage 3.0 (TID 358). 2452 bytes result sent to driver
23/09/24 21:34:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9663676416-9797894144, partition values: [empty row]
23/09/24 21:34:21 INFO CoarseGrainedExecutorBackend: Got assigned task 374
23/09/24 21:34:21 INFO Executor: Running task 73.0 in stage 3.0 (TID 374)
23/09/24 21:34:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9797894144-9932111872, partition values: [empty row]
23/09/24 21:34:21 INFO MemoryStore: Block rdd_22_56 stored as values in memory (estimated size 115.2 MiB, free 2.9 GiB)
23/09/24 21:34:21 INFO Executor: Finished task 56.0 in stage 3.0 (TID 357). 2452 bytes result sent to driver
23/09/24 21:34:21 INFO CoarseGrainedExecutorBackend: Got assigned task 375
23/09/24 21:34:21 INFO Executor: Running task 74.0 in stage 3.0 (TID 375)
23/09/24 21:34:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9932111872-10066329600, partition values: [empty row]
23/09/24 21:34:24 INFO MemoryStore: Block rdd_22_70 stored as values in memory (estimated size 116.7 MiB, free 2.8 GiB)
23/09/24 21:34:24 INFO Executor: Finished task 70.0 in stage 3.0 (TID 371). 2452 bytes result sent to driver
23/09/24 21:34:24 INFO CoarseGrainedExecutorBackend: Got assigned task 385
23/09/24 21:34:24 INFO Executor: Running task 84.0 in stage 3.0 (TID 385)
23/09/24 21:34:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11274289152-11408506880, partition values: [empty row]
23/09/24 21:34:24 INFO MemoryStore: Block rdd_22_71 stored as values in memory (estimated size 116.7 MiB, free 2.7 GiB)
23/09/24 21:34:24 INFO Executor: Finished task 71.0 in stage 3.0 (TID 372). 2452 bytes result sent to driver
23/09/24 21:34:24 INFO CoarseGrainedExecutorBackend: Got assigned task 387
23/09/24 21:34:24 INFO MemoryStore: Block rdd_22_73 stored as values in memory (estimated size 116.7 MiB, free 2.6 GiB)
23/09/24 21:34:24 INFO Executor: Running task 86.0 in stage 3.0 (TID 387)
23/09/24 21:34:24 INFO Executor: Finished task 73.0 in stage 3.0 (TID 374). 2452 bytes result sent to driver
23/09/24 21:34:24 INFO CoarseGrainedExecutorBackend: Got assigned task 388
23/09/24 21:34:24 INFO Executor: Running task 87.0 in stage 3.0 (TID 388)
23/09/24 21:34:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11542724608-11676942336, partition values: [empty row]
23/09/24 21:34:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11676942336-11811160064, partition values: [empty row]
23/09/24 21:34:24 INFO MemoryStore: Block rdd_22_72 stored as values in memory (estimated size 116.9 MiB, free 2.5 GiB)
23/09/24 21:34:24 INFO Executor: Finished task 72.0 in stage 3.0 (TID 373). 2452 bytes result sent to driver
23/09/24 21:34:24 INFO CoarseGrainedExecutorBackend: Got assigned task 389
23/09/24 21:34:24 INFO Executor: Running task 88.0 in stage 3.0 (TID 389)
23/09/24 21:34:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11811160064-11945377792, partition values: [empty row]
23/09/24 21:34:24 INFO MemoryStore: Block rdd_22_74 stored as values in memory (estimated size 116.7 MiB, free 2.4 GiB)
23/09/24 21:34:24 INFO Executor: Finished task 74.0 in stage 3.0 (TID 375). 2452 bytes result sent to driver
23/09/24 21:34:24 INFO CoarseGrainedExecutorBackend: Got assigned task 390
23/09/24 21:34:24 INFO Executor: Running task 89.0 in stage 3.0 (TID 390)
23/09/24 21:34:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11945377792-12079595520, partition values: [empty row]
23/09/24 21:34:28 INFO MemoryStore: Block rdd_22_84 stored as values in memory (estimated size 116.7 MiB, free 2.3 GiB)
23/09/24 21:34:28 INFO Executor: Finished task 84.0 in stage 3.0 (TID 385). 2452 bytes result sent to driver
23/09/24 21:34:28 INFO CoarseGrainedExecutorBackend: Got assigned task 400
23/09/24 21:34:28 INFO Executor: Running task 99.0 in stage 3.0 (TID 400)
23/09/24 21:34:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13287555072-13421772800, partition values: [empty row]
23/09/24 21:34:28 INFO MemoryStore: Block rdd_22_86 stored as values in memory (estimated size 116.9 MiB, free 2.2 GiB)
23/09/24 21:34:28 INFO Executor: Finished task 86.0 in stage 3.0 (TID 387). 2452 bytes result sent to driver
23/09/24 21:34:28 INFO CoarseGrainedExecutorBackend: Got assigned task 402
23/09/24 21:34:28 INFO Executor: Running task 101.0 in stage 3.0 (TID 402)
23/09/24 21:34:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13555990528-13690208256, partition values: [empty row]
23/09/24 21:34:28 INFO MemoryStore: Block rdd_22_87 stored as values in memory (estimated size 116.9 MiB, free 2.0 GiB)
23/09/24 21:34:28 INFO Executor: Finished task 87.0 in stage 3.0 (TID 388). 2452 bytes result sent to driver
23/09/24 21:34:28 INFO CoarseGrainedExecutorBackend: Got assigned task 403
23/09/24 21:34:28 INFO Executor: Running task 102.0 in stage 3.0 (TID 403)
23/09/24 21:34:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13690208256-13824425984, partition values: [empty row]
23/09/24 21:34:28 INFO MemoryStore: Block rdd_22_89 stored as values in memory (estimated size 116.9 MiB, free 1968.2 MiB)
23/09/24 21:34:28 INFO Executor: Finished task 89.0 in stage 3.0 (TID 390). 2452 bytes result sent to driver
23/09/24 21:34:28 INFO CoarseGrainedExecutorBackend: Got assigned task 404
23/09/24 21:34:28 INFO Executor: Running task 103.0 in stage 3.0 (TID 404)
23/09/24 21:34:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13824425984-13958643712, partition values: [empty row]
23/09/24 21:34:29 INFO MemoryStore: Block rdd_22_88 stored as values in memory (estimated size 116.9 MiB, free 1851.3 MiB)
23/09/24 21:34:29 INFO Executor: Finished task 88.0 in stage 3.0 (TID 389). 2452 bytes result sent to driver
23/09/24 21:34:29 INFO CoarseGrainedExecutorBackend: Got assigned task 405
23/09/24 21:34:29 INFO Executor: Running task 104.0 in stage 3.0 (TID 405)
23/09/24 21:34:29 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13958643712-14092861440, partition values: [empty row]
23/09/24 21:34:32 INFO MemoryStore: Block rdd_22_99 stored as values in memory (estimated size 116.8 MiB, free 1734.4 MiB)
23/09/24 21:34:32 INFO Executor: Finished task 99.0 in stage 3.0 (TID 400). 2452 bytes result sent to driver
23/09/24 21:34:32 INFO CoarseGrainedExecutorBackend: Got assigned task 416
23/09/24 21:34:32 INFO Executor: Running task 115.0 in stage 3.0 (TID 416)
23/09/24 21:34:32 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15435038720-15569256448, partition values: [empty row]
23/09/24 21:34:32 INFO MemoryStore: Block rdd_22_102 stored as values in memory (estimated size 116.6 MiB, free 1617.8 MiB)
23/09/24 21:34:32 INFO Executor: Finished task 102.0 in stage 3.0 (TID 403). 2452 bytes result sent to driver
23/09/24 21:34:32 INFO CoarseGrainedExecutorBackend: Got assigned task 417
23/09/24 21:34:32 INFO Executor: Running task 116.0 in stage 3.0 (TID 417)
23/09/24 21:34:32 INFO MemoryStore: Block rdd_22_101 stored as values in memory (estimated size 116.8 MiB, free 1501.0 MiB)
23/09/24 21:34:32 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15569256448-15703474176, partition values: [empty row]
23/09/24 21:34:32 INFO Executor: Finished task 101.0 in stage 3.0 (TID 402). 2452 bytes result sent to driver
23/09/24 21:34:32 INFO CoarseGrainedExecutorBackend: Got assigned task 418
23/09/24 21:34:32 INFO Executor: Running task 117.0 in stage 3.0 (TID 418)
23/09/24 21:34:32 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15703474176-15837691904, partition values: [empty row]
23/09/24 21:34:32 INFO MemoryStore: Block rdd_22_103 stored as values in memory (estimated size 116.9 MiB, free 1384.1 MiB)
23/09/24 21:34:32 INFO Executor: Finished task 103.0 in stage 3.0 (TID 404). 2452 bytes result sent to driver
23/09/24 21:34:32 INFO CoarseGrainedExecutorBackend: Got assigned task 419
23/09/24 21:34:32 INFO Executor: Running task 118.0 in stage 3.0 (TID 419)
23/09/24 21:34:32 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15837691904-15971909632, partition values: [empty row]
23/09/24 21:34:33 INFO MemoryStore: Block rdd_22_104 stored as values in memory (estimated size 116.9 MiB, free 1267.2 MiB)
23/09/24 21:34:33 INFO Executor: Finished task 104.0 in stage 3.0 (TID 405). 2452 bytes result sent to driver
23/09/24 21:34:33 INFO CoarseGrainedExecutorBackend: Got assigned task 420
23/09/24 21:34:33 INFO Executor: Running task 119.0 in stage 3.0 (TID 420)
23/09/24 21:34:33 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15971909632-16106127360, partition values: [empty row]
23/09/24 21:34:36 INFO MemoryStore: Block rdd_22_115 stored as values in memory (estimated size 116.9 MiB, free 1150.3 MiB)
23/09/24 21:34:36 INFO Executor: Finished task 115.0 in stage 3.0 (TID 416). 2452 bytes result sent to driver
23/09/24 21:34:36 INFO CoarseGrainedExecutorBackend: Got assigned task 430
23/09/24 21:34:36 INFO Executor: Running task 129.0 in stage 3.0 (TID 430)
23/09/24 21:34:36 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17314086912-17448304640, partition values: [empty row]
23/09/24 21:34:36 INFO MemoryStore: Block rdd_22_116 stored as values in memory (estimated size 116.9 MiB, free 1033.3 MiB)
23/09/24 21:34:36 INFO MemoryStore: Block rdd_22_118 stored as values in memory (estimated size 116.9 MiB, free 916.4 MiB)
23/09/24 21:34:36 INFO Executor: Finished task 116.0 in stage 3.0 (TID 417). 2452 bytes result sent to driver
23/09/24 21:34:36 INFO CoarseGrainedExecutorBackend: Got assigned task 432
23/09/24 21:34:36 INFO Executor: Running task 131.0 in stage 3.0 (TID 432)
23/09/24 21:34:36 INFO Executor: Finished task 118.0 in stage 3.0 (TID 419). 2452 bytes result sent to driver
23/09/24 21:34:36 INFO CoarseGrainedExecutorBackend: Got assigned task 433
23/09/24 21:34:36 INFO Executor: Running task 132.0 in stage 3.0 (TID 433)
23/09/24 21:34:36 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17582522368-17716740096, partition values: [empty row]
23/09/24 21:34:36 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17716740096-17850957824, partition values: [empty row]
23/09/24 21:34:36 INFO MemoryStore: Block rdd_22_117 stored as values in memory (estimated size 116.9 MiB, free 799.5 MiB)
23/09/24 21:34:36 INFO Executor: Finished task 117.0 in stage 3.0 (TID 418). 2452 bytes result sent to driver
23/09/24 21:34:36 INFO CoarseGrainedExecutorBackend: Got assigned task 434
23/09/24 21:34:36 INFO Executor: Running task 133.0 in stage 3.0 (TID 434)
23/09/24 21:34:36 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17850957824-17985175552, partition values: [empty row]
23/09/24 21:34:37 INFO MemoryStore: Block rdd_22_119 stored as values in memory (estimated size 116.9 MiB, free 682.6 MiB)
23/09/24 21:34:37 INFO Executor: Finished task 119.0 in stage 3.0 (TID 420). 2452 bytes result sent to driver
23/09/24 21:34:37 INFO CoarseGrainedExecutorBackend: Got assigned task 435
23/09/24 21:34:37 INFO Executor: Running task 134.0 in stage 3.0 (TID 435)
23/09/24 21:34:37 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17985175552-18119393280, partition values: [empty row]
23/09/24 21:34:40 INFO MemoryStore: Block rdd_22_129 stored as values in memory (estimated size 116.9 MiB, free 565.6 MiB)
23/09/24 21:34:40 INFO Executor: Finished task 129.0 in stage 3.0 (TID 430). 2452 bytes result sent to driver
23/09/24 21:34:40 INFO CoarseGrainedExecutorBackend: Got assigned task 446
23/09/24 21:34:40 INFO Executor: Running task 145.0 in stage 3.0 (TID 446)
23/09/24 21:34:40 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19461570560-19595788288, partition values: [empty row]
23/09/24 21:34:41 INFO MemoryStore: Block rdd_22_131 stored as values in memory (estimated size 116.9 MiB, free 448.7 MiB)
23/09/24 21:34:41 INFO Executor: Finished task 131.0 in stage 3.0 (TID 432). 2452 bytes result sent to driver
23/09/24 21:34:41 INFO CoarseGrainedExecutorBackend: Got assigned task 447
23/09/24 21:34:41 INFO Executor: Running task 146.0 in stage 3.0 (TID 447)
23/09/24 21:34:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19595788288-19730006016, partition values: [empty row]
23/09/24 21:34:41 INFO MemoryStore: Block rdd_22_132 stored as values in memory (estimated size 116.9 MiB, free 331.7 MiB)
23/09/24 21:34:41 INFO Executor: Finished task 132.0 in stage 3.0 (TID 433). 2452 bytes result sent to driver
23/09/24 21:34:41 INFO CoarseGrainedExecutorBackend: Got assigned task 448
23/09/24 21:34:41 INFO Executor: Running task 147.0 in stage 3.0 (TID 448)
23/09/24 21:34:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19730006016-19864223744, partition values: [empty row]
23/09/24 21:34:41 INFO MemoryStore: Block rdd_22_133 stored as values in memory (estimated size 116.9 MiB, free 214.8 MiB)
23/09/24 21:34:41 INFO Executor: Finished task 133.0 in stage 3.0 (TID 434). 2452 bytes result sent to driver
23/09/24 21:34:41 INFO CoarseGrainedExecutorBackend: Got assigned task 449
23/09/24 21:34:41 INFO Executor: Running task 148.0 in stage 3.0 (TID 449)
23/09/24 21:34:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19864223744-19998441472, partition values: [empty row]
23/09/24 21:34:41 INFO MemoryStore: Block rdd_22_134 stored as values in memory (estimated size 117.0 MiB, free 97.9 MiB)
23/09/24 21:34:41 INFO Executor: Finished task 134.0 in stage 3.0 (TID 435). 2452 bytes result sent to driver
23/09/24 21:34:41 INFO CoarseGrainedExecutorBackend: Got assigned task 450
23/09/24 21:34:41 INFO Executor: Running task 149.0 in stage 3.0 (TID 450)
23/09/24 21:34:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19998441472-20012106932, partition values: [empty row]
23/09/24 21:34:42 INFO MemoryStore: Block rdd_22_149 stored as values in memory (estimated size 8.9 MiB, free 89.0 MiB)
23/09/24 21:34:42 INFO Executor: Finished task 149.0 in stage 3.0 (TID 450). 2409 bytes result sent to driver
23/09/24 21:34:42 INFO CoarseGrainedExecutorBackend: Got assigned task 451
23/09/24 21:34:42 INFO Executor: Running task 139.1 in stage 3.0 (TID 451)
23/09/24 21:34:42 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18656264192-18790481920, partition values: [empty row]
23/09/24 21:34:43 INFO MemoryStore: Will not store rdd_22_145
23/09/24 21:34:43 WARN MemoryStore: Not enough space to cache rdd_22_145 in memory! (computed 64.6 MiB so far)
23/09/24 21:34:43 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.5 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:43 WARN BlockManager: Block rdd_22_145 could not be removed as it was not found on disk or in memory
23/09/24 21:34:43 WARN BlockManager: Putting block rdd_22_145 failed
23/09/24 21:34:43 INFO MemoryStore: Will not store rdd_22_146
23/09/24 21:34:43 WARN MemoryStore: Not enough space to cache rdd_22_146 in memory! (computed 64.6 MiB so far)
23/09/24 21:34:43 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.8 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:43 WARN BlockManager: Block rdd_22_146 could not be removed as it was not found on disk or in memory
23/09/24 21:34:43 WARN BlockManager: Putting block rdd_22_146 failed
23/09/24 21:34:43 INFO MemoryStore: Will not store rdd_22_147
23/09/24 21:34:43 WARN MemoryStore: Not enough space to cache rdd_22_147 in memory! (computed 64.6 MiB so far)
23/09/24 21:34:43 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.1 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:43 WARN BlockManager: Block rdd_22_147 could not be removed as it was not found on disk or in memory
23/09/24 21:34:43 WARN BlockManager: Putting block rdd_22_147 failed
23/09/24 21:34:43 INFO MemoryStore: Will not store rdd_22_148
23/09/24 21:34:43 WARN MemoryStore: Not enough space to cache rdd_22_148 in memory! (computed 64.6 MiB so far)
23/09/24 21:34:43 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.4 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:43 WARN BlockManager: Block rdd_22_148 could not be removed as it was not found on disk or in memory
23/09/24 21:34:43 WARN BlockManager: Putting block rdd_22_148 failed
23/09/24 21:34:44 INFO MemoryStore: Will not store rdd_22_139
23/09/24 21:34:44 WARN MemoryStore: Not enough space to cache rdd_22_139 in memory! (computed 64.9 MiB so far)
23/09/24 21:34:44 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:44 WARN BlockManager: Block rdd_22_139 could not be removed as it was not found on disk or in memory
23/09/24 21:34:44 WARN BlockManager: Putting block rdd_22_139 failed
23/09/24 21:34:44 INFO Executor: Finished task 147.0 in stage 3.0 (TID 448). 2452 bytes result sent to driver
23/09/24 21:34:44 INFO CoarseGrainedExecutorBackend: Got assigned task 455
23/09/24 21:34:44 INFO Executor: Running task 135.1 in stage 3.0 (TID 455)
23/09/24 21:34:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18119393280-18253611008, partition values: [empty row]
23/09/24 21:34:44 INFO Executor: Finished task 148.0 in stage 3.0 (TID 449). 2452 bytes result sent to driver
23/09/24 21:34:44 INFO CoarseGrainedExecutorBackend: Got assigned task 456
23/09/24 21:34:44 INFO Executor: Running task 4.1 in stage 3.0 (TID 456)
23/09/24 21:34:44 INFO Executor: Finished task 146.0 in stage 3.0 (TID 447). 2452 bytes result sent to driver
23/09/24 21:34:44 INFO CoarseGrainedExecutorBackend: Got assigned task 457
23/09/24 21:34:44 INFO Executor: Running task 13.1 in stage 3.0 (TID 457)
23/09/24 21:34:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 536870912-671088640, partition values: [empty row]
23/09/24 21:34:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1744830464-1879048192, partition values: [empty row]
23/09/24 21:34:44 INFO Executor: Finished task 145.0 in stage 3.0 (TID 446). 2452 bytes result sent to driver
23/09/24 21:34:44 INFO CoarseGrainedExecutorBackend: Got assigned task 460
23/09/24 21:34:44 INFO Executor: Running task 1.1 in stage 3.0 (TID 460)
23/09/24 21:34:44 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 134217728-268435456, partition values: [empty row]
23/09/24 21:34:45 INFO Executor: Finished task 139.1 in stage 3.0 (TID 451). 2452 bytes result sent to driver
23/09/24 21:34:45 INFO CoarseGrainedExecutorBackend: Got assigned task 466
23/09/24 21:34:45 INFO Executor: Running task 34.1 in stage 3.0 (TID 466)
23/09/24 21:34:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4563402752-4697620480, partition values: [empty row]
23/09/24 21:34:46 INFO MemoryStore: Will not store rdd_22_135
23/09/24 21:34:46 WARN MemoryStore: Not enough space to cache rdd_22_135 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:46 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.7 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:46 WARN BlockManager: Block rdd_22_135 could not be removed as it was not found on disk or in memory
23/09/24 21:34:46 WARN BlockManager: Putting block rdd_22_135 failed
23/09/24 21:34:46 INFO MemoryStore: Will not store rdd_22_4
23/09/24 21:34:46 WARN MemoryStore: Not enough space to cache rdd_22_4 in memory! (computed 65.1 MiB so far)
23/09/24 21:34:46 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 23.0 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:46 WARN BlockManager: Block rdd_22_4 could not be removed as it was not found on disk or in memory
23/09/24 21:34:46 WARN BlockManager: Putting block rdd_22_4 failed
23/09/24 21:34:46 INFO MemoryStore: Will not store rdd_22_13
23/09/24 21:34:46 WARN MemoryStore: Not enough space to cache rdd_22_13 in memory! (computed 65.1 MiB so far)
23/09/24 21:34:46 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:46 WARN BlockManager: Block rdd_22_13 could not be removed as it was not found on disk or in memory
23/09/24 21:34:46 WARN BlockManager: Putting block rdd_22_13 failed
23/09/24 21:34:46 INFO MemoryStore: Will not store rdd_22_1
23/09/24 21:34:46 WARN MemoryStore: Not enough space to cache rdd_22_1 in memory! (computed 65.3 MiB so far)
23/09/24 21:34:46 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.5 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:46 WARN BlockManager: Block rdd_22_1 could not be removed as it was not found on disk or in memory
23/09/24 21:34:46 WARN BlockManager: Putting block rdd_22_1 failed
23/09/24 21:34:47 INFO Executor: Finished task 4.1 in stage 3.0 (TID 456). 2452 bytes result sent to driver
23/09/24 21:34:47 INFO CoarseGrainedExecutorBackend: Got assigned task 471
23/09/24 21:34:47 INFO Executor: Running task 76.1 in stage 3.0 (TID 471)
23/09/24 21:34:47 INFO Executor: Finished task 135.1 in stage 3.0 (TID 455). 2452 bytes result sent to driver
23/09/24 21:34:47 INFO CoarseGrainedExecutorBackend: Got assigned task 472
23/09/24 21:34:47 INFO Executor: Running task 121.1 in stage 3.0 (TID 472)
23/09/24 21:34:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10200547328-10334765056, partition values: [empty row]
23/09/24 21:34:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16240345088-16374562816, partition values: [empty row]
23/09/24 21:34:48 INFO MemoryStore: Will not store rdd_22_34
23/09/24 21:34:48 WARN MemoryStore: Not enough space to cache rdd_22_34 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:48 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 7.7 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:48 WARN BlockManager: Block rdd_22_34 could not be removed as it was not found on disk or in memory
23/09/24 21:34:48 WARN BlockManager: Putting block rdd_22_34 failed
23/09/24 21:34:48 INFO Executor: Finished task 13.1 in stage 3.0 (TID 457). 2452 bytes result sent to driver
23/09/24 21:34:48 INFO CoarseGrainedExecutorBackend: Got assigned task 474
23/09/24 21:34:48 INFO Executor: Running task 109.1 in stage 3.0 (TID 474)
23/09/24 21:34:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14629732352-14763950080, partition values: [empty row]
23/09/24 21:34:48 INFO Executor: Finished task 1.1 in stage 3.0 (TID 460). 2452 bytes result sent to driver
23/09/24 21:34:48 INFO CoarseGrainedExecutorBackend: Got assigned task 475
23/09/24 21:34:48 INFO Executor: Running task 91.1 in stage 3.0 (TID 475)
23/09/24 21:34:48 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12213813248-12348030976, partition values: [empty row]
23/09/24 21:34:49 INFO Executor: Finished task 34.1 in stage 3.0 (TID 466). 2452 bytes result sent to driver
23/09/24 21:34:49 INFO CoarseGrainedExecutorBackend: Got assigned task 476
23/09/24 21:34:49 INFO Executor: Running task 23.1 in stage 3.0 (TID 476)
23/09/24 21:34:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3087007744-3221225472, partition values: [empty row]
23/09/24 21:34:49 INFO MemoryStore: Will not store rdd_22_121
23/09/24 21:34:49 WARN MemoryStore: Not enough space to cache rdd_22_121 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:49 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.7 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:49 WARN BlockManager: Block rdd_22_121 could not be removed as it was not found on disk or in memory
23/09/24 21:34:49 WARN BlockManager: Putting block rdd_22_121 failed
23/09/24 21:34:49 INFO MemoryStore: Will not store rdd_22_76
23/09/24 21:34:49 WARN MemoryStore: Not enough space to cache rdd_22_76 in memory! (computed 64.9 MiB so far)
23/09/24 21:34:49 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:49 WARN BlockManager: Block rdd_22_76 could not be removed as it was not found on disk or in memory
23/09/24 21:34:49 WARN BlockManager: Putting block rdd_22_76 failed
23/09/24 21:34:50 INFO MemoryStore: Will not store rdd_22_109
23/09/24 21:34:50 WARN MemoryStore: Not enough space to cache rdd_22_109 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:50 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:50 WARN BlockManager: Block rdd_22_109 could not be removed as it was not found on disk or in memory
23/09/24 21:34:50 WARN BlockManager: Putting block rdd_22_109 failed
23/09/24 21:34:50 INFO MemoryStore: Will not store rdd_22_91
23/09/24 21:34:50 WARN MemoryStore: Not enough space to cache rdd_22_91 in memory! (computed 64.9 MiB so far)
23/09/24 21:34:50 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.5 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:50 WARN BlockManager: Block rdd_22_91 could not be removed as it was not found on disk or in memory
23/09/24 21:34:50 WARN BlockManager: Putting block rdd_22_91 failed
23/09/24 21:34:51 INFO Executor: Finished task 121.1 in stage 3.0 (TID 472). 2452 bytes result sent to driver
23/09/24 21:34:51 INFO CoarseGrainedExecutorBackend: Got assigned task 480
23/09/24 21:34:51 INFO Executor: Running task 62.1 in stage 3.0 (TID 480)
23/09/24 21:34:51 INFO MemoryStore: Will not store rdd_22_23
23/09/24 21:34:51 WARN MemoryStore: Not enough space to cache rdd_22_23 in memory! (computed 65.2 MiB so far)
23/09/24 21:34:51 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.8 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:51 WARN BlockManager: Block rdd_22_23 could not be removed as it was not found on disk or in memory
23/09/24 21:34:51 WARN BlockManager: Putting block rdd_22_23 failed
23/09/24 21:34:51 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8321499136-8455716864, partition values: [empty row]
23/09/24 21:34:51 INFO Executor: Finished task 76.1 in stage 3.0 (TID 471). 2452 bytes result sent to driver
23/09/24 21:34:51 INFO CoarseGrainedExecutorBackend: Got assigned task 481
23/09/24 21:34:51 INFO Executor: Running task 107.1 in stage 3.0 (TID 481)
23/09/24 21:34:51 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14361296896-14495514624, partition values: [empty row]
23/09/24 21:34:51 INFO Executor: Finished task 91.1 in stage 3.0 (TID 475). 2452 bytes result sent to driver
23/09/24 21:34:51 INFO CoarseGrainedExecutorBackend: Got assigned task 484
23/09/24 21:34:51 INFO Executor: Running task 27.1 in stage 3.0 (TID 484)
23/09/24 21:34:51 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3623878656-3758096384, partition values: [empty row]
23/09/24 21:34:51 INFO Executor: Finished task 109.1 in stage 3.0 (TID 474). 2452 bytes result sent to driver
23/09/24 21:34:51 INFO CoarseGrainedExecutorBackend: Got assigned task 485
23/09/24 21:34:51 INFO Executor: Running task 60.1 in stage 3.0 (TID 485)
23/09/24 21:34:51 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8053063680-8187281408, partition values: [empty row]
23/09/24 21:34:53 INFO Executor: Finished task 23.1 in stage 3.0 (TID 476). 2452 bytes result sent to driver
23/09/24 21:34:53 INFO CoarseGrainedExecutorBackend: Got assigned task 486
23/09/24 21:34:53 INFO Executor: Running task 33.1 in stage 3.0 (TID 486)
23/09/24 21:34:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4429185024-4563402752, partition values: [empty row]
23/09/24 21:34:53 INFO MemoryStore: Will not store rdd_22_62
23/09/24 21:34:53 WARN MemoryStore: Not enough space to cache rdd_22_62 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:53 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.8 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:53 WARN BlockManager: Block rdd_22_62 could not be removed as it was not found on disk or in memory
23/09/24 21:34:53 WARN BlockManager: Putting block rdd_22_62 failed
23/09/24 21:34:53 INFO MemoryStore: Will not store rdd_22_107
23/09/24 21:34:53 WARN MemoryStore: Not enough space to cache rdd_22_107 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:53 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 23.1 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:53 WARN BlockManager: Block rdd_22_107 could not be removed as it was not found on disk or in memory
23/09/24 21:34:53 WARN BlockManager: Putting block rdd_22_107 failed
23/09/24 21:34:53 INFO MemoryStore: Will not store rdd_22_60
23/09/24 21:34:53 WARN MemoryStore: Not enough space to cache rdd_22_60 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:53 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.3 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:53 WARN BlockManager: Block rdd_22_60 could not be removed as it was not found on disk or in memory
23/09/24 21:34:53 WARN BlockManager: Putting block rdd_22_60 failed
23/09/24 21:34:53 INFO MemoryStore: Will not store rdd_22_27
23/09/24 21:34:53 WARN MemoryStore: Not enough space to cache rdd_22_27 in memory! (computed 65.1 MiB so far)
23/09/24 21:34:53 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.6 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:53 WARN BlockManager: Block rdd_22_27 could not be removed as it was not found on disk or in memory
23/09/24 21:34:53 WARN BlockManager: Putting block rdd_22_27 failed
23/09/24 21:34:54 INFO Executor: Finished task 62.1 in stage 3.0 (TID 480). 2452 bytes result sent to driver
23/09/24 21:34:54 INFO CoarseGrainedExecutorBackend: Got assigned task 494
23/09/24 21:34:54 INFO Executor: Running task 93.1 in stage 3.0 (TID 494)
23/09/24 21:34:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12482248704-12616466432, partition values: [empty row]
23/09/24 21:34:55 INFO MemoryStore: Will not store rdd_22_33
23/09/24 21:34:55 WARN MemoryStore: Not enough space to cache rdd_22_33 in memory! (computed 65.0 MiB so far)
23/09/24 21:34:55 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 6.7 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:55 WARN BlockManager: Block rdd_22_33 could not be removed as it was not found on disk or in memory
23/09/24 21:34:55 WARN BlockManager: Putting block rdd_22_33 failed
23/09/24 21:34:55 INFO Executor: Finished task 107.1 in stage 3.0 (TID 481). 2452 bytes result sent to driver
23/09/24 21:34:55 INFO CoarseGrainedExecutorBackend: Got assigned task 497
23/09/24 21:34:55 INFO Executor: Running task 108.1 in stage 3.0 (TID 497)
23/09/24 21:34:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14495514624-14629732352, partition values: [empty row]
23/09/24 21:34:55 INFO Executor: Finished task 60.1 in stage 3.0 (TID 485). 2452 bytes result sent to driver
23/09/24 21:34:55 INFO CoarseGrainedExecutorBackend: Got assigned task 499
23/09/24 21:34:55 INFO Executor: Running task 105.1 in stage 3.0 (TID 499)
23/09/24 21:34:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14092861440-14227079168, partition values: [empty row]
23/09/24 21:34:55 INFO Executor: Finished task 27.1 in stage 3.0 (TID 484). 2452 bytes result sent to driver
23/09/24 21:34:55 INFO CoarseGrainedExecutorBackend: Got assigned task 500
23/09/24 21:34:55 INFO Executor: Running task 123.1 in stage 3.0 (TID 500)
23/09/24 21:34:55 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16508780544-16642998272, partition values: [empty row]
23/09/24 21:34:56 INFO Executor: Finished task 33.1 in stage 3.0 (TID 486). 2452 bytes result sent to driver
23/09/24 21:34:57 INFO MemoryStore: Will not store rdd_22_93
23/09/24 21:34:57 WARN MemoryStore: Not enough space to cache rdd_22_93 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:57 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:57 WARN BlockManager: Block rdd_22_93 could not be removed as it was not found on disk or in memory
23/09/24 21:34:57 WARN BlockManager: Putting block rdd_22_93 failed
23/09/24 21:34:57 INFO MemoryStore: Will not store rdd_22_108
23/09/24 21:34:57 WARN MemoryStore: Not enough space to cache rdd_22_108 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:57 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.1 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:57 WARN BlockManager: Block rdd_22_108 could not be removed as it was not found on disk or in memory
23/09/24 21:34:57 WARN BlockManager: Putting block rdd_22_108 failed
23/09/24 21:34:57 INFO MemoryStore: Will not store rdd_22_105
23/09/24 21:34:57 WARN MemoryStore: Not enough space to cache rdd_22_105 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:57 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.4 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:57 WARN BlockManager: Block rdd_22_105 could not be removed as it was not found on disk or in memory
23/09/24 21:34:57 WARN BlockManager: Putting block rdd_22_105 failed
23/09/24 21:34:57 INFO MemoryStore: Will not store rdd_22_123
23/09/24 21:34:57 WARN MemoryStore: Not enough space to cache rdd_22_123 in memory! (computed 64.8 MiB so far)
23/09/24 21:34:57 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:34:57 WARN BlockManager: Block rdd_22_123 could not be removed as it was not found on disk or in memory
23/09/24 21:34:57 WARN BlockManager: Putting block rdd_22_123 failed
23/09/24 21:34:58 INFO Executor: Finished task 93.1 in stage 3.0 (TID 494). 2452 bytes result sent to driver
23/09/24 21:34:58 INFO Executor: Finished task 108.1 in stage 3.0 (TID 497). 2452 bytes result sent to driver
23/09/24 21:34:59 INFO Executor: Finished task 105.1 in stage 3.0 (TID 499). 2452 bytes result sent to driver
23/09/24 21:34:59 INFO Executor: Finished task 123.1 in stage 3.0 (TID 500). 2452 bytes result sent to driver
23/09/24 21:34:59 INFO CoarseGrainedExecutorBackend: Got assigned task 501
23/09/24 21:34:59 INFO Executor: Running task 0.0 in stage 4.0 (TID 501)
23/09/24 21:34:59 INFO MapOutputTrackerWorker: Updating epoch to 3 and clearing cache
23/09/24 21:34:59 INFO TorrentBroadcast: Started reading broadcast variable 7 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:34:59 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 5.0 KiB, free 89.0 MiB)
23/09/24 21:34:59 INFO TorrentBroadcast: Reading broadcast variable 7 took 6 ms
23/09/24 21:34:59 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 10.1 KiB, free 89.0 MiB)
23/09/24 21:34:59 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 1, fetching them
23/09/24 21:34:59 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@static.154.188.161.5.clients.your-server.de:46637)
23/09/24 21:34:59 INFO MapOutputTrackerWorker: Got the output locations
23/09/24 21:34:59 INFO ShuffleBlockFetcherIterator: Getting 150 (8.8 KiB) non-empty blocks including 70 (4.1 KiB) local and 80 (4.7 KiB) host-local and 0 (0.0 B) remote blocks
23/09/24 21:34:59 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 16 ms
23/09/24 21:34:59 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:45879 after 1 ms (0 ms spent in bootstraps)
23/09/24 21:34:59 INFO CodeGenerator: Code generated in 8.020775 ms
23/09/24 21:34:59 INFO Executor: Finished task 0.0 in stage 4.0 (TID 501). 2450 bytes result sent to driver
23/09/24 21:34:59 INFO CoarseGrainedExecutorBackend: Got assigned task 503
23/09/24 21:34:59 INFO Executor: Running task 0.0 in stage 6.0 (TID 503)
23/09/24 21:34:59 INFO TorrentBroadcast: Started reading broadcast variable 10 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:34:59 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 7.0 KiB, free 89.0 MiB)
23/09/24 21:34:59 INFO TorrentBroadcast: Reading broadcast variable 10 took 4 ms
23/09/24 21:34:59 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 14.7 KiB, free 89.0 MiB)
23/09/24 21:34:59 INFO CodeGenerator: Code generated in 9.367108 ms
23/09/24 21:34:59 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00056-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4526, partition values: [empty row]
23/09/24 21:34:59 INFO TorrentBroadcast: Started reading broadcast variable 9 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:34:59 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 25.1 KiB, free 88.9 MiB)
23/09/24 21:34:59 INFO TorrentBroadcast: Reading broadcast variable 9 took 4 ms
23/09/24 21:34:59 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 398.2 KiB, free 88.6 MiB)
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00136-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4489, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00000-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4486, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00072-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4485, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00016-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4480, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00145-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4447, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00024-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4420, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00097-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4419, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00090-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4387, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00105-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4380, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00074-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4364, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00154-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4340, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00066-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4281, partition values: [empty row]
23/09/24 21:35:00 INFO Executor: Finished task 0.0 in stage 6.0 (TID 503). 2058 bytes result sent to driver
23/09/24 21:35:00 INFO CoarseGrainedExecutorBackend: Got assigned task 508
23/09/24 21:35:00 INFO Executor: Running task 1.0 in stage 8.0 (TID 508)
23/09/24 21:35:00 INFO MapOutputTrackerWorker: Updating epoch to 4 and clearing cache
23/09/24 21:35:00 INFO TorrentBroadcast: Started reading broadcast variable 13 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:00 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 10.0 KiB, free 89.1 MiB)
23/09/24 21:35:00 INFO TorrentBroadcast: Reading broadcast variable 13 took 4 ms
23/09/24 21:35:00 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 29.8 KiB, free 89.1 MiB)
23/09/24 21:35:00 INFO CodeGenerator: Code generated in 16.456936 ms
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00049-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4280, partition values: [empty row]
23/09/24 21:35:00 INFO TorrentBroadcast: Started reading broadcast variable 12 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:00 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 25.8 KiB, free 89.1 MiB)
23/09/24 21:35:00 INFO TorrentBroadcast: Reading broadcast variable 12 took 5 ms
23/09/24 21:35:00 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 398.2 KiB, free 88.7 MiB)
23/09/24 21:35:00 INFO CodecPool: Got brand-new decompressor [.snappy]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00019-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4211, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00131-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4138, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00043-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4128, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00035-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4116, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00123-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4104, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00027-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4103, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00092-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4099, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00012-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4098, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00085-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4098, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00052-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4095, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00116-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4090, partition values: [empty row]
23/09/24 21:35:00 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00032-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4080, partition values: [empty row]
23/09/24 21:35:00 INFO MemoryStore: Block rdd_44_1 stored as values in memory (estimated size 5.9 KiB, free 88.7 MiB)
23/09/24 21:35:00 INFO CodeGenerator: Code generated in 5.08014 ms
23/09/24 21:35:00 INFO CodeGenerator: Code generated in 14.004221 ms
23/09/24 21:35:00 INFO CodeGenerator: Code generated in 4.7416 ms
23/09/24 21:35:00 INFO Executor: Finished task 1.0 in stage 8.0 (TID 508). 2131 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 510
23/09/24 21:35:01 INFO Executor: Running task 1.0 in stage 9.0 (TID 510)
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 15 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 88.7 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 15 took 4 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 36.8 KiB, free 88.6 MiB)
23/09/24 21:35:01 INFO BlockManager: Found block rdd_44_1 locally
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 5.925737 ms
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 10.537191 ms
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 16.1941 ms
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 14 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 1669.0 B, free 88.6 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 14 took 4 ms
23/09/24 21:35:01 INFO MemoryStore: 6 blocks selected for dropping (87.9 MiB bytes)
23/09/24 21:35:01 INFO BlockManager: Dropping block broadcast_1_piece0 from memory
23/09/24 21:35:01 INFO BlockManager: Writing block broadcast_1_piece0 to disk
23/09/24 21:35:01 INFO BlockManager: Dropping block broadcast_1 from memory
23/09/24 21:35:01 INFO BlockManager: Writing block broadcast_1 to disk
23/09/24 21:35:01 INFO BlockManager: Dropping block broadcast_0 from memory
23/09/24 21:35:01 INFO BlockManager: Writing block broadcast_0 to disk
23/09/24 21:35:01 INFO BlockManager: Dropping block broadcast_0_piece0 from memory
23/09/24 21:35:01 INFO BlockManager: Writing block broadcast_0_piece0 to disk
23/09/24 21:35:01 INFO BlockManager: Dropping block broadcast_5 from memory
23/09/24 21:35:01 INFO BlockManager: Writing block broadcast_5 to disk
23/09/24 21:35:01 INFO BlockManager: Dropping block rdd_22_11 from memory
23/09/24 21:35:01 INFO MemoryStore: After dropping 6 blocks, free memory is 176.5 MiB
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 64.0 MiB, free 112.5 MiB)
23/09/24 21:35:01 INFO Executor: Finished task 1.0 in stage 9.0 (TID 510). 2435 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 513
23/09/24 21:35:01 INFO Executor: Running task 0.0 in stage 10.0 (TID 513)
23/09/24 21:35:01 INFO MapOutputTrackerWorker: Updating epoch to 5 and clearing cache
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 16 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_16_piece0 stored as bytes in memory (estimated size 5.0 KiB, free 112.5 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 16 took 3 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_16 stored as values in memory (estimated size 10.1 KiB, free 112.5 MiB)
23/09/24 21:35:01 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 3, fetching them
23/09/24 21:35:01 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@static.154.188.161.5.clients.your-server.de:46637)
23/09/24 21:35:01 INFO MapOutputTrackerWorker: Got the output locations
23/09/24 21:35:01 INFO ShuffleBlockFetcherIterator: Getting 3 (180.0 B) non-empty blocks including 1 (60.0 B) local and 2 (120.0 B) host-local and 0 (0.0 B) remote blocks
23/09/24 21:35:01 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 5.909516 ms
23/09/24 21:35:01 INFO Executor: Finished task 0.0 in stage 10.0 (TID 513). 2450 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 515
23/09/24 21:35:01 INFO Executor: Running task 1.0 in stage 11.0 (TID 515)
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 17 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 112.5 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 17 took 4 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 30.5 KiB, free 112.5 MiB)
23/09/24 21:35:01 INFO BlockManager: Found block rdd_44_1 locally
23/09/24 21:35:01 INFO Executor: Finished task 1.0 in stage 11.0 (TID 515). 2131 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 518
23/09/24 21:35:01 INFO Executor: Running task 1.0 in stage 12.0 (TID 518)
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 19 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 112.4 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 19 took 4 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_19 stored as values in memory (estimated size 36.8 KiB, free 112.4 MiB)
23/09/24 21:35:01 INFO BlockManager: Found block rdd_44_1 locally
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 5.948289 ms
23/09/24 21:35:01 INFO CodeGenerator: Code generated in 8.163185 ms
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 18 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 1669.0 B, free 112.4 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 18 took 5 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_18 stored as values in memory (estimated size 64.0 MiB, free 48.4 MiB)
23/09/24 21:35:01 INFO Executor: Finished task 1.0 in stage 12.0 (TID 518). 2435 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 521
23/09/24 21:35:01 INFO Executor: Running task 1.0 in stage 14.0 (TID 521)
23/09/24 21:35:01 INFO MapOutputTrackerWorker: Updating epoch to 6 and clearing cache
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 21 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_21_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 48.4 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 21 took 4 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_21 stored as values in memory (estimated size 30.5 KiB, free 48.4 MiB)
23/09/24 21:35:01 INFO BlockManager: Found block rdd_44_1 locally
23/09/24 21:35:01 INFO Executor: Finished task 1.0 in stage 14.0 (TID 521). 2131 bytes result sent to driver
23/09/24 21:35:01 INFO CoarseGrainedExecutorBackend: Got assigned task 526
23/09/24 21:35:01 INFO Executor: Running task 1.0 in stage 15.0 (TID 526)
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 23 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 48.4 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 23 took 3 ms
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_23 stored as values in memory (estimated size 36.8 KiB, free 48.3 MiB)
23/09/24 21:35:01 INFO BlockManager: Found block rdd_44_1 locally
23/09/24 21:35:01 INFO TorrentBroadcast: Started reading broadcast variable 22 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 1669.0 B, free 48.3 MiB)
23/09/24 21:35:01 INFO TorrentBroadcast: Reading broadcast variable 22 took 3 ms
23/09/24 21:35:01 INFO MemoryStore: 1 blocks selected for dropping (116.9 MiB bytes)
23/09/24 21:35:01 INFO BlockManager: Dropping block rdd_22_2 from memory
23/09/24 21:35:01 INFO MemoryStore: After dropping 1 blocks, free memory is 165.3 MiB
23/09/24 21:35:01 INFO MemoryStore: Block broadcast_22 stored as values in memory (estimated size 64.0 MiB, free 101.3 MiB)
23/09/24 21:35:01 INFO Executor: Finished task 1.0 in stage 15.0 (TID 526). 2435 bytes result sent to driver
23/09/24 21:35:06 INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown
23/09/24 21:35:06 ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
tdown