3.5.3 Spark Master at spark://spark-master:7077

  • URL: spark://spark-master:7077
  • Alive Workers: 5
  • Cores in use: 10 Total, 2 Used
  • Memory in use: 15.0 GiB Total, 2.0 GiB Used
  • Resources in use:
  • Applications: 1 Running, 32 Completed
  • Drivers: 0 Running, 0 Completed
  • Status: ALIVE

Workers (5)

Worker IdAddressStateCoresMemoryResources
worker-20251208231455-172.22.0.10-34617 172.22.0.10:34617 ALIVE 2 (0 Used) 3.0 GiB (0.0 B Used)
worker-20251208231455-172.22.0.7-43417 172.22.0.7:43417 ALIVE 2 (0 Used) 3.0 GiB (0.0 B Used)
worker-20251208231455-172.22.0.8-33197 172.22.0.8:33197 ALIVE 2 (0 Used) 3.0 GiB (0.0 B Used)
worker-20251208231455-172.22.0.9-44229 172.22.0.9:44229 ALIVE 2 (1 Used) 3.0 GiB (1024.0 MiB Used)
worker-20251208231456-172.22.0.6-37337 172.22.0.6:37337 ALIVE 2 (1 Used) 3.0 GiB (1024.0 MiB Used)

Running Applications (1)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration
app-20251208232946-0032
(kill)
Streaming_Kafka_to_PostgreSQL 2 1024.0 MiB 2025/12/08 23:29:46 spark RUNNING 2.9 min

Completed Applications (32)

Application IDNameCoresMemory per ExecutorResources Per ExecutorSubmitted TimeUserStateDuration
app-20251208205400-0031 Batch_Gold_to_Postgres 4 1024.0 MiB 2025/12/08 20:54:00 spark FINISHED 37 s
app-20251208205243-0030 Batch_Silver_to_Gold 4 1024.0 MiB 2025/12/08 20:52:43 spark FINISHED 1.0 min
app-20251208205103-0029 Batch_Bronze_to_Silver 4 1024.0 MiB 2025/12/08 20:51:03 spark FINISHED 1.4 min
app-20251208205054-0028 Batch_Bronze_to_Silver 4 1024.0 MiB 2025/12/08 20:50:54 spark FINISHED 1.4 min
app-20251208204948-0027 Batch_Raw_to_Bronze 4 1024.0 MiB 2025/12/08 20:49:48 spark FINISHED 50 s
app-20251208204813-0025 Batch_Raw_to_Bronze 4 1024.0 MiB 2025/12/08 20:48:13 spark FINISHED 57 s
app-20251208204824-0026 Batch_Raw_to_Bronze 4 1024.0 MiB 2025/12/08 20:48:24 spark FINISHED 46 s
app-20251208204148-0023 Streaming_Kafka_to_PostgreSQL 4 1024.0 MiB 2025/12/08 20:41:48 spark FINISHED 17 s
app-20251208204156-0024 Streaming_Realtime_Dashboard 2 1024.0 MiB 2025/12/08 20:41:56 spark FINISHED 6 s
app-20251208204033-0022 Streaming_Kafka_to_PostgreSQL 10 2.0 GiB 2025/12/08 20:40:33 spark FINISHED 15 s
app-20251208203744-0021 Batch_Gold_to_Postgres 6 2.0 GiB 2025/12/08 20:37:44 spark FINISHED 2.7 min
app-20251208203354-0020 Batch_Silver_to_Gold 6 2.0 GiB 2025/12/08 20:33:54 spark FINISHED 3.7 min
app-20251208202629-0019 Batch_Bronze_to_Silver 6 2.0 GiB 2025/12/08 20:26:29 spark FINISHED 7.3 min
app-20251208200946-0018 Batch_Raw_to_Bronze 5 2.0 GiB 2025/12/08 20:09:46 spark FINISHED 17 min
app-20251208200934-0017 Streaming_Kafka_to_PostgreSQL 4 1024.0 MiB 2025/12/08 20:09:34 spark FINISHED 8.7 min
app-20251208185107-0015 Streaming_Realtime_Dashboard 2 1024.0 MiB 2025/12/08 18:51:07 spark FINISHED 1.4 h
app-20251208183924-0008 Streaming_Kafka_to_PostgreSQL 4 1024.0 MiB 2025/12/08 18:39:24 spark FINISHED 1.5 h
app-20251208185238-0016 Streaming_Realtime_Dashboard 2 1024.0 MiB 2025/12/08 18:52:38 spark FINISHED 32 s
app-20251208184910-0014 Streaming_Realtime_Dashboard 2 1024.0 MiB 2025/12/08 18:49:10 spark FINISHED 22 s
app-20251208184646-0013 Streaming_Realtime_Dashboard 2 1024.0 MiB 2025/12/08 18:46:46 spark FINISHED 26 s
app-20251208184634-0012 Streaming_Realtime_Dashboard 2 1024.0 MiB 2025/12/08 18:46:34 spark FINISHED 25 s
app-20251208184154-0011 Streaming_Realtime_Dashboard 2 1024.0 MiB 2025/12/08 18:41:54 spark FINISHED 27 s
app-20251208184140-0010 Streaming_Realtime_Dashboard 2 1024.0 MiB 2025/12/08 18:41:40 spark FINISHED 27 s
app-20251208183950-0009 Streaming_Realtime_Dashboard 2 1024.0 MiB 2025/12/08 18:39:50 spark FINISHED 27 s
app-20251208183224-0007 Streaming_Realtime_Dashboard 2 1024.0 MiB 2025/12/08 18:32:24 spark FINISHED 4.9 min
app-20251208153318-0006 Streaming_Kafka_to_PostgreSQL 10 2.0 GiB 2025/12/08 15:33:18 spark FINISHED 3.1 h
app-20251208142304-0001 Streaming_Kafka_to_PostgreSQL 4 1024.0 MiB 2025/12/08 14:23:04 spark FINISHED 1.2 h
app-20251208153017-0005 Batch_Gold_to_Postgres 6 2.0 GiB 2025/12/08 15:30:17 spark FINISHED 2.7 min
app-20251208152617-0004 Batch_Silver_to_Gold 6 2.0 GiB 2025/12/08 15:26:17 spark FINISHED 3.8 min
app-20251208145621-0003 Batch_Bronze_to_Silver 6 2.0 GiB 2025/12/08 14:56:21 spark FINISHED 30 min
app-20251208143154-0002 Batch_Bronze_to_Silver 6 2.0 GiB 2025/12/08 14:31:54 spark FINISHED 23 min
app-20251208141204-0000 Batch_Raw_to_Bronze 6 2.0 GiB 2025/12/08 14:12:04 spark FINISHED 20 min