'flink slots in same taskmanager memory is share?
These information is describe in flink.apache.org, I don't sure memory is share by 3 slots?
Each task slot represents a fixed subset of resources of the TaskManager. A
TaskManager with three slots, for example, will dedicate 1/3 of its managed
memory to each slot. Slotting the resources means that a subtask will not
compete with subtasks from other jobs for managed memory, but instead has a
certain amount of reserved managed memory. Note that no CPU isolation happens
here; currently slots only separate the managed memory of tasks.
some job is big, some is small, slot configure is too difficult. if share memory, only set total process memory is ok.
Solution 1:[1]
All of tasks in the slots in a given task manager are running in the same JVM, and are competing with each other for the resources available to that JVM -- memory, CPU, etc.
A task slot is just an abstraction used by Flink's scheduler. It's a generally convenient abstraction because the number of slots your cluster needs matches the parallelism of the job(s) running there, but it doesn't really correspond to anything concrete.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 |