Yarn Capacity Scheduler: Share resource between users and queues
The job B will have to wait for job A to complete. As far as I know, there’s no way to redistributed the load on the same YARN queue.
The production jobs will be prioritized if you have enabled preemption (https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_yarn-resource-management/content/preemption.html) and should take indeed 70% of the resources. As for the dev queue, first in, first serve..
as Harold said
there’s no way to redistributed the load on the same YARN queue
But if you make sub queues inside for each user it can work,but you have to manage it for each user, (we are small company and have few users so it manageable)
- Root 100%
- Prod 70%
- user1 25% (25 of the 70)
- user2 25% (25 of the 70)
- user3 25% (25 of the 70)
- user4 25% (25 of the 70)
I configured this scenario on our grid, but still looking for a better approach