Control How Your GPU Shares Work with Green Contexts
GPU applications increasingly consist of multiple independent components running at the same time within a single process: a latency-sensitive operator...GPU applications increasingly consist of multiple independent components running at the same time within a single process: a latency-sensitive operator alongside a throughput-oriented background kernel; a data preprocessing stage alongside model inference; or multiple stages of a processing workflow sharing a single GPU. Controlling how GPU resources are shared between them remains difficult.
原文：https://www.a8q9.cn/en/article/control-how-your-gpu-shares-work-with-green-contexts-b2c034.html