在线咨询
eetop公众号 创芯大讲堂 创芯人才网
切换到宽版

EETOP 创芯网论坛 (原名:电子顶级开发网)

手机号码,快捷登录

手机号码,快捷登录

找回密码

  登录   注册  

快捷导航
搜帖子
查看: 60|回复: 0

[求助] MCLB: Dynamic Load Balancing and Implications on GPU Memory Controllers

[复制链接]
发表于 昨天 17:26 | 显示全部楼层 |阅读模式
50资产
https://ieeexplore.ieee.org/document/10737822

Abstract:Graphics Processing Units (GPUs) play a pivotal role as primary devices for executing a diverse range of applications. Effective load balancing of the interconnection network is crucial in distributed computing systems as it ensures optimal resource utilization. While previous studies have addressed interconnection network load balancing, our investigation reveals that GPU cores often exhibit a uniform load pattern due to the nature of their workloads. However, we found that memory controllers experience varying loads, potentially leading to stall cycles during which memory requests cannot enter a specific controller’s full queue, causing it to remain in the interconnection network. Introducing the concept of “busy” and “relaxed” memory controllers, our proposed method, Memory Controller Load Balancing (MCLB), dynamically balances the load on memory controllers by categorizing them based on a predefined threshold. GPU cores temporarily pause sending memory requests to “busy” memory controllers, prioritizing “relaxed” cores. This strategy effectively reduces unnecessary congestion in the interconnection network and improves resource utilization in the memory request path. To our knowledge, MCLB is the first method specifically designed to balance memory controller loads in GPU. MCLB significantly reduces total number of memory controller stalls (eliminating them completely in some cases), resulting in latency enhancements. It improves memory request and response roundtrip latency by up to 11.8%, and interconnection network latency by up to 24.6%. This work presents a novel approach to GPU optimization by addressing memory controller load imbalances.

您需要登录后才可以回帖 登录 | 注册

本版积分规则

关闭

站长推荐 上一条 /1 下一条

X

小黑屋| 手机版| 关于我们| 联系我们| 隐私声明| EETOP 创芯网
( 京ICP备:10050787号 京公网安备:11010502037710 )

GMT+8, 2025-7-4 01:42 , Processed in 0.012340 second(s), 6 queries , Gzip On, MemCached On.

eetop公众号 创芯大讲堂 创芯人才网
快速回复 返回顶部 返回列表