NewBalance: Efficient Data Space Management and Algorithmic Optimization for Large-Scale Storage Sys

来源 :Chinese Journal of Electronics | 被引量 : 0次 | 上传用户:imanhuaa
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Fragmentation usually occurs when data space of original storage nodes has to be reallocated to new added storage nodes during the scale-out evolution of the large-scale storage system.It greatly influences its performance and becomes a challenge to manage the whole space.We present an efficient space management framework,called New Balance,to reduce fragmentation with the minimum data movement while keeping the storage system load balance.The space management framework has two phases including the collection phase and the allocation phase.For the collection phase,we propose a novel algorithm,called the greedy bi-direction collector,which collects enough space for the new storage nodes.For the allocation phase,we formally represent it as a variant of the bin packing problem and then utilize some bin packing heuristics including the first fitting and the best fitting to allocate collected intervals to new added storage nodes.The experimental results show that the amount of intervals can be reduced by 20%~55%and our algorithmic optimization improves the data lookup performance by at least 10%and the scale-out performance by 2X~3X. Fragmentation usually when data space of original storage nodes has to be reallocated to new added storage nodes has to be reallocated to new added storage nodes have to be reallocated to new added storage nodes during to scale-out evolution of the large- scale storage system. If its performance and becomes a challenge to manage the whole space. We present an efficient space management framework, called New Balance, to reduce fragmentation with the minimum data movement while keeping the storage system load balance. the space management framework has two phases including the collection phase and the allocation phase. For the collection phase, we propose a novel algorithm, called the greedy bi-direction collector, which collects enough space for the new storage nodes. For the allocation phase, we formally represent it as a variant of the bin packing problem and then utilizes some bin packing heuristics including the first fitting and the best fitting to allocate collected intervals to new added storage nodes. The experimental results show that the amount of intervals can be reduced by 20% ~ 55% and our algorithmic optimization improves the data lookup performance by at least 10% and the scale-out performance by 2X ~ 3X.
其他文献
【摘 要】汽车命名的好坏,关系到消费者对汽车的认同度,也是汽车营销的一个重要环节。好的命名,既要彰显厂家的品位和文化,又要琅琅上口、好听好记。因此,汽车命名的学问同时也是语言的学问。据此我们调查了国际和国内市场上较为知名的200种汽车系列的命名,从语言学角度来分析当今汽车市场在命名上的现象及趋势。  【关键词】车名;语音;词汇;语用  汽车名是汽车厂家给消费者的第一印象,汽车命名的好坏,很大程度上
Spin-torque transfer RAM(STT-RAM) is a promising candidate to replace SRAM for larger Last level cache(LLC). However, it has long write latency and high write e
For complex multi-source,multi-product,multi-stage Supply chain network(SCN)design problem,we propose an optimization supply chain network model.We consider cas
期刊
介绍用模拟探伤仪测金属材料声速的原理、方法及实测结果。用数据对比展示了实测结果的精确程度 ,讨论了可能产生误差的原因。 This paper introduces the principle, metho
一天下午,我像往常那样看门诊,一位中年阿姨被人搀扶着进来了.“医生,我的右眼突然看不见了.”她神情焦虑,极其紧张.“别着急,坐下慢慢说.”我指引她先摸了一下凳子,然后轻轻
期刊
该文从挂篮荷载计算、施工流程、支座及临时固结施工、挂篮安装及试验、合拢段施工、模板制作安装、钢筋安装、混凝土的浇筑及养生、测量监控等方面人手,介绍了S226海滨大桥
【摘 要】分析早期康复护理对脑卒中患者功能预后的影响。方法 选择2008年1月至2008年12月在我科收治的120例缺血性脑卒中患者,分康复组和对照组各60例,两组患者均接受神经内科常规治疗和护理。康复组除常规护理外,在患者生命体征稳定、神志清楚、神经系统症状不再恶化48 h后即采用早期综合康复护理方案。治疗前后肌张力评定采用Ashwarth评分法评定瘫痪肢体的运动功能及Barthel指数评定日常
期刊