A Data Storage Strategy for Low-latency in Memory HDFS

YING Chang-tian; YU Jiong; LIAO Bin; LU Liang

Chinese

您当前的位置：

首页 >

文章列表页 >

A Data Storage Strategy for Low-latency in Memory HDFS

更新时间：2026-09-04

- A Data Storage Strategy for Low-latency in Memory HDFS
- Vol. 31, Issue 11, Pages: 160-166(2014)
- 作者机构：
  
  新疆大学信息科学与工程学院,新疆,乌鲁木齐,830046
- 作者简介：
- 基金信息：
- DOI：
  CLC：
- Published：2014
- 稿件说明：
移动端阅览
英昌甜, 于炯, 廖彬, 鲁亮. 一种面向低延迟的内存HDFS数据存储策略[J]. 微电子学与计算机, 2014, 31(11): 160-166.

YING Chang-tian, YU Jiong, LIAO Bin, et al. A Data Storage Strategy for Low-latency in Memory HDFS[J]. 2014, 31(11): 160-166.
英昌甜, 于炯, 廖彬, 鲁亮. 一种面向低延迟的内存HDFS数据存储策略[J]. 微电子学与计算机, 2014, 31(11): 160-166. DOI：

YING Chang-tian, YU Jiong, LIAO Bin, et al. A Data Storage Strategy for Low-latency in Memory HDFS[J]. 2014, 31(11): 160-166. DOI：

摘要

从底层存储介质的选择和上层分布式文件系统效率的角度出发

提出基于HDFS的内存分布式文件系统架构Mem-HDFS

同时利用集群DataNode的内存和磁盘存储数据

以提高基于HDFS应用的读取性能.并对其进行性能优化

提出一种适应的同分布数据存储策略以及并行读取访问算法.对比实验表明:提出的算法能够较好地降低读取访问延迟.

Abstract

In this paper

we present a storage system

Mem-HDFS

to enable low-latency read accesses.Mem-HDFS integrates the available memory resources in an HDFS clusters to form a cloud storage system.We also present an adaptive identically distributed storage strategy and concurrently read access algorithm.By serving data from memory instead of disks

Mem-HDFS can yield high I/O performance with low latency.

关键词

Keywords

references

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Design of a high-performance fast-SSC decoder for polar codes

Design of ultra-low power real-time clock circuits

Implementation and verification of a dual-chain power gating strategy for low power design

Research on assembly action recognition based on MSS-YOLO-MPHands fusion architecture

Microservices anomaly detection based on the correlation of monitoring metrics

Related Author

LIN Qing

DU Gao-ming

DAI Wu-jun

WANG Xiao-lei

Related Institution

Hefei University of Technology Institute of VLSI Design, IC Design Web-cooperation Research Center of MOE

AI问答

Postal code：100079
Tel：（010）53879206 Email：tmw@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09082226号-64 京公网安备11010602201714号
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰