FAST’11 WiP

Flash Oriented IO Management  for Data Intensive Applications Yongkun Wang Student, Graduate School of Information Science and Technology Kazuo Goda

Miyuki Nakano     Masaru Kitsuregawa Institute of Industrial Science The University of Tokyo 1

Flash SSD • A promising storage device for data intensive  applications • Lots of works succeeded in boosting – Many employed LFS‐like techniques in a specific  storage layer to mitigate slow random writes – Few explored potential device performance in a  system

• Our goal: overall IO optimization through IO path  for achieving potential flash SSD performance 2

Performance Gap • Mtron device implies significant speedup • LFS gives substantial boosting, but does not  reach potential performance Intel 2GHz processor, 2GB memory with Mtron PRO 7500 32GB SLC Linux 2.6.x, TPC‐C (#W=30), DBMS‐X with 4KB blocks, 80MB buffer

Sequential Read Sequential Write

Read

x5.8 Random Read

x116

x6.0

Random Write Write

Basic performance of Mtron SSD

IO time of TPC‐C execution

3

Eager Scheduling w/ Database Checkpoint Information • Database checkpoint information helps to maximize  write scheduling opportunities • Flash‐aware write scheduling reduces slow random  writes to obtain potential device power Scheduling Window Read

Application (DBMS)

Write

Ckpt. Info.

IO Path

Write scheduling Time

Flash SSD 4

Trace‐driven Experiment • Combined write scheduling techniques could potentially  reduce write time by two orders of magnitude – Even small buffer boosted well – Merely deferring gave degradation

Intel 2GHz processor, 2GB memory with Mtron PRO 7500 32GB SLC, Linux 2.6.x, TPC‐C (#W=30), DBMS‐X with 4KB blocks, 80MB buffer

5

Towards Deeper Impedance Matching • Small runtime application  information • Device specific characteristics

– Slow random writes – Unexpected aging – Diversity between products

• Other applications – VMs

• Implementation strategy – Existing storage software stack – Relatively small CPU time for  scheduling

IO Optimization

• More Flash SSD characteristics

App

App

App

File System LVM Disk Driver HBA Array Controller

SSD

SSD

SSD 6

Flash Oriented IO Management for Data Intensive ...

Feb 16, 2011 - Intel 2GHz processor, 2GB memory with Mtron PRO 7500 32GB SLC. Linux 2.6.x, TPC-C (#W=30), DBMS-X with 4KB blocks, 80MB buffer ...

427KB Sizes 2 Downloads 181 Views

Recommend Documents

An Experimental Study on IO Optimization Techniques for Flash ...
We examined the IO optimization techniques and the distinct features of the flash SSD. The IOs applied with optimization techniques are analyzed through the IO ...

Power Management of Online Data-Intensive Services
ther power management of a single server component nor uncoordinated power management of multiple components provide desirable power-latency tradeoffs. We report the results of two major studies to better un- derstand the power management needs of OL

Dynamic Data Migration Policies for* Query-Intensive Distributed Data ...
∗Computer Science, Graduate School and University Center, City University ... dials a number to make a call, a request is made to query the callee's location.

Power Management of Online Data-Intensive Services - CiteSeerX
Permission to make digital or hard copies of all or part of this work for personal or classroom ... C.5.5 [Computer System Implementation]: Servers. General Terms.

Power Management of Online Data-Intensive Services - CiteSeerX
this workload class, we first characterize a production Web .... 1) CPU active low-power modes provide the best ... low-power modes for memory (e.g., [10]) and we demonstrate that these ...... hosting centers,” in Symp. on Operating System.

MONTHLY DATA REPORT: GOOGLE IO May 2016 - data to Apteligent
May 2, 2016 - App owners typically focus on the operating systems that are most widely used by their customer base. For these decision makers, the official ...

MONTHLY DATA REPORT: GOOGLE IO May 2016 - data to Apteligent
May 2, 2016 - We've analyzed Android fragmentation (or lack thereof!), Google Fi device usage, crashes ..... Phone 10, Hybrid and HTML5. Trusted by three ...

IO (41am)
May 1, 2002 - grated Optic Systems”, Journal Of Lightwave Technology, vol. 7, pp. 3-10, Jan. ...... degree of spectral coherence by use of a wave-front-folded interferometer. .... tomography and high frequency intravascular ultrasound.” Heart ...

Pilot-Abstractions for Data-Intensive Cloud Applications - GitHub
Pilots provide a powerful abstraction for clouds as well. ... KEY WORDS: Cloud Computing, MapReduce, Grid Computing, Data- ... what if data-volumes are too large to move, or have constraints on the ability to ... due to security or privacy concerns).

Enabling Advanced Loading Strategies for Data Intensive Web Services
in a real implementation of a Web services framework that extends CXF. ... those applications where data-intensive multiple-interactions ..... development.

Enabling Advanced Loading Strategies for Data Intensive Web Services
Enabling Advanced Loading Strategies for Data Intensive Web Services ... those applications where data-intensive multiple-interactions ..... development.

Event / Data Flash -
operating figures, with net revenue of USD1,121mn (0% QoQ/ -20% YoY) and adjusted ... Rolling chip volume and VIP revenue were +12.5% QoQ/ -24%. YoY and +8% QoQ/ ... believe the company possesses solid medium term growth prospects, .... analyst in th

[EBOOK] Download Designing Data-Intensive ...
Book Synopsis. Data is at the center of many challenges in system design today. Difficult issues need to be figured out, such as scalability, consistency, reliability, efficiency, and maintainability. In addition, we have an overwhelming variety of t

IO (41am)
May 1, 2002 - Mueller-Matrix Optical Coherence Tomography and Application in. Burn Imaging ..... Chance, B., J. S. Leigh, et al. (1988). “Comparison ofTime- ...

M IO/ INTA
2.a) Write a subroutine for 8085 to obtain 1 milli sec. delay. The crystal frequency ... 6.144 MHz. Use this subroutine write a programme for 50 milli seconds delay.

pdf-1882\io-consolidation-in-the-data-center.pdf
pdf-1882\i-o-consolidation-in-the-data-center.pdf. pdf-1882\i-o-consolidation-in-the-data-center.pdf. Open. Extract. Open with. Sign In. Main menu.

Service-Oriented Architecture for High-Dimensional Private Data ...
Service-Oriented Architecture for High-Dimensional Private Data Mashup..pdf. Service-Oriented Architecture for High-Dimensional Private Data Mashup..pdf.