Storage system architectures for continuous media data

Abstract

Data storage systems are being called on to manage continuous media data types, such as digital audio and video. There is a demand by apphcations for "constrained-latency storage access" (CLSA) to such data: precisely scheduled delivery of data streams. We believe that anticipated quantitative improvements in processor and storage-device performance will not be sufficient for current data management architectures to meet CLSA requirements. The need for high-volume (but high-latency) storage devices, high-bandwidth access and predictable throughput rates mean that standard latency-masking techniques, such as buffering, are inadequate for the service demands of these apphcations. We examine the ways in which storage system architectures must change in order to provide CLSA on continuous media, taking into account operating system and network support as well as database management. Particular points we cover include -changes in the form of requests and responses at the applicationdatabase and database-OS interfaces -new kinds of abstractions and data independence that data mangemeat systems will need to supply, such as quality-of-service requests and mapping of domain events to OS events -effects of CLSA demands on query optimization, planning and evaluation, including the need for accurate resource estimates and detailed schedules -new information requirements for the database system, such as better characterizations of storage subsystem performance and apphcation patterns. We illustrate the problems and new demands of continuous media access with apphcation requirements of an all-digital television production studio of the future. We conclude by presenting a storage axchitecture we are pursuing that we believe will support "scripted" CLSA to shared data.