Designing a Multi-Petabyte Database for LSST (open access)

Designing a Multi-Petabyte Database for LSST

The 3.2 giga-pixel LSST camera will produce approximately half a petabyte of archive images every month. These data need to be reduced in under a minute to produce real-time transient alerts, and then added to the cumulative catalog for further analysis. The catalog is expected to grow about three hundred terabytes per year. The data volume, the real-time transient alerting requirements of the LSST, and its spatio-temporal aspects require innovative techniques to build an efficient data access system at reasonable cost. As currently envisioned, the system will rely on a database for catalogs and metadata. Several database systems are being evaluated to understand how they perform at these data rates, data volumes, and access patterns. This paper describes the LSST requirements, the challenges they impose, the data access philosophy, results to date from evaluating available database technologies against LSST requirements, and the proposed database architecture to meet the data challenges.
Date: January 10, 2007
Creator: Becla, Jacek; Hanushevsky, Andrew; Nikolaev, Sergei; Abdulla, Ghaleb; Szalay, Alex; Nieto-Santisteban, Maria et al.
Object Type: Article
System: The UNT Digital Library
Sample Preparation: The Missing Link in Microfluidics-based Biodetection (open access)

Sample Preparation: The Missing Link in Microfluidics-based Biodetection

None
Date: December 10, 2007
Creator: Mariella, Raymond, Jr.
Object Type: Article
System: The UNT Digital Library
Advanced Communication and Control Solutions of Distributed Energy Resources (DER) (open access)

Advanced Communication and Control Solutions of Distributed Energy Resources (DER)

This report covers work performed in Phase II of a two phase project whose objective was to demonstrate the aggregation of multiple Distributed Energy Resources (DERs) and to offer them into the energy market. The Phase I work (DE-FC36-03CH11161) created an integrated, but distributed, system and procedures to monitor and control multiple DERs from numerous manufacturers connected to the electric distribution system. Procedures were created which protect the distribution network and personnel that may be working on the network. Using the web as the communication medium for control and monitoring of the DERs, the integration of information and security was accomplished through the use of industry standard protocols such as secure SSL,VPN and ICCP. The primary objective of Phase II was to develop the procedures for marketing the power of the Phase I aggregated DERs in the energy market, increase the number of DER units, and implement the marketing procedures (interface with ISOs) for the DER generated power. The team partnered with the Midwest Independent System Operator (MISO), the local ISO, to address the energy market and demonstrate the economic dispatch of DERs in response to market signals. The selection of standards-based communication technologies offers the ability of the system …
Date: January 10, 2007
Creator: Asgeirsson, Haukur; Seguin, Richard; Sherding, Cameron; de Bruet, Andre, G.; Broadwater, Robert & Dilek, Murat
Object Type: Report
System: The UNT Digital Library