Category Archives: Data index

Hadoop – part 2

Posted on June 14, 2011 by Ray

(Sorry about the length). In part 1 we discussed some of Hadoop’s core characteristics with respect to the Hadoop distributed file system (HDFS) and the MapReduce analytics engine. Now in part 2 we promised to discuss some of the other … Continue reading →

Posted in Data, Data analytics, Data index, Data reduction, Data science, Decision making, Distributed computing, Strategy, System effectiveness, Systems | Tagged , , , , , , , , , , , , , , , , , , | Leave a comment

5 killer apps for $0.10/TB/year

Posted on July 27, 2010 by Ray

Cloud storage keeps getting more viable and I see storage pricing going down considerably over time.  All of which got me thinking what could be done with a dime per TB per year storage ($0.10/TB/yr).  Now most cloud providers charge … Continue reading →

Posted in Data, Data growth, Data index, Data search, storage economics | Tagged , , , , , , , , | 3 Comments

Google vs. National Information Exchange Model

Posted on February 23, 2010 by Ray

Wouldn’t the National information exchange be better served by deferring the National Information Exchange Model (NIEM) and instead implementing some sort of Google-like search of federal, state, and municipal text data records.  Most federal, state and local data resides in … Continue reading →

Posted in data access, Data index, Data search, Data security, Strategy, Systems | Tagged , , , , | 26 Comments

5 laws of unstructured data

Posted on January 6, 2010 by Ray

All data operates under a set of laws but unstructured data suffers from these tendencies more than most of all. Although, information technology has helped us to create and manage data easier, it hasn’t done much to minimize the problems … Continue reading →

Posted in Data growth, Data index, Data search, Storage, storage economics | Tagged , , , , , , | Leave a comment

7 grand challenges for the next storage century

Posted on November 19, 2009 by Ray

I saw a recent IEEE Spectrum article on engineering’s grand challenges for the next century and thought something similar should be done for data storage. So this is a start: Replace magnetic storage – most predictions show that magnetic disk … Continue reading →

Posted in Data index, Data search, Data security, Networking, Storage, Storage density, Storage Features, Storage reliability | Tagged , , , , , , , , , , , , , | Leave a comment

Protecting the Yottabyte archive

Posted on November 11, 2009 by Ray

In a previous post I discussed what it would take to store 1YB of data in 2015 for the National Security Agency (NSA). Due to length, that post did not discuss many other aspects of the 1YB archive such as … Continue reading →

Posted in Data index, Networking, Storage, Storage Backup, Storage density, Storage performance, Systems | Tagged , , , , , , , , , , , , , , , , | 2 Comments

Yottabytes by 2015!?

Posted on November 3, 2009 by Ray

Well, maybe an Exabyte a day was way too small for 2009. NSA is now reporting that they may be storing yottabytes (YB, 10**24) of data by 2015 somewhere in Utah. Later reports have NSA reducing this down to something … Continue reading →

Posted in Data index, File Storage, Storage, Storage density, Storage performance, Storage reliability, Systems | Tagged , , , , , , , , , , , | 1 Comment