Skip to main content

Posts

Showing posts from June, 2023

Big Data: A Brief Historical Description

Big data is a voluminous dataset from a variety of sources and of varying types that is continuously generated at a high velocity. It can only be managed by specialized processes different from the traditional relational database processing tools in order to infer any relevance or insight from it and to establish the veracity of the data. In other words, big data is a huge collection of data from different sources and of varying types that are growing at an exponential rate with time with no traditional means of storing or processing it but are valuable for insight. The description of big data above stems from the historical use of the term up to the recent definition of parameters (i.e. V's) that are being used to capture the various aspects of this sort of dataset. My history consideration for my description starts from various uses of the term between 1997 and 1998 which are similar to the current usage to mean information explosion starting with Michael Cox and David Ellsworth