transaction generated data Archives — LIRNEasia


What is big data?

Posted on November 18, 2015  /  0 Comments

I spent the last two days at a meeting on big data in the global south. The sixty people in the room had no shared understanding of big data, which led to some interesting discussions. Then someone stated that he wished big data would be defined. Big data is characterized by volume and variety. The third part of the 3 Vs, velocity, is irrelevant, as has been argued by many including Viktor Mayer-Schonberger.
My previous post on Internet v Facebook users elicited a lot of responses. We also went back and relooked at the numbers carefully. The Myanmar census numbers came in (after 30 years?). Some changes were made.
I was reminded of that old chestnut about a flagman having to walk in front of early automobiles when I heard some participants talk at the workshop on big data, social good and privacy. Imagine imposing inform and consent rules on transaction-generated data (big data) belonging to large corporate entities such as mobile operators. They need the data on user mobility patterns to manage their networks; they need financial transaction data to manage their finances. All these things can be covered under broad inform and consent procedures that will be presented to customers as they sign up. What will not be possible would be to permit use by third parties for traffic management, energy management, urban planning etc, since these uses could not be conceptualized at the time of signing up customers.