New York University's independent student newspaper, established in 1973.

Washington Square News

New York University's independent student newspaper, established in 1973.

Washington Square News

New York University's independent student newspaper, established in 1973.

Washington Square News

A mural of a woman’s face holding up a chain with the word “LOISAIDA” and a gold cityscape. The words “el bohio murals” and “#BRINGARTBACK” are next to the woman alongside the words “CURATED BY … THRIVECOLLECTIVE.ORG.”
Activists’ 25-year fight to revive an East Village community center
Dharma Niles, Deputy News Editor • Mar 12, 2024
A front entrance with the text “Electric Lady Studios” written in a retro white font on two reflective walls.
‘An exploitative environment’: The interns behind Electric Lady Studios
Julia Diorio, Music Editor • Feb 20, 2024

Adam’s Angle: Big data should supplement traditional data collection

When it comes to data, big does not always mean better. Businesses, agencies and websites have become obsessed with the excessive collection of information in this age of big data, even though their efforts do not always yield functional results. A recent scientific article aptly used the term “big data hubris” to describe the mistaken assumption that big data can replace traditional data analysis. Certainly, big data have proven useful and is expanding its reach into consumer applications, but it cannot be used as a solution to every existing problem.

Big data are the large-scale aggregation and analysis of information. Large retailers like Walmart have found value in big data, tracking consumer preferences to determine which products are in demand and when to time sales. Since the growth of data availability fostered by the Internet, new uses of big data have been discovered. UPS has used big data to optimize its delivery routes, dating websites to better match its users and even police departments to gather information on past arrests to calculate when and where crimes are likely to occur again.

Just because big data have succeeded in some areas, however, does not mean it should be applied to every field of research. Tech giant Google used big data to collect information on flu outbreaks. Such analyses are typically made by the Centers for Disease Control and Prevention, which has a large collection of patient data, but Google thought it could better predict future flu outbreaks by tracking the location and frequency of Internet searches for flu symptoms. Unfortunately, as Google has discovered, there is not a direct correlation between people who search for flu symptoms and people who have the flu — healthy individuals are interested in flu symptoms, too. As a result, Google Flu Trends was unsuccessful. In fact, Google reported an inordinately high prevalence of the flu for 100 of the 108 weeks data was tracked.

Google suffers from big data hubris. The Google analysts assumed that big data could replace the traditional data collection methods utilized by the CDC, instead of trying to supplement it. Google Flu Trends would be more accurate if the company had worked in conjunction with the CDC instead of trying to operate independently.

While big data have opened new doors for researchers over the past decade, its blind implementation is unwarranted. Data aggregation is a costly endeavor and does not always pay off. Businesses should proceed with caution when considering the use of big data, making sure to allow its collection to augment, not supplant, traditional research methods.

Adam Fazlibegu is a staff columnist. Adam’s Angle is published every Thursday. Email him at [email protected].

View comments (1)

Comments (1)

Comments that are deemed spam or hate speech by the moderators will be deleted.
All Sort: Newest

Your email address will not be published. Required fields are marked *

 

  • C

    candy crush cheats and tips level 95Oct 13, 2014 at 7:51 pm

    Hi there, just became aware of your blog through Google,
    and found that it’s truly informative. I’m going to wwatch out for brussels.
    I will bee grateful if you continue this in future.
    Many people will be benefited from your writing. Cheers!

    Reply