Big Data and its Application

Aditya Raj
4 min readSep 17, 2020

--

With fast development in technologies there is an increase in the data generation and these data are transforming the way in which companies are creating their business strategies.

In today’s world it is impossible for a person to not use the internet. Digital’s role in our lives has reached new heights, with more people spending more time doing more things online than ever before. The number of people around the world using the internet has grown to 4.54 billion, an increase of 7 percent (298 million new users) compared to January 2019. Worldwide, there are 3.80 billion social media users in January 2020, with this number increasing by more than 9 percent (321 million new users) since this time last year.

Facebook revealed that its system processes 2.5 billion pieces of content and 500+ terabytes of data each day, and it scans roughly 105 terabytes of data each half hour.

Very few companies have been able to obtain useful insight from these data and use them in their business decision making. Many companies collect data about their customers but they are not able to process them and many companies don’t think about data.

Let’s discuss some of the applications of Big Data by some of the companies like Google, Facebook and Netflix.

Application of Big Data by Google

Google is the world’s most “data-oriented” company. It is a part of the largest implementer of Big Data technologies. Google has developed different tools and techniques that they use in the big data ecosystem. With the help of these tools and techniques Google is now able to explore billions of web pages and fetch the right answer and information within milliseconds. Google uses Big Data tools and techniques to understand user’s requirements based on several parameters like search history, locations, trends etc. Then it runs an algorithm to do complex calculations and then returns the result according to the user’s requirements.

Google also applies Big Data technologies in advertisements. They find the target users based on the age, gender, location etc. Google also keeps track of user search history. This data is aggregated to its advertisers, so they can easily choose the best keywords for their campaigns.

Now the question is how Google handles the large volume of data which is in Petabytes. The answer is by implementing computing tools and technologies which is like Hadoop and BigQuery.

Application of Big Data by Facebook

Facebook uses big data to understand about their users by understanding their user’s behaviors, interest, and their geographic locations. Facebook uses this data to show customized ads on the user’s timeline.

There are billions of unstructured data that is generated every day, which contains images, text, videos and many other data. With the help of Artificial Intelligence Facebook converts unstructured data into structured data. A deep learning analysis tool can learn to recognize the images which contain humans. This can be done by analyzing the context of the large images that contain humans. By recognizing the similar images. This is the way through which Facebook converts unstructured data into structured data.

Facebook uses deep neural networks to select the target audience to show them ads. The AI can learn how to find the most information about the target audience and then group them to show the ads in a best way. Facebook does facial recognition and image processing of its user by keeping track of its users across the internet and other Facebook profiles.

Facebook revealed that over 100 petabytes of data are stored in a single Hadoop disk cluster. Right now, Facebook actually stores its entire live, evolving user database in a single data center, with others used for redundancy and other data.

Application of Big Data by Netflix

Netflix is one prime example of how technological advancement can work together with human creativity. According to the Wall Street Journal, Netflix uses Big Data analytics to optimize the quality and stability of its video streams, and also assess customer entertainment preferences along with viewing patterns.

Netflix has a huge subscriber base of 182 million and counting. Netflix collects vast amounts of data and analyzes subscriber’s personal taste. Based on this, it recommends movies and shows to the user.

The Recommendation System algorithms which are used by Netflix, it also uses user’s data to generate a different movie series based on the tastes of its users.

Netflix uses data processing software and traditional business intelligence tools such as Hadoop and Teradata, as well as its own open-source solutions such as Lipstick and Genie, to gather, store, and process massive amounts of information. These platforms influence its decisions on what content to create and promote to viewers.

Thank You!!

--

--

Aditya Raj

I'm passionate learner diving into the concepts of computing 💻