Have you ever wondered how
Google and Facebook manage it's queries in excessive amount of data or how
Facebook gets your photos and notifications in such a small time with a large
quantity of information that needs scanning for appropriate data item to be
retrieved
We are moving into a wide
world of Data management called Big Data. This term may seem strange to hear
now but it is goanna be the future of internet world. It may be astonishing to
know that 90% of the worldwide data that we have on internet is generated in
last 2 years. This accelerated trend is
definitely going to continue and it is just a matter of time when it can cross
when hundreds of petabytes.
Recommended Article For you
There is no pondering over
the fact that where the data is coming from. It is the generation of smart
phones, social networks like Facebook, twitter and trading platforms.
Google labs had developed an
algorithm called Map Reduce that allowed their large data calculations to be
chopped up into smaller chunks and map to many computers. And when the
calculations were done, we brought back together to produce the resulting data
set.
This algorithm is then used
to develop open source project called Hadoop which allows applications to run
using Map Reduce algorithm.
This helps Google and
Facebook to manage their data easily. Businesses are adopting themselves to use
this powerful architecture. There are generally two things that's forcing them
to do so. First of all large amount of data, larger than 10 Terabytes and
secondly high calculation complexity. Combination of these two factors with a
need for fast retrieval of data can demand hadoop architecture.
It can be simply understood
as the data processing takes place in parallel instead of processing in serial
manner in this architecture which finally leads to faster results.
Facebook currently has the
largest Hadoop cluster in the world with more than 100 PB of data which grows
roughly half a PB per day. Fascinating isn't it!
So, this technology helps
Google and Facebook to manage their big data to retrieve any queries quickly.
This post is written by
Sarabjeet singh on the topic “How Google and Facebook manage their all data so
effectively?” and SEO by Gaurav Sharma. If you have to write a quality guest
post for us, you can check out our guest posting guidelines.
Back to: ComFuge- A World ofGeeks
About the author
| Sarabjeet singh is an author at ComFuge-A World of Geeks. He is also pursuing B.tech (Computer Science ) from Vit University, Chennai. |  |
