Thursday, June 5, 2014

Google software engineers talk about MapReduce - Business

Hadoop in China community once a year of annual event Hadoop China technology cloud computation conference (Hadoop in China 2011, HiC2011) 12.2-12.3 day was held in Beijing, Hadoop in China has successfully held four sessions, this year the theme of the congress is "mass data digging treasure", by the Chinese academy of sciences HiC2011 institute of computing technology, host, through technical application and scientific research in the perspective of cloud computing and double Hadoop open source ecological system present situation and development trend, carry forward the open source spirit, promote Hadoop and cloud computing open source ecological system in China's development.

Google software engineer Grzegorz Malew

The meeting, Google's software engineers Grzegorz Malew published "Beyond MapReduce" theme speech. The earliest Hadoop by by Google Lab development MapReduce and Google File System of inspiration, and by Apache software foundation in 2005 officially introduced in autumn, in March 2006, MapReduce and Nutch distributed File System into the Hadoop project respectively.

Every day as a fast handling large amounts of data large Internet enterprise, Google is also the earliest application MapReduce enterprise, because MapReduce can run in the fleet of common machine, the scale of the fleet can according to application flexible adjustment, a typical MapReduce calculation processing thousands of machine to TB volume of data calculation, a large number of programmers use proved MapReduce usability, at present, Google has achieved hundreds of MapReduce program, every day in Google's fleet has more than 1000 MapReduce program in execution.

In MapReduce according to its own development and application of the experience and the experience, Grzegorz Malew memories, from November 2008, Google USES 4000 computer processing of PB 1 took six hours data a couple of minutes, and in September 2011, the use of 8000 computer processing of PB 10 data, the time spent quite, 3 years, MapReduce brought the data processing ability of rapid ascension, such MapReduce embodies the excellent expansibility, in dealing with the data of PB level, MapReduce is an important role, now 30 minutes when can handle the data 1 PB.

With the rapid growth of the future data, special deal with huge amount unstructured data, MapReduce technology development provides a powerful solution, there have been many applications are based on MapReduce development.

Browse Hadoop China cloud computing congress can slam here.

Recently, a called "loophole hunter" of the people in the BBS name in foreign technology Sysinternals aerator on material says, sogou browser save "buffer overrun vulnerabilities", if the hackers use, can use it carries out unauthorized instructions, and can even get system privileges, various kinds of illegal operations. Today, sogou invention formal statement counter that, at present and can't confirm this loophole, and blamed the "leaks" obvious human manipulations trace, suspected of unfair competition.

According to the BBS aeration material says, this vulnerability can bypass the Win8 security system, operation malicious code, get the administrator privileges, and realize the control of the user's computer. And as for loopholes some reasons, this person, sogou browser use expired of Google Chrome browser kernel, long time not update let sogou browser and Google official seasons, and in fact, Google has been on the new version of the Chrome repair the loophole. At the same time, because of sogou browser doesn't open DEP/ASLR, sand box, and other important protection function, can't control the security risks brought loopholes trigger.

According to PRC reports, a gateway website information security engineer Mr. Pan, a software company WEB security product development personnel Mr Qin in clinical sogou analysis browser think, sogou browser based on Google's Chromium 6 kernel, at present, Chromium version number to 14, most sogou users still in use more than 1 year ago browser kernel, there have been so many holes in the exploit-db, SecuniaSecurityFocus and so on international loophole research organization open. From this point of view, the safety of sogou browser as good patch of IE6.

Today, sogou published official statement said, already on November 29 sogou browser will upgrade to version 3.1, this version used the new Chromium 14.0 kernel, in order to improve the safety level. And explain says, software is inevitable has holes, is in constant repair and upgrade process is the software industry of normal.





No comments:

Post a Comment