GoogleBigtableFayChang,JeffreyDean,SanjayGhemawat,,,MikeBurrows,TusharChandra,AndrewFikes,,(other)UWpresentationbyJeffDeaninSeptemberof2005(Seethelinkontheseminarpage,orjustgooglefor“googlebigtable”)1Beforewebegin…IntersectionofdatabasesanddistributedsystemsWilltrytoexplain(oratleastwarn)whenwehitapatchofdatabaseRememberthisisadiscussion!2GoogleScaleLotsofdataCopiesoftheweb,satellitedata,userdata,,mercialsystembigenoughCouldn’tafforditiftherewasoneMightnothavemadeappropriatedesignchoicesFirmbelieversintheEnd-to-Endargument450,000machines(NYTimesestimate,June14th20063BuildingBlocksScheduler(GoogleWorkQueue)GoogleFilesystemChubbyLockserviceTwootherpieceshelpfulbutnotrequiredSawzallMapReduce(says)BigTable:buildamoreapplication-friendlystorageserviceusingtheseparts4GoogleFileSystemLarge-scaledistributed“filesystem”Master:responsibleformetadataChunkservers:responsibleforreadingandwritinglargechunksofdataChunksreplicatedon3machines,masterresponsibleforensuringreplicasexistOSDI’04Paper5Chubby{lock/file/name}serviceCoarse-grainedlocks,canstoresmallamountofdatainalock5replicas,needamajorityvotetobeactiveAlsoanOSDI’06Paper6Datamodel:abigmap<Row,Column,Timestamp>tripleforkey-lookup,insert,anddeleteAPIArbitrary“columns”onarow-by-rowbasisColumnfamily:,qualifierlightweightColumn-orientedphysicalstore-rowsaresparse!DoesnotsupportarelationalmodelNotable-wideintegrityconstraintsNomultirowtransactions7SSTableImmutable,sortedfileofkey-valuepairsChunksofdataplusanindexIndexisofblockranges,notvaluesIndex64Kblock64Kblock64KblockSSTable8TabletContainssomerangeofrowsofthetableBuiltoutofmultipleSSTablesIndex64Kblock64Kblock64KblockSSTableIndex64Kblock64Kblock64KblockSSTableTabletStart:aardvarkEnd:apple9TableMultipletabletsmakeupthetableSSTablescanbesharedTabletsdonotoverlap,SSTablescanoverlapSSTableSSTableSSTableSSTableTabletaardvarkappleTabletapple_two_E
Google Bigtable 来自淘豆网m.daumloan.com转载请标明出处.
