华为大数据解决方案24

应用不动性能翻番数据库闪存加速器HUAWEITECHNOLOGIESCO.,LTD.Toprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.2HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidential目录Toprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.3HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidential一个大规模生产、分享和应用数据的时代正在开启…...——肯尼思·库克耶（《大数据时代》作者大数据时代已经来临个人电脑大型机互联网移动互联网大数据Toprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.4HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidential从基因分析看大数据基因分析是对大规模基因数据生产，共享，分析和保存的过程，是典型的大数据处理流程。基因测序数据共享基因分析数据保存导入速度快分析效率高保存容量大共享速度快Toprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.5HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidential知易行难，基因分析机构CIO的大数据困局1.一份数据存储3次，浪费空间2/32.一份数据拷贝2次，浪费时间2倍基因测序基因数据共享基因数据分析基因保存系统共享NAS存储Hadoop存储测序仪本地硬盘基因数据拷贝基因数据保存基因样本基因数据拷贝测序仪本地存储共享NAS存储Hadoop存储快速存取√X√对接分析XX√数据共享X√X没有一种存储能完美适应大数据处理各个环节为什么会这样？Toprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.6HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidential诸多行业大数据处理过程相似，面临同样的困局数据分析数据保存海量数据数据源数据共享能源勘探二维到三维，精度提升数十倍，数据量提升20倍，效率提升数十倍卫星测绘从中分辨率到超高分辨率，精度提高近100倍，数据量提升100倍标清到高清，码率提升4~8倍，数据量提升10倍，总容量超过10PB媒体娱乐金融证券每天处理2千万笔交易，数据保存期不低于15年，总量超过10PBToprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.7HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidential目录Toprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.8HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidentialOceanStor9000丏为大数据设计的存储系统•高效的存储与分析融合•灵活的存储与归档融合•多样的数据类型融合•极致的扩展能力华为全融合大数据存储系统OceanStor9000大数据存储系统归档区Toprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.9HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidential高效全融合系统架构对象检索查询数据分析HPC视频监控应用层媒体与娱乐分布式数据库数据处理层NFSCIFSHDFSObjectSQL分布式文件系统归档网盘话单查询精准营销上网行为分析商业推广文件硬件节点层NodeNodeNodeNodeNodeNodeNodeNodeNodeNodeNodeNodeNodeNodeNodeNodeNodeNodeNodeNode融合扩展FTPToprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.10HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidential存储与分析融合，提升处理效率拷贝共享存储分析存储拷贝导入存储数据生产数据共享数据分析数据生产数据共享数据分析融合扩展一份数据3次存储，浪费空间67%一份数据2次拷贝，浪费时间2倍一份数据1次存储，节省空间67%一份数据0次拷贝，提升效率2倍存储资源池Toprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.11HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidential存储资源池存储与归档融合，简化数据生命周期管理内置检索引擎统一管理，无需独立检索系统，无需应用层参与存储区归档区归档流应用外置检索系统存储设备归档设备融合扩展各自管理，需独立检索系统，消耗应用层资源Toprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.12HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidential多种数据类型融合，支持全量数据分析融合扩展Hadoop基因分析，视频分析，行为分析…SQL详单查询，BI非结构化存储结构化存储不同系统承载不同数据类型，支撑不同分析方式文件数据库NFS/CIFS存储资源池文件数据库Hadoop基因分析，视频分析，行为分析…SQL详单查询，BI一套系统承载多种数据类型，支撑不同分析方式非结构化数据结构化数据NFS/CIFSToprightcornerforfield-mark,customerorpartnerlogotypes.----------------Thefollowingninegroupsofcolorsareanexampleofhowourdesigncolorscanbeused,pleasetakenotethatyoushouldonlyuseonedesigncolorgroupperslide.Forspecificusagedetails,refertothe“TypesettingStandard”.13HUAWEITECHNOLOGIESCO.,LTD.HuaweiConfidential多重关键技术打造横向扩展能力全IP互联、全分布式的存储架构，构建扩展基石业界唯一的动态子树切割技术，管理海量文件自动访