• 您當前位置:首頁 > 成功案例 > 高教案例 > 北京郵電大學大數據實驗平臺管理系統

    北京郵電大學大數據實驗平臺管理系統

    概述

            "大數據"是一個體量特別大,數據類別特別大的數據集,并且這樣的數據集無法用傳統數據庫工具對其內容進行抓取、管理和處理。 "大數據"首先是指數據體量(volumes)大,指代大型數據集,一般在10TB規模左右,但在實際應用中,很多企業用戶把多個數據集放在一起,已經形成了PB級的數據量。其次是指數據類別(variety)大,數據來自多種數據源,數據種類和格式日漸豐富,已沖破了以前所限定的結構化數據范疇,囊括了半結構化和非結構化數據。接著是數據處理速度(Velocity)快,在數據量非常龐大的情況下,也能夠做到數據的實時處理。最后一個特點是指數據真實性(Veracity)高,隨著社交數據、企業內容、交易與應用數據等新數據源的興趣,傳統數據源的局限被打破,企業愈發需要有效的信息之力以確保其真實性及安全性。

    實現目標

        為北京郵電大學搭建大數據實訓室,為100人同時在線,提供Hadoop服務,同時進行并行存儲和并行計算。

    基礎平臺搭建--云

    云技術架構

            首先 “私有云”基于企業網構成,私有云的構建與運行者、資源提供者和使用者是集團和集團企業下屬相關廠所、研究單位、企業等,其目的主要是強調企業內或集團內制造資源和制造能力整合與服務,優化企業或集團資源和能力使用率,減少重復資源和能力的重復建設,降低成本,提高競爭力。

            云計算為方便地,按需地通過網絡訪問共享的計算資源提供了解決途徑,它可以實現基礎設施和用戶程序的快速自動部署,同時提供云環境(硬件,軟件)完整的生命周期管理。使用者可以通過網絡隨時訪問。同時將計算資源池化,各應用按負載要求從資源池中靈活調用,可以實現自動的資源添加或縮減,同時也可以統計各應用對計算資源的消耗情況。

            引入云計算平臺可以降低 IT 成本,同時提高現有資產的效率、利用率和靈活性。

    采用云計算的優勢

            任何一種新的信息技術在企業中的應用,往往都是出于商業價值的考量。對基礎設施云來說也不例外。基礎設施云和傳統的IT架構相比,能極大的提高企業信息部門各個服務器的使用率,解決企業自有的計算力在高峰時期不足而在低谷時期又過剩的矛盾,提升企業信息系統的容錯性,并最終在規模化的基礎上產生的更好的成本效應。

    邏輯架構設計

            云計算解決方案實現資源彈性調整以為上層服務云提供各類服務及業務系統,為了加強IT部門對于云平臺及下層各種資源的運維程度,我們需要建設一個統一的運維管理自動化平臺,該平臺采用OPENSTACK運維管理自動化產品的完整解決方案。OPENSTACK運維管理自動化產品能夠實現IT運維整個生命期的自動化,涵蓋了從最初的設備發現及拓撲生成,到安裝、配置、升級、安全管理、審計及擴展的全過程。

    應用平臺搭建--大數據實驗平臺

            Hadoop 是一個能夠讓用戶輕松架構和使用的分布式計算平臺、輕松地在 Hadoop 上開發和運行處理海量數據的應用程序。它主要有以下幾個優點:

    產品架構

    1.      大數據實驗平臺管理系統架構

    2.      設計要點

            界面化的 Hadoop 部署工具。采用開源的 openstack 虛擬化平臺。hadoop 基于 Apache Hadoop 二次開發,增進了易用性,同時增加 了 ResourceManager 高可用功能,可提供大于 2 臺的ResourceManager,保證 YARN 框架的 7*24 不間斷工作。集成了 Hadoop 生態圈的大部分生態應用,Accumulo,HBase,Hive,Pig,Storm,Kafka,Sqoop,Flume 等。已預編譯為 rpm、deb 方式,,支持 CentOS, RedHat 5/6, ubuntu等 Linux 操作系統。提供管理界面,可通過管理節點以界面化的方式快速部署和管理 Hadoop 集群,并提供監控功能,監測每臺節點的運行狀況。


    發表時間:[2017-09-08 11:48:26]

    红运彩
  • www.530391.com | 70118g.com | www.4058gg.com | WWW.590673.COM | 1114116.com | www.0622.com | www.810926.com | 3550j.com | www.126xc.com | 38989l.com | www.8967m.com | WWW.750563.COM | 4647a.com | www.pgylc.cc | www.38084a.com | 6594mm.com | WWW.579872.COM | 0981.com | www.49956y.com | 555305.com | www.901148.com | WWW.546516.COM | 405.com | www.hn896.com | www.150822.com | long677.com | WWW.24478.COM | 3416m.com | www.367777.cc | www.178675.com | xpj66378.com | WWW.221354.COM | eee67890.com | WWW.662307.COM | 7893w04.com | www.39500f.com | bj1111.com | www.12136y.com | www.590596.com | WWW.610802.COM | WWW.150058.COM | WWW.205100.COM | www.10999j.com | WWW.355320.COM | tz6.com | WWW.516008.COM | 8000524.com | www.0014o.com | 33331.cm | www.00840a.com | www.long8.com | www.1117795.com | WWW.771606.COM | 67877r.com | WWW.508877.COM | 422yh.com | www.zmfqp.net | www.bizhong55.com | 1688key.com | WWW.95438.COM | 11018z.com | www.9478l.com | 3258r.com | www.4520011.com | www.202314.com | www.56655u.com | WWW.836888.COM | 28288k.com | WWW.195853.COM | 4255hh.com | WWW.787606.COM | 8890830.com | WWW.187035.COM | 4255oo.com | WWW.321440.COM | 30688h.com | WWW.13199.COM | bodog57.com | WWW.628176.COM | am9649.com | WWW.606898.COM | hg772018.com | www.775709.com | www.50999.com | www.383566.com | www.3032aa.com | 061.com | www.83033l.com | js66661.com | www.hjin2.com | 11473333.com | WWW.168696.COM | 3659h.cc | www.372082.com | www.44118s.com | 8036.com | www.59191.cc | 42842827.com | WWW.544522.COM | amjsc02.com | www.91233y.com | 19497h.com | www.7886278.com | 6245k.com | WWW.879040.COM | 4465v.com | WWW.439877.COM | byyl.com | www.106367.com | www.68070.com | 4379m.com | WWW.918289.COM | le888h.com | www.768996.com | www.w84v.com | 3614e.com | WWW.272826.COM | 36504w.com | www.554363.com | www.jl58qp.com | l2146.com | WWW.743877.COM | 30304.com | 6y57.com | www.jcai4.com | 8808555.com | www.377474.com | www.860505.com | uc03.cc | WWW.790004.COM | www.18131.com | vic9308.com | WWW.487728.COM | www.623667.com | qq3189.com | WWW.782599.COM | www.808888y.com | 7141mm.com | WWW.586096.COM | www.50999u.com | 5004rr.com | WWW.548702.COM | www.38345s.com | 3559r.com | WWW.260205.COM | www.mgm868006.com | 6830.com | WWW.96455.COM | www.587189.com | 6269cc.com | WWW.64044.COM | 7945ss.com | WWW.56151.COM | 26444w.com | www.8839d.com | www.118109.com | WWW.118590.COM | 80188.com | WWW.922047.COM | 500000598.com | 73055.cc | WWW.760739.COM | www.256238.com | www.810262.com | 550111s.com | www.lb55567.com | www.449366.com | WWW.153065.COM | www.5446dd.com | 2019mm.cc | WWW.343536.COM | www.97655m.com | 11kk8331.com | 588hz.me | WWW.838123.COM | www.cn365x.com | 58000c.com | WWW.298977.COM | www.38775yy.com | 7249q.com | www.928621.com | www.7239t.com | 46474647.com | 61329999.com | WWW.157479.COM | www.jsdc9777.com | 506374.com | 32126p.net | WWW.888979.COM | www.12455hh.com | 66876l.com | 32212.com | www.913075.com | www.qilc2.com | www.50999w.com | 717blr.com | 355422.com | WWW.198710.COM | www.68365l.com | 0765211.com | 500000797.com | WWW.17001.COM | www.yi695.com | www.10999i.com | 11163355.com | 55335002.com | www.810706.com | WWW.645432.COM | www.9464005.com | 3245k.com | 3238.com | www.815333.com | WWW.761419.COM | www.12455w.com | www.mgm555555.com | p4212.com | 7141mm.com | www.911888.com | WWW.301648.COM | www.42456677.com | www.533163.com | 664740.com | www.52062x.com | 01234ggg.com | www.663558.com | www.514077.com | WWW.806638.COM | WWW.27098.COM | WWW.632448.COM | www.26878n.com | www.13k0048.com | zhcp60.com | 38989h.com | 520666.com | www.877802.com | WWW.647655.COM | www.26878c.com | www.p3410.com | 55cc8332.com | 11zz145.com | 1331jj.com | tk499.com | www.648377.com | WWW.898459.COM | WWW.541955.COM | www.9646n.com | www.hg8hh.com | 2455l.com | 15876.vip | 5004v.com | www.209213.com | WWW.820233.COM | WWW.163720.COM | www.66ffn.com | www.2418q.com | www.369404.com | 4422mmmm.com | 755365.com | 67890rrr.com | www.6678695.com | www.bet63d.com | 4195ww.com | 060.com | www.yi432.com | 505509.com | www.433737.com | WWW.55039.COM | WWW.193521.COM | WWW.170007.COM | www.50064t.com | www.93gj08.com | www.8017111.com | www.bwinyz50.com | 13136.com | WWW.788382.COM | WWW.614569.COM | WWW.910921.COM | www.11025.cc | www.50732t.com | www.68993267.com | www.97828z.vip | www.598012.com | www.xpj29777.com | www.4963qq.com | www.jy768.com | 54140077.com | ambyc3.com | 3169f.com | bet8688.net | 8449ff.com | k7742.com | 85698x.com | 473042.com | s45638.com | jx2400.com | 7m365.com | 2015.com | 776093.com | 5443v.com | bb8888-1.com | 28455.com | v1647.com | www.971055.com | www.80jsjs.com | www.biying950vip.com | www.3983177.com | www.466909.com | www.06400.com | www.x88678.com | www.2418t.com | www.3zq02.com | www.71399m.com | www.5086c.com | WWW.207677.COM | WWW.140029.COM | WWW.79626.COM | WWW.877388.COM | WWW.130879.COM | WWW.615275.COM | www.712012.com | www.131671.com | www.xg2888.com | 7334r.com | 4107b.com | 66671u.com | gao482.com | www.50000955.co | www.58404b.com | www.81608m.com | www.26163l.com | WWW.8977.COM | WWW.40852.COM | WWW.397774.COM | www.358939.com | 7779898.com | 8988w.com | 60957777.com | 55331.com | www.533163.com | www.2848bbb.com | www.4323l.com | WWW.388752.COM | WWW.881980.COM | www.972283.com | www.027107.com | 2127kk.com | 4261.com | 8827hh.com | www.6880vv.com | www.764169.com | WWW.877289.COM | WWW.685505.COM | www.355241.com | 3222n.cc | 77260022.com | pj626910.com | www.s63568.com | www.qucp9.com | WWW.451876.COM | www.767884.com | 8988f.com | 38749.com | 5589w.com | www.06386644.com | www.108ak.com | WWW.745422.COM | www.466780.com | 8988c.com | 3467o.com | www.l456x.com | www.js02346.com | WWW.52232.COM | WWW.930041.COM | 67877e.com | 1443f.com | www.twcp04.com | www.610859.com | WWW.915876.COM | www.598074.com | g3144.com | 3156fff.com | www.78885.com | WWW.798013.COM | www.602255.com | 66300vip39.com | fc9596.com | www.380870.com | WWW.165249.COM | www.713799.com | 644237.com | 28758p.com | www.1358003.com | WWW.7758.COM | www.36166o.com | 88770076.com | www.97060g.com | www.7793j.com | WWW.736789.COM | 21866g.com | hg5009.com | www.967004.com | WWW.56575.COM | www.489789.com | 9068ww.com | www.466890.com | WWW.760709.COM | www.364343.com | 81366i.com | www.v88133.com | WWW.73478.COM | www.354918.com | shibolianmen.com | www.3116j.com | WWW.558268.COM | www.336779.com | 0234t.com | www.t80288.com | WWW.896949.COM | www.39957a.com | 53262d.com | www.68365c.com | WWW.225574.COM | 16690022.com | 500000555.com | www.99714.cc | www.723135.com | 98345f.com | www.m32031.com | WWW.456520.COM | www.89894y.com | WWW.689882.COM | 032132.com | 2078y.com | www.81520m.com | www.935970.com | 4377.com | www.r999997.com | WWW.780748.COM | WWW.452225.COM | WWW.567318.COM | 1413.com | www.88325i.com | WWW.804879.COM | 43456.com | www.7415ee.com | WWW.519103.COM | 6220ll.com | www.rycp052.com | WWW.122416.COM | 66876s.com | www.20199ff.com | WWW.863230.COM | 38sb.com | 7811g.com | WWW.848239.COM | www.50732e.com | 33382r.com | www.0270g.com | WWW.492398.COM | 73567tg9.com | www.327969.com | WWW.892293.COM | 36402222.com | www.bwinyz18.com | WWW.63383.COM | 500000631.com | www.38138t.com | WWW.216066.COM | 3983013.com | www.4196n.com | WWW.56265.COM | 9649e.com | www.8582cc.com | www.267051.com | 0033r.cc | WWW.923192.COM | hg218.com | www.9187e.com | www.924177.com | x3855.com | WWW.31301.COM | 0015qq.com | www.x80288.com | WWW.42442.COM | 33jj8331.com | www.c5829.com | 38821155.com | www.44118g.com | www.711448.com | 55899m.com | WWW.52538.COM | 35222z.com | www.00840a.com | www.05996.com | www.88166j.com | WWW.429978.COM | 365vip99.co | WWW.730428.COM | 3189xx.com | www.81608y.com | www.127918.com | www.ac771.com | WWW.436658.COM | m95510.com | WWW.610655.COM | 71372226.com | www.2350q.com | by305.com | www.830363.com | www.666755.com | www.3066uu.com | www.602436.com | 86688004.com | WWW.788701.COM | 22296xx.com | WWW.931518.COM | 4156.com | WWW.702056.COM | 22nn145.com | WWW.774723.COM | 38989n.com | www.84040.com | WWW.120203.COM | 4997k.com | 25288r.com | www.hg8268.com | 6137i.com | WWW.246116.COM | 918tx.com | WWW.709024.COM | 5008999.com | WWW.7559.COM | yyy40033.com | WWW.223579.COM | 7893w51.com | WWW.805599.COM | WWW.208950.COM | WWW.113473.COM | d67890.com | 4066yy.com | www.h063801.com | www.993939.com | www.7737gg.com | 7030055.com | www.86267hh.com | 00773t.com | www.3126h.com | 45939904.com | WWW.856708.COM | 3482v.com | WWW.509684.COM | 7893w27.com | WWW.881984.COM | www.c155e.com | www.426689.com | www.04567y.com | www.202341.com | www.55545j.com | www.351731.com | www.l3065.com | www.320663.com | www.800544.com | www.37337.com | www.d4.com | 858448.com | www.065915.com | bo9.vip | www.61268888.com | 87665t.com | www.pkfc8.com | 3640.com | WWW.663564.COM | a757033.com | WWW.169036.COM | www.680588.com | 883399y.com | www.00840j.com | 8159d.cc | WWW.577388.COM | yk105.com | www.550247.com | www.xpj8819.com | 55899h.com | www.2934x.com | 3559666.cc | WWW.313529.COM | 5429d.com | www.196702.com | www.00797a.com | xj001c.com | WWW.107586.COM | www.n4042.com | www.50051o.com | www.52072d.com | 3566bb.com | www.985579.com | www.7920x.com | 1294u.com | WWW.714188.COM | www.cp0016.com | 55545z.com | www.5xag.com | emr9836.com | www.369499.com | www.sx139975.com | uu67890.com | WWW.495898.COM | www.4809k.com | 1213com.com | WWW.350709.COM | www.1115yl.com | 61328833.com | WWW.611022.COM | www.12136i.com | 4995m.com | WWW.345814.COM | www.2848.com | 5906kk.com | WWW.254765.COM | www.984702.com | wnsr8803.com | www.802190.com | www.pj56l.com | 55967y.com | www.533081.com | www.51876.cc | 131www.net | 1855.com | WWW.255105.COM | www.35252c.com | 1101885.com | WWW.517865.COM | www.5856873.com | 4255jj.com | www.339967.com | www.3479g.com | 0747jj.com | 2349001.com | WWW.231577.COM | www.69989d.com | hg6686.com | www.500710.com | www.055s.cc | 7335c.com | 5855hh.com | WWW.749807.COM | www.0270t.com | 37570.com | 6175d.com | WWW.29718.COM | www.ejylc17.com | weibo.com | www.111146.com | WWW.381807.COM | www.55676s.com | JS1388z.com | qq365x.com | WWW.666637.COM | www.h36524.com | 88851w.com | am2948.com | WWW.152499.COM | www.2221104.com | 500000416.com | 4444sands.com | WWW.345985.COM | www.87096.com | www.799666j.com | 1592.com | www.595601.com | WWW.807413.COM | www.bet63q.com | 3559x.com | www.80199.com | WWW.555483.COM | www.55vn777.com | pp3189.com | 5443ss.com | www.560529.com | WWW.847744.COM | www.38775ii.com | w5050w.com | ly8004.com | www.808466.com | WWW.198292.COM | www.140086.com | 8290c.com | 2613h.com | www.332069.com | WWW.454603.COM | www.bet73z.com | www.138cpc.com | a81570.com | 5678901.com | WWW.752729.COM | www.hr3888.com | www.11pjjt.com | 77990.com | 6175t.com | www.43131g.com | 69441166.com | hg77760.com | WWW.457637.COM | WWW.735611.COM | www.00797c.com | 650pj.com | www.126309.com | www.7249j.com | 3121z.com | 7893w19.com | 1468ddd.com | www.652631.com | WWW.63180.COM | www.696by.com | www.r999991.com | 80892gg.com | 53262k.com | 9694y.com | www.7415ss.com | 1113865.com | 0080q.com | cp885.cc | www.986656.com | WWW.316126.COM | www.2934i.com | www.924924.com | www.178659.com | 8977yy.com | 463t8.com | k1.z6528.com | www.160951.com | WWW.111259.COM | WWW.741366.COM | www.022s.cc | www.86339a.com | 78113366.com | 56822.com | 5651a.com | 81708.com | www.791317.com | WWW.752721.COM | www.26163j.com | www.98488.com | www.50999r.com | LXYL350.com | 7893w2.com | 66300vip32.com | www.196095.com | WWW.213862.COM | WWW.383505.COM | www.3479x.com | www.bmw8044.com | www.b35ee.com | 7196bb.com | bet28b.com | 38238v.com | 3559dddd.com | 182hk.com | www.942677.com | WWW.104799.COM | WWW.818779.COM | WWW.23518.COM | www.43818m.com | www.1434z.com | www.6386c.com | www.77vn777.com | www.klcp005.com | 1213ppp.com | 30007n.com | 2349002.com | 39199o.com | 0615.com | 20t88.com | 3844gg.com | 50067y.com | 4303.com | 4018b.com | 12742u.com | 1489p.com | 8040ggg.com | wns78.com | am2982.com | 91019j.net | k1458.com | x171717.com | bwinccc.com | v3686.com | lj552.com | 0011886.com | 22113885.com | i99345.am | a4255.com | 86811oo.com | 61327733.com | ly88888885.com | 188qq444.com | 918tx.com | 9679p.com | 111ctx.com | 9694q.com | 9737oo.me | 2613z.com | www.f4042.com | www.90305b.com | www.26123kk.com | www.06820i.com | www.y6098.com | www.b94600.com | www.16065r.com | www.71399l.com | www.2109z.com | WWW.333287.COM | www.c30666.vip | www.jj55826.com | www.55070f.com | www.w84e.com | 22kk8332.com | 0747t.com | 3938722.com | 3534h.com | 8fll8.com | haobocaiwang.net | gh7107.com | 1104028.com | 3121g.com | 8037jj.com | feicai0571.com | 111hg.com | www.55070g.com | www.12345603.cc | www.?junzi8888.com | www.08992.com | WWW.800795.COM | www.1764m.com | www.71233x.com | WWW.29937.COM | WWW.718478.COM | WWW.47374.COM | www.775701.com | www.113399.net | 58335.com | vip268268.com | ggg7570.com | www.5360ss.com | www.6386a.com | www.87668d.com | WWW.666199.COM | WWW.366445.COM | www.920564.com | www.882111.com | 454691.com | 78666z.com | yh888c.com | www.sha3111.com | www.08182.com | WWW.548155.COM | WWW.483886.COM | www.361979.com | 348960.com | 33432k.com | h8381.com | www.4963z.com | www.5859118.com | WWW.53844.COM | WWW.362369.COM | www.216299.com | 61789l.com | y088.cc | www.163a55.com | www.633547.com | WWW.62662.COM | WWW.235066.COM | 760ss.cc | 1458i.com | yin3333.com | www.1841222.com | www.hr5888.com | WWW.437887.COM | www.80075i.com | ttt444000.com | wx789.com | www.20000.cc | www.070.la | WWW.830513.COM | 146333.com | 159666h.com | 06dd.cc | www.9484.com | WWW.854877.COM | WWW.52768.COM | 259009.com | 30688y.com | www.55545l.com | www.34788r.com | WWW.350928.COM | 276666.com | 61772222.com | 87665n.com | www.3775k.com | 44999193.com | 3258z.com | www.68993272.com | WWW.345427.COM | www.338052.com | 18438m.com | 32424h.com | www.zmfqp.com | WWW.16405.COM | www.666637.com | 3807q.com | www.38138q.com | www.az0908.com | www.bxcp66.com | 78113399.com | mm2205.com | www.pj99n.com | WWW.456065.COM | www.108382.com | 7380jj.com | www.5446aa.com | www.ac9911.com | www.901021.com | ddh5152.com | 4812z.com | www.07163l.com | WWW.130351.COM | 9694r.com | 9030b.com | www.50080m.com | WWW.610802.COM | 80567s.com | 20772200.com | www.01063.com | www.931518.com | www.kc66.com | www.848266.com |