1 / 11

Hadoop 技术体系在车联网领域的应用实践

Hadoop 技术体系在车联网领域的应用实践. 车联网与 H adoop 应用于车联网业务的 H dfs 用于地理分析的 M ap R educe 实时读写相关的 HB ase功能. 车联网与Hadoop. 网关集群. 业务模块. 车机终端. 存储集群. 车机终端. 车机终端. 车机终端. 车机终端. 车联网与Hadoop. 车辆数量众多 1200万辆营运车辆 客车170万辆 货车超过1000万辆 95%为个体和挂靠 事故率较高 87%的重大交通事故与营运车辆有关 多数由超载、超速和疲劳驾驶引起 利用率偏低 货车平均空置率我国27%欧美7%

margot
Download Presentation

Hadoop 技术体系在车联网领域的应用实践

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hadoop技术体系在车联网领域的应用实践

  2. 车联网与Hadoop • 应用于车联网业务的Hdfs • 用于地理分析的MapReduce • 实时读写相关的HBase功能

  3. 车联网与Hadoop 网关集群 业务模块 车机终端 存储集群 车机终端 车机终端 车机终端 车机终端

  4. 车联网与Hadoop • 车辆数量众多 • 1200万辆营运车辆 • 客车170万辆 • 货车超过1000万辆 • 95%为个体和挂靠 • 事故率较高 • 87%的重大交通事故与营运车辆有关 • 多数由超载、超速和疲劳驾驶引起 • 利用率偏低 • 货车平均空置率我国27%欧美7% • 牵引车与挂车之比 我国1:1.14 欧美1:3

  5. 车联网与Hadoop Scribe 网关 解析模块 预处理 HDFS HBase Kafka

  6. 应用于车联网业务的Hdfs • 存储所有动态数据 • Hadoop1.0.4版本，NameNode存在单点故障的风险 • Pacemaker+Cman+DRBD实现NameNode的HA

  7. 用于地理分析的MapReduce

  8. 用于地理分析的MapReduce • gridid:point 与 gridid:line • SortComparator • v1.toString().compareTo(v2.toString()); • Partitioner • v1.toString().compareTo(v2.toString()); • GroupingComparator • v1.toString().split(":")[0].compareTo(v2.toString().split(":")[0])

  9. 实时读写相关的HBase功能 • 轨迹类数据 • vid_time:ColumnFamily • 记录类数据 • vid_(10^14-time):ColumnFamily • rowkey优化 • byte[24]，[0-15]为vid的md5，[16-23]为time的byte形态

  10. 实时读写相关的HBase功能 • GeoHash • (116.3906,39.92324)编码 11100 11101 00100 01111 00000 01101 01011 00001,GeoHash:wx4g0ec1

  11. 聚活动、看直播、下资料

More Related