Mryqu's Notes


  • 首页

  • 搜索
close

[Hadoop] check FSDataInputStream and its wrapped InputStream implementation

时间: 2015-05-01   |   分类: BigData     |   阅读: 114 字 ~1分钟

打开一个HDFS文件,获得一个FSDataInputStream对象,其实现类到底是什么?小小探究一下。

package com.yqu.hadoop;

import java.io.IOException;
import java.io.InputStream;

import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FSDataInputStream;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;

public class LearnFS {

  public static void main(String[] args) {
    Configuration config = new Configuration();
    FSDataInputStream in = null;
    Path path = new Path("/user/hadoop/input/access_log.txt");

    try {
      FileSystem fs = FileSystem.get(config);
      System.out.println("Scheme: " + fs.getScheme());
      System.out.println("Uri: " + fs.getUri().toString());
      in = fs.open(path);
      if (in != null) {
        System.out.println("FSDataInputStream impl:"
            + in.getClass().getCanonicalName());
        InputStream is = in.getWrappedStream();
        if (is != null) {
          System.out.println("InputStream impl:"
              + is.getClass().getCanonicalName());
        }
      }

    } catch (Throwable t) {
      t.printStackTrace();
    } finally {
      if (in != null) {
        try {
          in.close();
        } catch (IOException e) {
          // TODO Auto-generated catch block
          e.printStackTrace();
        }
      }
    }
  }
}

测试结果是org.apache.hadoop.hdfs.client.HdfsDataInputStream和org.apache.hadoop.hdfs.DFSInputStream: [Hadoop] check FSDataInputStream and its wrapped InputStream implementation

标题:[Hadoop] check FSDataInputStream and its wrapped InputStream implementation
作者:mryqu
声明: 本博客所有文章除特别声明外,均采用 CC BY-NC-SA 3.0 CN 许可协议。转载请注明出处!

#hadoop# #hdfs# #hdfsdatainputstream# #dfsinputstream#
非技术视角八卦一下docker
[Hadoop] 安装Hadoop 2.7.x 集群
  • 文章目录
  • 站点概览

Programmer & Architect

662 日志
27 分类
1472 标签
GitHub Twitter FB Page
© 2009 - 2023 Mryqu's Notes
Powered by - Hugo v0.120.4
Theme by - NexT
0%