[HD] Hadoop开源环境搭建(集群模式):8.Sqoop

常用的华为FusionInsight C60U10中各组件的版本,以此作为兼容参考:

HDFS:2.7.2
Hive:1.3.0
HBase:1.0.2
Spark:1.5.1
Solr:5.3.1
Flume:1.6.0
Kafka:2.10-0.10.0.0
Storm:0.10.0
Hue:3.9.0
Redis:3.0.5

本文配置:Redhat6.5、JDK-jdk1.7.0_79 、Hadoop-hadoop-2.7.3、zookeeper-3.4.8、hbase-1.2.4-bin、apache-hive-2.1.1、sqoop-1.99.7

 

详细步骤如下

1.下载和解压

tar zxvf sqoop-1.99.7-bin-hadoop200.tar.gz
mv sqoop-1.99.7-bin-hadoop200 sqoop-1.99.7

2.修改环境参数 vi .bash_profile(如有root可改/etc/profile)

export SQOOP_HOME=/home/hadoop/BigData/sqoop-1.99.7
export PATH=$SQOOP_HOME/bin:$SQOOP_HOME/server/bin:$PATH
export LOGDIR=$SQOOP_HOME/logs

 

3.修改sqoop参数
Step1.修改文件 vi /home/hadoop/BigData/sqoop-1.99.7/conf/sqoop.properties,参考如下

# Hadoop configuration directory
org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/home/hadoop/hadoop-2.7.3/etc/hadoop

 

4.启动sqoop

$ cd /home/hadoop/BigData/sqoop-1.99.7/bin
$ sh sqoop.sh serve start
$ sh sqoop.sh client #客户端
sqoop:000> show version --all
client version:
 Sqoop 1.99.7 source revision 435d5e61b922a32d7bce567fe5fb1a9c0d9b1bbb 
 Compiled by abefine on Tue Jul 19 16:08:27 PDT 2016
server version:
 Sqoop 1.99.7 source revision 435d5e61b922a32d7bce567fe5fb1a9c0d9b1bbb 
 Compiled by abefine on Tue Jul 19 16:08:27 PDT 2016
API versions:
 [v1]
sqoop:000> set server --host HMaster --port 12000 -webapp sqoop
Server is set successfully

 

 

分类上一篇:无,已是最新文章    分类下一篇:

Leave a Reply