【问题标题】:Export hive data to oracle using sqoop使用 sqoop 将 hive 数据导出到 oracle
【发布时间】:2014-09-24 13:16:41
【问题描述】:

我试图在 kerberos 集群上使用 sqoop 将 hive/hdfs 数据导出到 oracle,但无法提交作业,我不知道为什么。

我收到以下错误:

2014-09-23 11:11:05 IST: FAILURE_ON_SUBMIT
Exception: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Authorization (hadoop.security.authorization) is enabled but authentication (hadoop.security.authentication) is configured as simple. Please configure another method like kerberos or digest.
Stack trace: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.Acc essControlException): Authorization (hadoop.security.authorization) is enabled but authentication (hadoop.security.authentication) is configured as simple. Please configure another method like kerberos or digest.
        at org.apache.hadoop.ipc.Client.call(Client.java:1238)
        at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:225)
        at org.apache.hadoop.mapred.$Proxy13.getStagingAreaDir(Unknown Source)
        at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
        at org.apache.hadoop.mapred.$Proxy13.getStagingAreaDir(Unknown Source)
        at org.apache.hadoop.mapred.JobClient.getStagingAreaDir(JobClient.java:1366)

【问题讨论】:

    标签: hive kerberos sqoop sqoop2


    【解决方案1】:

    我认为您需要使用 kinit 对 Kerberos 进行身份验证。此外,您还需要在 hive-site.xml 中为 Kerberos 进行一些配置。有关这些配置,请参阅这些 linkthese

    【讨论】:

      猜你喜欢
      • 2016-10-08
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      相关资源
      最近更新 更多