使用spark查询hive表时,报错如下:

20/03/23 11:24:10 INFO StateStoreCoordinatorRef: Registered StateStoreCoordinator endpoint
Error in query: Table or view not found: bili_manga.homepage_mangacard_user_norm_onehot; line 19 pos 6
20/03/23 11:24:11 INFO SparkUI: Stopped Spark web UI at http://xxx:10005
20/03/23 11:24:11 INFO YarnClientSchedulerBackend: Interrupting monitor thread
20/03/23 11:24:12 INFO YarnClientSchedulerBackend: Shutting down all executors
20/03/23 11:24:12 INFO YarnSchedulerBackend$YarnDriverEndpoint: Asking each executor to shut down
20/03/23 11:24:12 INFO SchedulerExtensionServices: Stopping SchedulerExtensionServices
(serviceOption=None,
 services=List(),

但是使用hive引擎查询表存在且有结果的,$SPARK_HOME/conf下 也已经存放hive-site.xml文件。

查询sql部分如下

  LEFT JOIN (
    SELECT
      *
    FROM
      `bili_manga`.`homepage_mangacard_item_norm_onehot`
    WHERE
      dt = "<%=log_date-1%>"
  ) c ON a.manga_id = c.item_id
  LEFT JOIN (
    SELECT

将反引号去掉即可正常查询。

相关文章:

  • 2022-12-23
  • 2021-10-01
  • 2022-12-23
  • 2022-12-23
  • 2021-07-09
  • 2022-01-30
  • 2022-12-23
  • 2022-01-28
猜你喜欢
  • 2021-09-15
  • 2021-12-11
  • 2021-04-20
  • 2022-01-23
  • 2022-12-23
  • 2022-12-23
  • 2022-12-23
相关资源
相似解决方案