【问题标题】:Comprehensive reference to sqoop.properties with version综合参考 sqoop.properties 和版本
【发布时间】:2016-02-03 21:47:49
【问题描述】:

我正在寻找对 sqoop.properties 的引用,其中解释了有关每个属性的详细信息。这个sqoop.properties file on github 很好。有没有其他参考?我无法在我们的安装中隔离此文件。我们目前只使用一个属性:

jdbc.transaction.isolation=TRANSACTION_READ_UNCOMMITTED

【问题讨论】:

    标签: hadoop jdbc properties sqoop


    【解决方案1】:
    #
    # Licensed to the Apache Software Foundation (ASF) under one or more
    # contributor license agreements.  See the NOTICE file distributed with
    # this work for additional information regarding copyright ownership.
    # The ASF licenses this file to You under the Apache License, Version 2.0
    # (the "License"); you may not use this file except in compliance with
    # the License.  You may obtain a copy of the License at
    #
    #     http://www.apache.org/licenses/LICENSE-2.0
    #
    # Unless required by applicable law or agreed to in writing, software
    # distributed under the License is distributed on an "AS IS" BASIS,
    # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    # See the License for the specific language governing permissions and
    # limitations under the License.
    #
    
    #
    # Sqoop configuration file used by the built in configuration
    # provider: org.apache.sqoop.core.PropertiesConfigurationProvider.
    # This file must reside in the system configuration directory
    # which is specified by the system property "sqoop.config.dir"
    # and must be called sqoop.properties.
    #
    
    #
    # Logging Configuration
    # Any property that starts with the prefix
    # org.apache.sqoop.log4j is parsed out by the configuration
    # system and passed to the log4j subsystem. This allows you
    # to specify log4j configuration properties from within the
    # Sqoop configuration.
    #
    org.apache.sqoop.log4j.appender.file=org.apache.log4j.RollingFileAppender
    org.apache.sqoop.log4j.appender.file.File=/var/log/sqoop/sqoop.log
    org.apache.sqoop.log4j.appender.file.MaxFileSize=25MB
    org.apache.sqoop.log4j.appender.file.MaxBackupIndex=5
    org.apache.sqoop.log4j.appender.file.layout=org.apache.log4j.PatternLayout
    org.apache.sqoop.log4j.appender.file.layout.ConversionPattern=%d{ISO8601} %-5p %c{2} [%l] %m%n
    org.apache.sqoop.log4j.debug=true
    org.apache.sqoop.log4j.rootCategory=WARN, file
    org.apache.sqoop.log4j.category.org.apache.sqoop=DEBUG
    org.apache.sqoop.log4j.category.org.apache.derby=INFO
    
    #
    # Repository configuration
    # The Repository subsystem provides the special prefix which
    # is "org.apache.sqoop.repository.sysprop". Any property that
    # is specified with this prefix is parsed out and set as a
    # system property. For example, if the built in Derby repository
    # is being used, the sysprop prefixed proeprties can be used
    # to affect Derby configuration at startup time by setting
    # the appropriate system properties.
    #
    
    # Repository provider
    org.apache.sqoop.repository.provider=org.apache.sqoop.repository.JdbcRepositoryProvider
    
    # JDBC repository provider configuration
    org.apache.sqoop.repository.jdbc.handler=org.apache.sqoop.repository.derby.DerbyRepositoryHandler
    org.apache.sqoop.repository.jdbc.transaction.isolation=READ_COMMITTED
    org.apache.sqoop.repository.jdbc.maximum.connections=10
    org.apache.sqoop.repository.jdbc.url=jdbc:derby:/var/lib/sqoop/repository/db;create=true
    org.apache.sqoop.repository.jdbc.create.schema=true
    org.apache.sqoop.repository.jdbc.driver=org.apache.derby.jdbc.EmbeddedDriver
    org.apache.sqoop.repository.jdbc.user=sa
    org.apache.sqoop.repository.jdbc.password=
    
    # System properties for embedded Derby configuration
    org.apache.sqoop.repository.sysprop.derby.stream.error.file=/var/log/sqoop/derbyrepo.log
    
    # Sleeping period for reloading configuration file (once a minute)
    org.apache.sqoop.core.configuration.provider.properties.sleep=60000
    
    #
    # Submission engine configuration
    #
    
    # Submission engine class
    org.apache.sqoop.submission.engine=org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine
    
    # Number of milliseconds, submissions created before this limit will be removed, default is one day
    #org.apache.sqoop.submission.purge.threshold=
    
    # Number of milliseconds for purge thread to sleep, by default one day
    #org.apache.sqoop.submission.purge.sleep=
    
    # Number of milliseconds for update thread to sleep, by default 5 minutes
    #org.apache.sqoop.submission.update.sleep=
    
    #
    # Configuration for Mapreduce submission engine (applicable if it's configured)
    #
    
    # Hadoop configuration directory
    org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/etc/hadoop/conf/
    
    #
    # Execution engine configuration
    #
    org.apache.sqoop.execution.engine=org.apache.sqoop.execution.mapreduce.MapreduceExecutionEngine
    

    【讨论】:

    • ​​​​​​​​​​​​​​不要把你的答案或代码的链接,最好在这里包括答案的基本部分,并提供链接供参考。如果链接页面发生更改,仅链接的答案可能会失效。
    猜你喜欢
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2023-03-27
    • 1970-01-01
    • 1970-01-01
    • 2015-04-25
    • 1970-01-01
    相关资源
    最近更新 更多