【发布时间】：2021-01-12 01:22:33
【问题描述】：
我的作业的第一步是计算源数据库和目标数据库中的行数，因此我可以在作业执行期间显示实时进度监视器（这可能需要几天时间）。
由于我输入的特殊性，提供作业的表列表可能与两个数据库中实际存在的表列表不对应（我的输入可能包含数据库中不存在的表）。由于大多数列表应该与数据库中存在的表匹配，因此我想使用容错步骤来处理这个问题。
我认为在这个问题的上下文中最重要的代码片段如下：
（步骤创建）
@Bean( "partitionedSourceRowsCounterStep" )
public Step partitionedSourceRowsCounterStep( @Qualifier( "sourceRowCounterStep" ) Step rowCounterStep,
@Qualifier( "parallelTasksExecutor" ) TaskExecutor taskExecutor ) {
return stepBuilderFactory
.get( "partitionedSourceRowsCounterStep" )
.partitioner( "sourceRowCounterStep", new RowsCounterPartitioner(
this.model.getEntityNames() ) )
.step( rowCounterStep )
.taskExecutor( taskExecutor )
.build();
}
@Bean( "sourceRowCounterStep" )
public Step rowCounterStep( SourceRowsCounterReader reader,
SourceRowsCounterInMemoryWriter writer,
@Qualifier( "parallelTasksExecutor" ) TaskExecutor taskExecutor ) {
return stepBuilderFactory
.get( "sourceRowCounterStep" )
.<Map<String, Object>, Map<String, Object>>chunk( this.config.getChunkSize() )
.reader( reader )
.writer( writer )
.faultTolerant()
.skipPolicy( new SkipPolicy() {
@Override
public boolean shouldSkip( Throwable t, int skipCount ) throws SkipLimitExceededException {
System.out.println( "SKIP_POLICY WAS CALLED" );
return false;
}
} )
.taskExecutor( taskExecutor )
.throttleLimit( 1 )
.build();
}
（行计数器阅读器）
@StepScope
@Slf4j
@Component
public class SourceRowsCounterReader extends AbstractCursorItemReader<Map<String, Object>> {
@Override
protected void openCursor( Connection con ) {
try {
String sql = getSql();
log.debug( "Query string: '" + sql + "'" );
if( isUseSharedExtendedConnection() ) {
preparedStatement = con.prepareStatement( sql, ResultSet.TYPE_FORWARD_ONLY, ResultSet.CONCUR_READ_ONLY, ResultSet.HOLD_CURSORS_OVER_COMMIT );
} else {
preparedStatement = con.prepareStatement( sql, ResultSet.TYPE_FORWARD_ONLY, ResultSet.CONCUR_READ_ONLY );
}
applyStatementSettings( preparedStatement );
if( this.preparedStatementSetter != null ) {
preparedStatementSetter.setValues( preparedStatement );
}
this.rs = preparedStatement.executeQuery(); // Exception happens here!
handleWarnings( preparedStatement );
} catch( SQLException se ) {
close();
throw getExceptionTranslator().translate("Executing query", getSql(), se);
}
}
@Override
protected SQLExceptionTranslator getExceptionTranslator() {
return this.customExceptionTranslator;
}
}
但是，当代码运行时出现错误：
org.springframework.batch.item.ItemStreamException: Failed to initialize the reader
at org.springframework.batch.item.support.AbstractItemCountingItemStreamItemReader.open(AbstractItemCountingItemStreamItemReader.java:153) ~[spring-batch-infrastructure-4.2.4.RELEASE.jar:4.2.4.RELEASE]
at org.springframework.batch.item.support.AbstractItemCountingItemStreamItemReader$$FastClassBySpringCGLIB$$ebb633d0.invoke(<generated>) ~[spring-batch-infrastructure-4.2.4.RELEASE.jar:4.2.4.RELEASE]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.9.RELEASE.jar:5.2.9.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) ~[spring-aop-5.2.9.RELEASE.jar:5.2.9.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.9.RELEASE.jar:5.2.9.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) ~[spring-aop-5.2.9.RELEASE.jar:5.2.9.RELEASE]
at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:136) ~[spring-aop-5.2.9.RELEASE.jar:5.2.9.RELEASE]
at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:124) ~[spring-aop-5.2.9.RELEASE.jar:5.2.9.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.9.RELEASE.jar:5.2.9.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) ~[spring-aop-5.2.9.RELEASE.jar:5.2.9.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) ~[spring-aop-5.2.9.RELEASE.jar:5.2.9.RELEASE]
at com.company.steps.SourceRowsCounterReader$$EnhancerBySpringCGLIB$$2dbb98e7.open(<generated>) ~[classes/:na]
at org.springframework.batch.item.support.CompositeItemStream.open(CompositeItemStream.java:103) ~[spring-batch-infrastructure-4.2.4.RELEASE.jar:4.2.4.RELEASE]
at org.springframework.batch.core.step.item.ChunkMonitor.open(ChunkMonitor.java:114) ~[spring-batch-core-4.2.4.RELEASE.jar:4.2.4.RELEASE]
at org.springframework.batch.item.support.CompositeItemStream.open(CompositeItemStream.java:103) ~[spring-batch-infrastructure-4.2.4.RELEASE.jar:4.2.4.RELEASE]
at org.springframework.batch.core.step.tasklet.TaskletStep.open(TaskletStep.java:311) ~[spring-batch-core-4.2.4.RELEASE.jar:4.2.4.RELEASE]
at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:205) ~[spring-batch-core-4.2.4.RELEASE.jar:4.2.4.RELEASE]
at org.springframework.batch.core.partition.support.TaskExecutorPartitionHandler$1.call(TaskExecutorPartitionHandler.java:138) [spring-batch-core-4.2.4.RELEASE.jar:4.2.4.RELEASE]
at org.springframework.batch.core.partition.support.TaskExecutorPartitionHandler$1.call(TaskExecutorPartitionHandler.java:135) [spring-batch-core-4.2.4.RELEASE.jar:4.2.4.RELEASE]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_231]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_231]
Caused by: com.company.steps.jdbc.exception.TableOrViewDoesnExistException: Table doesn't exist; nested exception is java.sql.SQLSyntaxErrorException: ORA-00942: table or view does not exist
at com.company.steps.jdbc.oracle.OracleExceptionTranslator.translate(OracleExceptionTranslator.java:18) ~[classes/:na]
at com.company.steps.SourceRowsCounterReader.openCursor(SourceRowsCounterReader.java:99) ~[classes/:na]
at org.springframework.batch.item.database.AbstractCursorItemReader.doOpen(AbstractCursorItemReader.java:428) ~[spring-batch-infrastructure-4.2.4.RELEASE.jar:4.2.4.RELEASE]
at org.springframework.batch.item.support.AbstractItemCountingItemStreamItemReader.open(AbstractItemCountingItemStreamItemReader.java:150) ~[spring-batch-infrastructure-4.2.4.RELEASE.jar:4.2.4.RELEASE]
... 20 common frames omitted
Caused by: java.sql.SQLSyntaxErrorException: ORA-00942: table or view does not exist
此外，终端中没有打印“SKIP_POLICY WAS CALLED”，即使我由于之前的异常而失败了十几个。
根据docs 异常应该被处理，不管它们被抛出的步骤链的点。
有人可以在这里看到任何错误配置吗？
Spring Boot v2.3.4.RELEASE Spring Batch v4.2.4.RELEASE
【问题讨论】：