【问题标题】:Spring Batch file headerSpring Batch 文件头
【发布时间】:2019-08-01 19:04:36
【问题描述】:

我有一个如下所示的标题:

// Writer
    @Bean(name = "cms200Writer")
    @StepScope
    public FlatFileItemWriter<Cms200Item> cmsWriter(@Value("#{jobExecutionContext}") Map<Object, Object> ec, //
            @Qualifier("cms200LineAggregator") FormatterLineAggregator<Cms200Item> lineAgg) throws IOException {
        @SuppressWarnings("unchecked")
        String fileName = ((Map<String, MccFtpFile>) ec.get(AbstractSetupTasklet.BATCH_FTP_FILES)).get("cms").getLocalFile();
        //Ensure the file can exist.
        PrintWriter fos = getIoHarness().getFileOutputStream(fileName);
        fos.close();
        FlatFileItemWriter<Cms200Item> writer = new FlatFileItemWriter<>();
        writer.setResource(new FileSystemResource(fileName));
        writer.setLineAggregator(lineAgg);
        Calendar cal = Calendar.getInstance();
        Date date = cal.getTime();
        DateFormat dateFormat = new SimpleDateFormat("HH:mm:ss");
        String formattedDate=dateFormat.format(date);
        writer.setHeaderCallback(new FlatFileHeaderCallback() {
            public void writeHeader(Writer writer) throws IOException  {
                writer.write("                                            Test Company.                                                           " + formattedDate);
                writer.write("\n  CMS200                  CUSTOMER SHIPMENT MANIFEST AUTHORIZATION BY CUSTOMER NAME                                        Page 1");
                writer.write("\n\n");
                writer.write("      CUSTOMER  NAME          CITY        ST  CONTROL  MNFST ID  AUTH CODE   I03  CLS  EDI  EXPRESS   POV     MOST CURRENT  DEACTIVE");
                writer.write("\n");
                writer.write("                                                NBR                               TRL  214   WORK                ACCESS       DATE  ");
            }
        });
        return writer;
    }

我想在每次处理 53 条记录时打印此标题。我不知道如何在我的 Spring Batch 作业中实现该逻辑。我已将 writeCount 添加到我的执行上下文中,但不确定如何在此处访问它,或者这是否是正确的方法。

我发布的作者在我的 BatchConfiguration.java 文件中

编辑:

下面我有我的文件步骤并添加了块大小

@Bean(name = "cms200FileStep")
    public Step createFileStep(StepBuilderFactory stepFactory, //
            @Qualifier("cms200Reader") ItemReader<Cms200Item> reader, //
            Cms200Processor processor, //
            @Qualifier("cms200Writer") ItemWriter<Cms200Item> writer) {
        return stepFactory.get("cms200FileStep") //
                .<Cms200Item, Cms200Item>chunk(100000) //
                .reader(reader) //
                .processor(processor) //
                .writer(writer).chunk(53) //
                .allowStartIfComplete(true)//
                .build();//
    }

编辑:添加作业配置

// Job
    @Bean(name = "mccCMSCLRPTjob")
    public Job mccCmsclrptjob(JobBuilderFactory jobFactory, //
            @Qualifier("cms200SetupStep") Step setupStep, //
            @Qualifier("cms200FileStep") Step fileStep, //
            @Qualifier("putFtpFilesStep") Step putFtpStep, //
            @Qualifier("cms200TeardownStep") Step teardownStep, //
            @Autowired SingleInstanceListener listener,
            @Autowired ChunkSizeListener chunkListener) { //
        return jobFactory.get("mccCMSCLRPTjob") //
                .incrementer(new RunIdIncrementer()) //
                .listener(listener) //
                .start(setupStep) //
                .next(fileStep) //
                .next(putFtpStep) //
                .next(teardownStep) //
                .build();
    }

编辑:添加监听器

   @Bean(name = "cms200FileStep")
        public Step createFileStep(StepBuilderFactory stepFactory, //
                @Qualifier("cms200Reader") ItemReader<Cms200Item> reader, //
                Cms200Processor processor, //
                @Qualifier("cms200Writer") ItemWriter<Cms200Item> writer,
                @Autowired ChunkSizeListener listener) {
            return stepFactory.get("cms200FileStep") //
                    .<Cms200Item, Cms200Item>chunk(100000) //
                    .reader(reader) //
                    .processor(processor) //
                    .writer(writer).chunk(53) //
                    .allowStartIfComplete(true)//
                    .listener(listener) //
                    .build();//
        }

编辑:经过多次来回,这就是我所在的位置

    // Utility Methods
    @Bean(name = "cms200FileStep")
    public Step createFileStep(StepBuilderFactory stepFactory, Map<Object, Object> ec, //
            @Qualifier("cms200Reader") ItemReader<Cms200Item> reader, //
            Cms200Processor processor, //
            @Qualifier("cms200Writer") ItemWriter<Cms200Item> writer) throws IOException {
        @SuppressWarnings("unchecked")
        String fileName = ((Map<String, MccFtpFile>) ec.get(AbstractSetupTasklet.BATCH_FTP_FILES)).get("cms").getLocalFile();
        return stepFactory.get("cms200FileStep") //
                .<Cms200Item, Cms200Item>chunk(100000) //
                .reader(reader) //
                .processor(processor) //
                .writer(writer).chunk(53) //
                .allowStartIfComplete(true)//
//                .listener((ChunkListener) listener) //
                .listener((ChunkListener) new ChunkSizeListener(new File(fileName))) //
                .build();//
    }

【问题讨论】:

  • 尝试在 afterStep() 中调用 writeHeader 方法并检查 writeCount()。但我想这只能在处理完所有行之后才能完成。或者您可以在 StepExecution 中将前 53 条记录拆分为单独的任务。
  • 我可以尝试一下 - 我更新了我的原始帖子以展示我的整个作者。这还能用吗?

标签: spring spring-batch flat-file


【解决方案1】:

FlatFileHeaderCallback 在面向块的步骤之前只被调用一次,也就是在所有块之前。

我想在每次处理 53 条记录时打印此标题

您可以将块大小设置为 53,并使用ChunkListenerItemWriteListener 写入所需的数据。

编辑:添加示例

class MyChunkListener extends StepListenerSupport {

    private FileWriter fileWriter;

    public MyChunkListener(File file) throws IOException {
        this.fileWriter = new FileWriter(file, true);
    }

    @Override
    public void beforeChunk(ChunkContext context) {
        try {
            fileWriter.write("your custom header");
            fileWriter.flush();
        } catch (IOException e) {
            System.err.println("Unable to write header to file");
        }
    }

    @Override
    public ExitStatus afterStep(StepExecution stepExecution) {
        try {
            fileWriter.close();
        } catch (IOException e) {
            System.err.println("Unable to close writer");
        }
        return super.afterStep(stepExecution);
    }
}

【讨论】:

猜你喜欢
  • 2015-10-27
  • 2016-06-29
  • 1970-01-01
  • 2018-08-06
  • 2014-01-21
  • 1970-01-01
  • 1970-01-01
  • 1970-01-01
  • 2014-02-24
相关资源
最近更新 更多