【问题标题】:Is there a way to append year part to the syslogs in logstash有没有办法将年份部分附加到 logstash 中的系统日志
【发布时间】:2019-09-04 09:34:42
【问题描述】:

我是 ELK 堆栈的新手。目前正在处理以下形式的系统日志:

Apr 26 12:20:02 localhost systemd[1]: Starting system activity accounting tool...

使用的grok模式如下:

        grok {
            match => {
                "message" => [
                   "%{SYSLOGTIMESTAMP:syslog_date}\s+%{DATA:node}\s+%{DATA:component_name}\[%{NUMBER:pid}\]\:\s+%{GREEDYDATA:log_message}"]

我需要以下面的格式解析这些日志 kibana,并在 syslog_date 后面加上当前年份。

当前格式:

  "log_message" => "Starting system activity accounting tool...",
  "@timestamp" => August 28th 2019, 23:49:53.014,
  "node"        => "localhost",
  "@version"   => "1",
  "host"       => "localhost.localdomain",
  "pid"        => "1",
  "message"    => "Apr 26 12:20:02 localhost systemd[1]: Starting system activity accounting tool...",
  "type"       => "stdin",
  "component_name"  => "systemd",
  "SYSLOGTIMESTAMP:syslog_date"  => "Apr 26 12:20:02"
}

要求格式:

  "log_message" => "Starting system activity accounting tool...",
  "@timestamp" => August 28th 2019, 23:49:53.014,
  "node"        => "localhost",
  "@version"   => "1",
  "host"       => "localhost.localdomain",
  "pid"        => "1",
  "message"    => "Apr 26 12:20:02 localhost systemd[1]: Starting system activity accounting tool...",
  "type"       => "stdin",
  "component_name"  => "systemd",
  "SYSLOGTIMESTAMP:syslog_date"  => "Apr 26 2019 12:20:02"
}

有人可以帮忙吗?或任何其他可以满足这种情况的方式

【问题讨论】:

    标签: elasticsearch logstash-grok logstash-configuration


    【解决方案1】:

    您可以根据logstash中的@timestamp字段添加“当前”年份

    mutate { add_field => { "dateWithYear" => "%{[syslog_date]} %{+YYYY}" } }
    

    但是,有时(12 月 31 日午夜之后)会出现错误的年份。日期过滤器对此有some handling,并且已经讨论过changing

    【讨论】:

    • 它只做了一些改动:``` mutate { add_field => { "dateWithYear" => "%{syslog_date} %{+YYYY}" } }
    • 是的,这是我已修复的复制和粘贴错误。
    猜你喜欢
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2021-11-02
    • 1970-01-01
    • 2011-07-01
    • 2022-01-14
    • 1970-01-01
    相关资源
    最近更新 更多