Syslog listener fails to parse log format from README

[xrl]

I am running the NGINX, Inc kubernetes helm chart (not the community NGINX). NGINX version 1.23.1.

I am configuring the main nginx.conf like this:

  config:
    entries:
      http-snippets: |
        log_format proxy_backend "$remote_addr - $remote_user [$time_local] \"$request\" $status $body_bytes_sent \"$http_referer\" \"$http_user_agent\" \"$http_x_forwarded_for\"";
        access_log syslog:server=127.0.0.1:5531,facility=local7,tag=nginx,severity=info proxy_backend;

and I have confirmed with the udp dump dummy container eexit/dumudp-server:1.1.0 that the log lines are coming in, for example:

127.0.0.1:39527 >>> <190>Nov 17 00:42:23 nginx-nginx-ingress-69f4ccb6-dvffx nginx: 3.120.248.28 - - [17/Nov/2022:00:42:23 +0000] "GET /_health/?full HTTP/1.1" 200 106 "-" "curl/7.79.1" "-"

but when I run with the nginxlog exporter with this config file:

apiVersion: v1
kind: ConfigMap
metadata:
  name: exporter-config
data:
  config.hcl: |
    listen {
      port = 4040
    }

    namespace "nginx" {
      print_log = true
      
      source = {
        syslog {
          listen_address = "udp://127.0.0.1:5531"
          format = "rfc3164"
          tags = [
            "ingress"
          ]
        } 
      }
    
      format="$remote_addr - $remote_user [$time_local] \"$request\" $status $body_bytes_sent \"$http_referer\" \"$http_user_agent\" \"$http_x_forwarded_for\""
    
      labels {
        app = "ingress"
      }
    }

I see this in the sidecars stdout:

 % k logs nginx-nginx-ingress-78f44897c7-2d7vz -c exporter
loading configuration file /etc/prometheus-nginxlog-exporter/config.hcl
using configuration {Listen:{Port:4040 Address:0.0.0.0 MetricsEndpoint:/metrics} Consul:{Enable:false Address: Datacenter: Scheme: Token: Service:{ID: Name: Address: Tags:[]}} Namespaces:[{Name:nginx NamespaceLabelName: NamespaceLabels:map[] MetricsOverride:<nil> NamespacePrefix: SourceFiles:[] SourceData:{Files:[] Syslog:0xc0000c8380} Parser: Format:$remote_addr - $remote_user [$time_local] "$request" $status $body_bytes_sent "$http_referer" "$http_user_agent" "$http_x_forwarded_for" Labels:map[app:ingress] RelabelConfigs:[] HistogramBuckets:[] PrintLog:true OrderedLabelNames:[] OrderedLabelValues:[]}] EnableExperimentalFeatures:false EnableExperimentalFeaturesOld:false}
starting listener for namespace nginx
running HTTP server on address 0.0.0.0:4040, serving metrics at /metrics
running Syslog server on address udp://127.0.0.1:5531

and no further output even though I set printlog.

And the metrics are empty:

% k exec -it -c nginx-nginx-ingress $(kubectl get pods -o name | head -n 1) -- curl http://localhost:4040/metrics
# HELP nginx_parse_errors_total Total number of log file lines that could not be parsed
# TYPE nginx_parse_errors_total counter
nginx_parse_errors_total 0
# HELP prometheus_nginxlog_exporter_build_info A metric with a constant '1' value labeled by version, revision, branch, and goversion from which prometheus_nginxlog_exporter was built.
# TYPE prometheus_nginxlog_exporter_build_info gauge
prometheus_nginxlog_exporter_build_info{branch="v1.10.0",goversion="go1.18.6",revision="9274be256a47378a9930164023d16e1958e96292",version="1.10.0"} 1

How do I configure the sidecar to start counting things?

[xrl]

I got what I wanted with a new little UDP daemon. It does require a more complex JSON output format but it works for my needs. No fancy config file execution system.

Check out the project: https://github.com/tureus/nginx-log-to-prometheus