Php fpm access log format

nginx / php-fpm error logging

I’m trying to figure out where the PHP errors are going in my setup. I’m running nginx as the reverse proxy to PHP-FPM, but I’m not seeing the various E_NOTICE or E_WARNING messages my app is producing. The only reason I know they’re happening is failed responses and NewRelic catching stack traces. Here’s the logging config: nginx.conf

proxy_intercept_errors on; fastcgi_intercept_errors on; 

error_reporting = E_ALL display_errors = Off display_startup_errors = Off log_errors = On log_errors_max_len = 1024 ignore_repeated_errors = Off ignore_repeated_source = Off report_memleaks = On track_errors = On error_log = syslog 

[global] error_log = /var/log/php-fpm/fpm-error.log [www] access.log = /var/log/php-fpm/access.log access.format = "%t \"%m %r%Q%q\" %s %dms %Mkb %C%%" catch_workers_output = yes php_flag[display_errors] = on php_admin_flag[log_errors] = true 

:syslogtag, contains, "php" /var/log/php-fpm/error.log 

I’ve configured PHP to log to syslog, however FPM has no syslog function so it’s logging to a file. I don’t really care where the errors end up, just that they end up somewhere. Any clues on how I might get this to work?

I would try make errors display first (in a test.php file you could manually trigger an error), then put them in a file and so on. . Could be errors triggered are from cli, thus using a different php.ini

Did you try this? php_admin_value[error_log] = /var/log/php-fpm/www-error.log php_admin_flag[log_errors] = on

4 Answers 4

Your php-fpm.conf file is not set up to send errors to syslog. See below for an example of how to do this.

; Error log file ; If it's set to "syslog", log is sent to syslogd instead of being written ; in a local file. ; Note: the default prefix is /var ; Default Value: log/php-fpm.log error_log = syslog ; syslog_facility is used to specify what type of program is logging the ; message. This lets syslogd specify that messages from different facilities ; will be handled differently. ; See syslog(3) for possible values (ex daemon equiv LOG_DAEMON) ; Default Value: daemon ;syslog.facility = daemon ; syslog_ident is prepended to every message. If you have multiple FPM ; instances running on the same server, you can change the default value ; which must suit common needs. ; Default Value: php-fpm ;syslog.ident = php-fpm ; Log level ; Possible Values: alert, error, warning, notice, debug ; Default Value: notice ;log_level = notice 

Are you sure about your assumption for the rsyslog.conf? That is, are you sure all such syslog messages are tagged with lower-case «php»?

Try setting syslog.facility to something like local2 (or local1, or local7) and replacing your rsyslog.conf config-line accordingly:

local2.* /var/log/php-fpm/error.log 

When you’re using php-fpm, it appears to override the php.ini settings.

The logging most likely needs to be configured in . /www.conf .

I uncommented these lines in order to grab the PHP logs.

php_admin_value[error_log] = /var/log/php-errors.log php_admin_flag[log_errors] = on 

The webserver user and group can also be found in this file under lines similar to this (may differ between unix socket & proxy configuration).

listen.owner = www-data listen.group = www-data 

Then it’s just a matter of creating the file and configuring it properly.

touch /var/log/php-errors.log chmod 644 /var/log/php-errors.log chgrp www-data /var/log/php-errors.log chown www-data /var/log/php-errors.log 

I believe the log level is still used from php-fpm.conf so you may also need to check this.

Thanks. It works. But adding this line log_level = error would cause an error and stop php-fpm from launching. My php-fpm version is 7.2 .

to get php-fpm errors in nginx error log you need:

as for nginx: it s enough just basic config

# cat default | grep -v "#" server < listen 80 default_server; listen [::]:80 default_server; root /var/www/html; index index.html index.htm index.nginx-debian.html; server_name _; index index.html; location / < try_files $uri $uri/ =404; >location ~ \.php$ < include snippets/fastcgi-php.conf; fastcgi_pass unix:/run/php/php7.0-fpm.sock; >> 

as for php-fpm the main setting is

basically it s enough. but to be on the safe side i would suggest to put the following block in php-fpm config(/etc/php/7.0/fpm/php.ini) :

[PHP] . error_reporting = E_ALL & ~E_DEPRECATED & ~E_STRICT display_errors = Off display_startup_errors = On log_errors = On log_errors_max_len = 1024 ignore_repeated_errors = Off ignore_repeated_source = Off report_memleaks = On track_errors = Off html_errors = On . 

after that all php stack traces will be in

# tail /var/log/nginx/error.log 2023/06/20 23:37:06 [error] 20307#20307: *1 FastCGI sent in stderr: "PHP message: PHP Parse error: syntax error, unexpected '"asd"' (T_CONSTANT_ENCAPSED_STRING) in /var/www/html/php1.php on line 2" while reading response header from upstream, client: 127.0.0.1, server: _, request: "GET /php1.php HTTP/1.1", upstream: "fastcgi://unix:/run/php/php7.0-fpm.sock:", host: "localhost" 2023/06/20 23:48:40 [error] 20307#20307: *5 FastCGI sent in stderr: "PHP message: PHP Parse error: syntax error, unexpected '"asd"' (T_CONSTANT_ENCAPSED_STRING) in /var/www/html/php1.php on line 2" while reading response header from upstream, client: 127.0.0.1, server: _, request: "GET /php1.php HTTP/1.1", upstream: "fastcgi://unix:/run/php/php7.0-fpm.sock:", host: "localhost" 2023/06/21 00:18:17 [error] 20307#20307: *7 FastCGI sent in stderr: "PHP message: PHP Parse error: syntax error, unexpected '"asd"' (T_CONSTANT_ENCAPSED_STRING) in /var/www/html/php1.php on line 2" while reading response header from upstream, client: 127.0.0.1, server: _, request: "GET /php1.php HTTP/1.1", upstream: "fastcgi://unix:/run/php/php7.0-fpm.sock:", host: "localhost:4545" 

if you want to see php stack traces not in nginx erorr file but instead in a separate file you need to add error_log setting that is

error_reporting = E_ALL & ~E_DEPRECATED & ~E_STRICT display_errors = Off display_startup_errors = On log_errors = On error_log = /var/log/php-errors.log log_errors_max_len = 1024 ignore_repeated_errors = Off ignore_repeated_source = Off report_memleaks = On track_errors = Off html_errors = On 

also very important to create /var/log/php-errors.log manually and set proper permisssions because php-fpm wont do that and will continue to transfer error to nginx. so

# touch /var/log/php-errors.log # chown www-data.www-data /var/log/php-errors.log # systemctl restart php7.0-fpm 

after that nginx error log /var/log/nginx/error.log will be empty but all php-errors will be in /var/log/php-errors.log

Источник

Formatting PHP-FPM and Nginx access logs as standardised JSON string in Docker environment

If you want to change PHP-FPM and Nginx container log format to JSON while keeping same style, you can use example below.

Structure

.
├── docker
│ ├── docker-compose.yml
│ ├── Makefile
│ ├── nginx
│ │ ├── app.conf
│ │ ├── Dockerfile
│ │ └── nginx.conf
│ └── php
│ ├── Dockerfile
│ ├── php.ini
│ └── www.conf
└── index.php

Files

docker/docker-compose.yml

version: "3.4"

services:
 
wait_php: 
build: 
context: "./php" 
hostname: "wait-php" 
volumes: 
- ". /app" 
environment: 
PS1: "\\u@\\h:\\w\\$$ "
 
wait_nginx: 
build: 
context: "./nginx" 
hostname: "wait-nginx" 
ports: 
- "1080:80" 
volumes: 
- ". /app" 
depends_on: 
- "wait_php" 
environment: 
PS1: "\\u@\\h:\\w\\$$ "

docker/nginx/Dockerfile

FROM nginx:1.15.8-alpine

WORKDIR /app

COPY app.conf /etc/nginx/conf.d/default.conf
COPY nginx.conf /etc/nginx/nginx.conf

docker/nginx/app.conf

We had to add fastcgi_param HTTP_X_REQUEST_ID $request_id; for PHP-FPM logs.

server listen 80 default_server;
 
server_name localhost;
 
root /app;
 
index index.php;
 
location ~ \.php$ try_files $uri =404; 
fastcgi_pass wait_php:9000; 
fastcgi_split_path_info ^(.+\.php)(/.+)$; 
fastcgi_index index.php; 
include fastcgi_params; 
fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name; 
fastcgi_param PATH_INFO $fastcgi_path_info; 
fastcgi_param HTTP_X_REQUEST_ID $request_id; 
>
>

docker/nginx/nginx.conf

If you remove error_log off; the PHP related coding errors will be displayed by Nginx container rather than the PHP-FPM container. I like my PHP-FPM container to own its own error so I am keeping it.

user nginx;

worker_processes 1;

error_log /var/log/nginx/error.log warn;
pid /var/run/nginx.pid;

events worker_connections 1024;
>

http include /etc/nginx/mime.types; 
default_type application/octet-stream;
 
log_format json_combined escape=json 
' '"time_local":"$time_iso8601",' 
'"client_ip":"$http_x_forwarded_for",' 
'"remote_addr":"$remote_addr",' 
'"remote_user":"$remote_user",' 
'"request":"$request",' 
'"status":"$status",' 
'"body_bytes_sent":"$body_bytes_sent",' 
'"request_time":"$request_time",' 
'"http_referrer":"$http_referer",' 
'"http_user_agent":"$http_user_agent",' 
'"request_id":"$request_id"' 
'>';
 
access_log /var/log/nginx/access.log json_combined;
 
error_log off;
 
sendfile on;
 
keepalive_timeout 65;
 
include /etc/nginx/conf.d/*.conf;
>

docker/php/Dockerfile

FROM php:7.2.13-fpm-alpine3.8

WORKDIR /app

COPY php.ini /usr/local/etc/php/conf.d/php.override.ini
COPY www.conf /usr/local/etc/php-fpm.d/www.conf

CMD ["php-fpm", "--nodaemonize"]

docker/php/php.ini

[PHP]date.timezone=UTC
log_errors=On
error_reporting=E_ALL & ~E_DEPRECATED & ~E_STRICT
display_errors=Off
max_execution_time=60
memory_limit=256M

docker/php/www.conf

You may need to add clear_env=no to see how it changes the logs or if it helps to access more environmental variables.

[global]daemonize=no

[www]user=www-data
group=www-data

listen=wait_nginx:9000

pm=dynamic
pm.max_children=40
pm.start_servers=2
pm.min_spare_servers=2
pm.max_spare_servers=4
pm.max_requests=500

access.format='T","client_ip":"%e","remote_addr":"%R","remote_user":"%u","request":"%m %e %e","status":"%s","body_bytes_sent":"%l","request_time":"%d","http_referrer":"%e","http_user_agent":"%e","request_id":"%e">'

Docker

$ docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
96d7f6c16904 docker_wait_nginx "nginx -g 'daemon of…" 4 minutes ago Up 4 minutes 0.0.0.0:1080->80/tcp docker_wait_nginx_1
f8d0c3367925 docker_wait_php "docker-php-entrypoi…" 4 minutes ago Up 4 minutes 9000/tcp docker_wait_php_1

Configuration information

The PHP access log format has C, d, e, f, l, m, M, n, o, p, P, q, Q, r, R, s, t, T, u options and they are used with % prefix — e.g. %C . However, e (represents Nginx server fastcgi_param vars and PHP-FPM server $_SERVER vars) and o (represents «header» output) are a bit different so they are used as %e — e.g. %e . Also the list of Nginx config file variables can be found here.

The PHP default access log format is «%R — %u %t \»%m %r\» %s» and the log output is 172.22.0.3 — 26/May/2019:10:57:14 +0000 «GET /index.php» 200 .

For demonstration purposes, if you have used all options in log format, your log would look like below.

$ curl -i 0.0.0.0:1080

 "C": "0.00", # CPU usage 
"d": "5.001", # Request processing duration (5 sec 1 milsec) 
"f": "/app/index.php", # Script run 
"l": "0", # Content length 
"m": "GET", # Method 
"M": "2097152", # Memory usage (byte) 
"n": "www", # Pool name 
"P": "1", # PID (master process) 
"p": "6", # PID (child process - pm.start_servers) 
"q": "", # Query string 
"Q": "", # The '?' character if query string exists 
"r": "/index.php", # Script run 
"R": "172.22.0.3", # IP of requester (Nginx) 
"s": "200", # HTTP status code 
"T": "2019-06-12T20:26:05+00:00", # Response time 
"t": "2019-06-12T20:26:00+00:00", # Request time 
"u": "" # Authenticated/remote user
>

# YOU MUST READ "/usr/local/etc/php-fpm.d/www.conf" file for detailed explanation and better usage of these parameters

Tests

PHP-FPM error log

wait_php_1 | [26-May-2019 17:49:02] WARNING: [pool www] child 7 said into stderr: "NOTICE: PHP message: PHP Parse error: syntax error, unexpected end of file in /app/index.php on line 4"

wait_php_1 | [26-May-2019 17:49:49] WARNING: [pool www] child 8 said into stderr: "NOTICE: PHP message: PHP Fatal error: Uncaught Error: Class 'Tomato' not found in /app/index.php:5"
wait_php_1 | [26-May-2019 17:49:49] WARNING: [pool www] child 8 said into stderr: "Stack trace:"
wait_php_1 | [26-May-2019 17:49:49] WARNING: [pool www] child 8 said into stderr: "#0 "
wait_php_1 | [26-May-2019 17:49:49] WARNING: [pool www] child 8 said into stderr: " thrown in /app/index.php on line 5"

Access logs

I did my best to match both log formats in configs but it’s up to you to improve it.

# PHP-FPM - wait_php_1

 "time_local": "2019-06-12T20:26:01+00:00", 
"client_ip": "2.28.107.100", 
"remote_addr": "172.22.0.3", 
"remote_user": "", 
"request": "GET / HTTP/1.1", 
"status": "200", 
"body_bytes_sent": "0", 
"request_time": "0.002", 
"http_referrer": "-", 
"http_user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36", 
"request_id": "98bb9fbfb3bc710422d87b22d380a4e6"
>

# Nginx - wait_nginx_1

 "time_local": "2019-06-12T20:26:00+00:00", 
"client_ip": "2.28.107.100", 
"remote_addr": "192.168.99.1", 
"remote_user": "", 
"request": "GET / HTTP/1.1", 
"status": "200", 
"body_bytes_sent": "2509", 
"request_time": "0.004", 
"http_referrer": "", 
"http_user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36", 
"request_id": "98bb9fbfb3bc710422d87b22d380a4e6"
>

Источник