OK, I made some research here and I found on [OpenWrt Wiki] mwan3 (Multi WAN load balancing/failover) to be able to modify/use the “interval” parameter. When I check the current default config (/etc/config/mwan3) there are two relevant tethering entries in the config:

[...]
config interface 'tethering'
	option enabled '1'
	list track_ip '8.8.4.4'
	list track_ip '8.8.8.8'
	list track_ip '208.67.222.222'
	list track_ip '208.67.220.220'
	option family 'ipv4'
	option reliability '2'
	option count '1'
	option timeout '2'
	option interval '5'
	option down '3'
	option up '8'
[...]
config member 'tethering_only'
	option interface 'tethering'
	option metric '3'
	option weight '3'

As I have Tethering as my only WAN (no WAN cable connected), I would assume, this is the one to go and with the current setup, there is a ping every 5 seconds according to documentation.

When I adjust this value to e.g. 60 or even 300, it should already minimize it, but I cannot really fully turn it off as this is part of the principle, can I?