Raspberry Pi 8GB Feezes when streaming video

[davefollett]

AdaFruit Order #2912647-9709709213
Purchased on Aug 31, 2022
Raspberry Pi 4 8GB
Summary: I am led to believe my issue is due to faulty hardware (see details below). How can I arrange a replacement?

Issue description:

Code: Select all

root@raspberrypi:~# cat /etc/os-release
PRETTY_NAME="Raspbian GNU/Linux 10 (buster)"
NAME="Raspbian GNU/Linux"
VERSION_ID="10"
VERSION="10 (buster)"
VERSION_CODENAME=buster
ID=raspbian
ID_LIKE=debian
HOME_URL="http://www.raspbian.org/"
SUPPORT_URL="http://www.raspbian.org/RaspbianForums"
BUG_REPORT_URL="http://www.raspbian.org/RaspbianBugs"

After streaming video (BANNED, disney+) for a while (time sometimes hours, sometimes minutes), my raspberry pi freezes up. I have tried several things and none seem to affect it:
- different power supply
- disable / enable the x compositor
- memory test checks out (sudo memtester 500 10)
- temp monitors never go above 38 C

The first error in the kern.log (also showed in dmesg) is "rcu: INFO: rcu_sched self-detected stall on CPU". More of the error can be seen below:

Code: Select all

Sep 29 13:54:41 raspberrypi kernel: [   14.164075] ICMPv6: process `dhcpcd' is using deprecated sysctl (syscall) net.ipv6.neigh.eth0.retrans_time - use net.ipv6.neigh.eth0.retrans_time_ms instead
Sep 29 13:54:42 raspberrypi kernel: [   14.916565] Bluetooth: Core ver 2.22
Sep 29 13:54:42 raspberrypi kernel: [   14.916635] NET: Registered protocol family 31
Sep 29 13:54:42 raspberrypi kernel: [   14.916642] Bluetooth: HCI device and connection manager initialized
Sep 29 13:54:42 raspberrypi kernel: [   14.916657] Bluetooth: HCI socket layer initialized
Sep 29 13:54:42 raspberrypi kernel: [   14.916667] Bluetooth: L2CAP socket layer initialized
Sep 29 13:54:42 raspberrypi kernel: [   14.916684] Bluetooth: SCO socket layer initialized
Sep 29 13:54:42 raspberrypi kernel: [   14.933468] Bluetooth: HCI UART driver ver 2.3
Sep 29 13:54:42 raspberrypi kernel: [   14.933479] Bluetooth: HCI UART protocol H4 registered
Sep 29 13:54:42 raspberrypi kernel: [   14.933540] Bluetooth: HCI UART protocol Three-wire (H5) registered
Sep 29 13:54:42 raspberrypi kernel: [   14.933711] Bluetooth: HCI UART protocol Broadcom registered
Sep 29 13:54:42 raspberrypi kernel: [   15.215044] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
Sep 29 13:54:42 raspberrypi kernel: [   15.215055] Bluetooth: BNEP filters: protocol multicast
Sep 29 13:54:42 raspberrypi kernel: [   15.215156] Bluetooth: BNEP socket layer initialized
Sep 29 13:54:42 raspberrypi kernel: [   15.345138] Bluetooth: RFCOMM TTY layer initialized
Sep 29 13:54:42 raspberrypi kernel: [   15.345165] Bluetooth: RFCOMM socket layer initialized
Sep 29 13:54:42 raspberrypi kernel: [   15.345194] Bluetooth: RFCOMM ver 1.11
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665213] rcu: INFO: rcu_sched self-detected stall on CPU
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665225] rcu: 	3-....: (2099 ticks this GP) idle=5ea/1/0x40000002 softirq=80368/80368 fqs=978
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665230] 	(t=2101 jiffies g=151061 q=6316)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665236] NMI backtrace for cpu 3
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665243] CPU: 3 PID: 1639 Comm: CompositorTileW Tainted: G         C        5.10.103-v7l+ #1529
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665247] Hardware name: BCM2711
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665251] Backtrace:
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665271] [<c0b875f0>] (dump_backtrace) from [<c0b87984>] (show_stack+0x20/0x24)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665277]  r7:ffffffff r6:00000000 r5:60000193 r4:c12e6fd8
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665286] [<c0b87964>] (show_stack) from [<c0b8bd74>] (dump_stack+0xcc/0xf8)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665295] [<c0b8bca8>] (dump_stack) from [<c07782cc>] (nmi_cpu_backtrace+0xc8/0xf4)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665301]  r10:80000193 r9:c0e284a4 r8:c0c02060 r7:c0c02070 r6:00000003 r5:00000000
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665305]  r4:00000003 r3:6e4df213
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665312] [<c0778204>] (nmi_cpu_backtrace) from [<c0778420>] (nmi_trigger_cpumask_backtrace+0x128/0x140)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665317]  r5:c1205b24 r4:c020ed30
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665326] [<c07782f8>] (nmi_trigger_cpumask_backtrace) from [<c020fc5c>] (arch_trigger_cpumask_backtrace+0x20/0x24)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665331]  r7:c1276640 r6:c12050a4 r5:c1205148 r4:00000003
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665338] [<c020fc3c>] (arch_trigger_cpumask_backtrace) from [<c0b896bc>] (rcu_dump_cpu_stacks+0x10c/0x144)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665347] [<c0b895b0>] (rcu_dump_cpu_stacks) from [<c029fd6c>] (rcu_sched_clock_irq+0x7c0/0xa38)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665352]  r10:c1203d00 r9:2ee96000 r8:00000000 r7:c10982c0 r6:c10982c0 r5:eff2e2c0
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665356]  r4:c1276640
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665364] [<c029f5ac>] (rcu_sched_clock_irq) from [<c02addd4>] (update_process_times+0x70/0x9c)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665370]  r10:c02c1cb8 r9:eff27640 r8:ffffe000 r7:00000125 r6:35eef28b r5:00000000
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665374]  r4:ffffe000
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665381] [<c02add64>] (update_process_times) from [<c02c15a4>] (tick_sched_handle+0x64/0x70)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665386]  r7:00000125 r6:0cca4845 r5:c5887d68 r4:eff27988
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665393] [<c02c1540>] (tick_sched_handle) from [<c02c1d14>] (tick_sched_timer+0x5c/0xb8)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665400] [<c02c1cb8>] (tick_sched_timer) from [<c02ae92c>] (__hrtimer_run_queues+0xe8/0x384)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665404]  r7:eff27680 r6:c120509c r5:eff27640 r4:eff27988
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665412] [<c02ae844>] (__hrtimer_run_queues) from [<c02af868>] (hrtimer_interrupt+0x130/0x2b8)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665417]  r10:eff27790 r9:eff277c0 r8:ffffffff r7:7fffffff r6:00000003 r5:20000193
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665421]  r4:eff27640
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665430] [<c02af738>] (hrtimer_interrupt) from [<c09c0430>] (arch_timer_handler_phys+0x38/0x40)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665436]  r10:0000000f r9:c5886000 r8:c1818800 r7:0000001b r6:c18e8480 r5:c1205b74
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665439]  r4:c18e6700
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665447] [<c09c03f8>] (arch_timer_handler_phys) from [<c028e120>] (handle_percpu_devid_irq+0x8c/0x21c)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665454] [<c028e094>] (handle_percpu_devid_irq) from [<c028734c>] (generic_handle_irq+0x44/0x54)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665459]  r7:00000001 r6:00000000 r5:00000000 r4:c1096d90
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665466] [<c0287308>] (generic_handle_irq) from [<c0287aac>] (__handle_domain_irq+0x6c/0xc4)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665473] [<c0287a40>] (__handle_domain_irq) from [<c020135c>] (gic_handle_irq+0x90/0xa4)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665478]  r9:c5886000 r8:c1096d9c r7:c5887d68 r6:f081400c r5:f0814000 r4:c1205b74
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665484] [<c02012cc>] (gic_handle_irq) from [<c0200abc>] (__irq_svc+0x5c/0x7c)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665489] Exception stack(0xc5887d68 to 0xc5887db0)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665495] 7d60:                   d8800014 00000000 00000000 0000000a c5887e90 c598af08
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665500] 7d80: da528bc4 00000000 ffece4e8 d8800014 0000000f c5887dc4 c5887dc8 c5887db8
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665505] 7da0: c03f2944 c0b97bec 20000113 ffffffff
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665511]  r9:c5886000 r8:ffece4e8 r7:c5887d9c r6:ffffffff r5:20000113 r4:c0b97bec
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665520] [<c0b97bac>] (_raw_spin_lock) from [<c03f2944>] (alloc_set_pte+0x2a0/0x32c)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665528] [<c03f26a4>] (alloc_set_pte) from [<c03b20b4>] (filemap_map_pages+0x3a0/0x3c4)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665533]  r10:0000000f r9:c5887e90 r8:c5910900 r7:c1205048 r6:00000402 r5:00000406
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665537]  r4:da528bc4
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665544] [<c03b1d14>] (filemap_map_pages) from [<c03f3a10>] (handle_mm_fault+0xe20/0x1124)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665549]  r10:c1205048 r9:00000040 r8:00000254 r7:0000000f r6:c5887e90 r5:00000000
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665554]  r4:ab69d000
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665560] [<c03f2bf0>] (handle_mm_fault) from [<c0b97fdc>] (do_page_fault+0x144/0x314)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665566]  r10:00000254 r9:00000000 r8:c4fdc644 r7:c4fdc600 r6:00000206 r5:ab69d000
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665570]  r4:c5887fb0
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665577] [<c0b97e98>] (do_page_fault) from [<c0b9828c>] (do_translation_fault+0xe0/0x10c)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665582]  r10:00000500 r9:00000500 r8:00000206 r7:ab69d000 r6:c0b981ac r5:00000206
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665586]  r4:c120af78
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665593] [<c0b981ac>] (do_translation_fault) from [<c0214de4>] (do_DataAbort+0x40/0xc0)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665599]  r9:00000500 r8:c5887fb0 r7:ab69d000 r6:c0b981ac r5:00000206 r4:c120af78
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665605] [<c0214da4>] (do_DataAbort) from [<c0200da4>] (__dabt_usr+0x44/0x60)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665609] Exception stack(0xc5887fb0 to 0xc5887ff8)
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665614] 7fa0:                                     ab69d000 ab193000 00000500 00000500
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665620] 7fc0: ab193000 ab69d000 00000198 03211a10 00000540 00000500 00000500 ae9cf720
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665625] 7fe0: 00000500 ae9cf700 03e8fb80 03211a10 20000010 ffffffff
Sep 29 14:15:43 raspberrypi kernel: [ 1258.665631]  r8:30c5387d r7:30c5383d r6:ffffffff r5:20000010 r4:03211a10

Searching around the internet has not produced much but this issue looks very similar to mine and was only solved with a hardware replacement.

https://forums.raspberrypi.com/viewtopic.php?t=301435

Is there anything that adafruit recommends I try? Or would it be possible to get a replacement?

Thanks,
Dave

[davefollett]

I have also tried 2 different SD Cards, same result.

[davefollett]

It also happens on bullseye

Code: Select all

PRETTY_NAME="Raspbian GNU/Linux 11 (bullseye)"
NAME="Raspbian GNU/Linux"
VERSION_ID="11"
VERSION="11 (bullseye)"
VERSION_CODENAME=bullseye
ID=raspbian
ID_LIKE=debian
HOME_URL="http://www.raspbian.org/"
SUPPORT_URL="http://www.raspbian.org/RaspbianForums"
BUG_REPORT_URL="http://www.raspbian.org/RaspbianBugs"

[adafruit_support_carter]

Is the freeze up only happening in conjunction with the video play back?

[davefollett]

Yes, as far as I can tell its just when stream video from at least the following websites:
- n e t f l i x
- disney+
- youtube

[davefollett]

I have been fiddling with this for about a month and I'm pretty sure its faulty hardware. I'd be happy to try anything you thing suggest but I'd like to get something resolved soon. The support from AdaFruit so far has been very very slow.

[adafruit_support_carter]

Your dmesg output has this:

Code: Select all

Sep 29 14:15:43 raspberrypi kernel: [ 1258.665243] CPU: 3 PID: 1639 Comm: CompositorTileW Tainted: G         C        5.10.103-v7l+ #1529

There's a post here where the person ran into this only after a kernel upgrade:
https://forums.raspberrypi.com/viewtopic.php?t=334423

So it could be software related. One way to test this would be to try an older OS image and see if the issue repeats.

[davefollett]

If this is a software issue, I would expect to see a lot more chatter online about it. I assume thousands of folks are streaming with their Raspberry Pis, yet there are very few posts (~3 including mine) about this issue.

The post you linked to can be summarized as following:

Code: Select all

Unknown kernel version - streaming worked
Upgraded to 5.10.103 - encountered same as my issue for streaming
Updated to 64 bit OS with 5.15.32, installed 32 bit chromium - streaming worked

So I upgraded my 32 bit Raspbian to the 5.15.72 kernel and I still got the issue. I have now tested the following OS / Kernel configurations.

Code: Select all

Raspbian 32-bit Buster
- 5.10.103 kernel
- 5.15.72 kernel

Raspbian 32-bit Bullseye
- 5.15.61 kernel

The raspberry pi imager does not offer anything older within its images than Raspbian 32-bit Buster with the 5.10.103 kernel. I tried without luck to downgrade to 5.4.81 with `rpi-update`.

I am now installing exactly what the person did who reported success, 64 bit Raspbian with 32 bit chromium and I will report back what happens.

[davefollett]

Blocked trying to install `64 bit Raspbian with 32 bit chromium` by this:

https://forums.raspberrypi.com/viewtopi ... 8#p2041092

Beyond frustrated, I'm 99.9% sure this is a hardware issue. By all reports 32 bit Raspbian streams N e t f l i x and Disney+ just fine.

[adafruit_support_carter]

If this is a hardware issue, it's very subtle. The only way to create the issue seems to be with streaming video which may have issues with DRM, codecs, etc.

Since this is essentially a Pi issue, please post this in the Raspberry Pi forums:
https://forums.raspberrypi.com
so the Pi engineers can take a look. This will also help by giving them visibility on this issue in general. If they deem it to be hardware related, then we can replace the Pi.

[davefollett]

I have been contributing to this post in the raspberry pi forums, its the same issue as mine. It was posted on Sept 27th and as far as I can tell no official Pi engineers have responded. How long do we wait for a response?

https://forums.raspberrypi.com/viewtopi ... 4#p2045614

[davefollett]

I just got a new type of crash, `InputThread Tainted`. This happened shortly after reconnecting my USB mouse

Code: Select all

[11307.979057] usb 1-1.1: new low-speed USB device number 5 using xhci_hcd
[11308.117982] usb 1-1.1: New USB device found, idVendor=413c, idProduct=301a, bcdDevice= 1.00
[11308.118008] usb 1-1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[11308.118026] usb 1-1.1: Product: Dell MS116 USB Optical Mouse
[11308.118044] usb 1-1.1: Manufacturer: PixArt
[11308.131833] input: PixArt Dell MS116 USB Optical Mouse as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.1/1-1.1:1.0/0003:413C:301A.0004/input/input3
[11308.132375] hid-generic 0003:413C:301A.0004: input,hidraw0: USB HID v1.11 Mouse [PixArt Dell MS116 USB Optical Mouse] on usb-0000:01:00.0-1.1/input0
[11360.140087] ------------[ cut here ]------------
[11360.140110] WARNING: CPU: 0 PID: 574 at drivers/firmware/raspberrypi.c:64 rpi_firmware_property_list+0x1f8/0x264
[11360.140116] Firmware transaction timeout
[11360.140122] Modules linked in: cmac rfcomm bnep hci_uart btbcm bluetooth ecdh_generic ecc fuse 8021q garp stp llc joydev brcmfmac brcmutil v3d hid_apple gpu_sched vc4 cfg80211 cec rfkill raspberrypi_hwmon drm_kms_helper bcm2835_v4l2(C) bcm2835_codec(C) bcm2835_isp(C) bcm2835_mmal_vchiq(C) drm vc_sm_cma(C) v4l2_mem2mem snd_bcm2835(C) videobuf2_vmalloc videobuf2_dma_contig videobuf2_memops drm_panel_orientation_quirks videobuf2_v4l2 videobuf2_common videodev snd_soc_core mc snd_compress snd_pcm_dmaengine snd_pcm rpivid_mem snd_timer snd syscopyarea sysfillrect sysimgblt fb_sys_fops backlight uio_pdrv_genirq uio nvmem_rmem i2c_dev ip_tables x_tables ipv6
[11360.140478] CPU: 0 PID: 574 Comm: InputThread Tainted: G         C        5.10.103-v7l+ #1529
[11360.140482] Hardware name: BCM2711
[11360.140486] Backtrace:
[11360.140500] [<c0b875f0>] (dump_backtrace) from [<c0b87984>] (show_stack+0x20/0x24)
[11360.140507]  r7:ffffffff r6:00000000 r5:60000013 r4:c12e6fd8
[11360.140515] [<c0b87964>] (show_stack) from [<c0b8bd74>] (dump_stack+0xcc/0xf8)
[11360.140524] [<c0b8bca8>] (dump_stack) from [<c0220c8c>] (__warn+0xfc/0x114)
[11360.140530]  r10:00000000 r9:00000009 r8:c09bfcc0 r7:00000040 r6:00000009 r5:c09bfcc0
[11360.140535]  r4:c0ea26a8 r3:c1205094
[11360.140541] [<c0220b90>] (__warn) from [<c0b88128>] (warn_slowpath_fmt+0xa4/0xd8)
[11360.140547]  r7:00000040 r6:c0ea26a8 r5:c1205048 r4:c0ea26c8
[11360.140554] [<c0b88088>] (warn_slowpath_fmt) from [<c09bfcc0>] (rpi_firmware_property_list+0x1f8/0x264)
[11360.140560]  r9:00000048 r8:c1205048 r7:c1a9d340 r6:dac04000 r5:00001000 r4:0000000e
[11360.140604] [<c09bfac8>] (rpi_firmware_property_list) from [<bf4759cc>] (vc4_plane_set_blank+0x110/0x168 [vc4])
[11360.140610]  r10:c52df400 r9:00000000 r8:00000000 r7:c3274000 r6:c3359e20 r5:c1205048
[11360.140614]  r4:c3359c40
[11360.140675] [<bf4758bc>] (vc4_plane_set_blank [vc4]) from [<bf475bac>] (vc4_plane_atomic_update+0x34/0x38 [vc4])
[11360.140681]  r8:c424c000 r7:bf497b38 r6:c3359c40 r5:00000007 r4:c42c1540
[11360.140757] [<bf475b78>] (vc4_plane_atomic_update [vc4]) from [<bf351118>] (drm_atomic_helper_commit_planes+0xe8/0x28c [drm_kms_helper])
[11360.140824] [<bf351030>] (drm_atomic_helper_commit_planes [drm_kms_helper]) from [<bf47837c>] (vc4_atomic_complete_commit+0x1c8/0x714 [vc4])
[11360.140830]  r10:c59a9d80 r9:00000000 r8:c42c1600 r7:00000000 r6:00000001 r5:c3274000
[11360.140834]  r4:c42c1540
[11360.140892] [<bf4781b4>] (vc4_atomic_complete_commit [vc4]) from [<bf478a4c>] (vc4_atomic_commit+0x184/0x1d4 [vc4])
[11360.140898]  r10:c59a9d80 r9:00000000 r8:c32744f8 r7:00000000 r6:00000000 r5:c3274000
[11360.140902]  r4:c42c1540
[11360.141017] [<bf4788c8>] (vc4_atomic_commit [vc4]) from [<bf1f0a24>] (drm_atomic_commit+0x54/0x60 [drm])
[11360.141023]  r9:0000012e r8:c335a440 r7:00000000 r6:c3274000 r5:c42c1540 r4:00000000
[11360.141139] [<bf1f09d0>] (drm_atomic_commit [drm]) from [<bf351d84>] (drm_atomic_helper_update_plane+0xfc/0x134 [drm_kms_helper])
[11360.141145]  r7:00000000 r6:c3359c40 r5:c424c000 r4:c42c1540
[11360.141258] [<bf351c88>] (drm_atomic_helper_update_plane [drm_kms_helper]) from [<bf1fb288>] (__setplane_atomic+0x104/0x144 [drm])
[11360.141264]  r10:00400000 r9:00400000 r8:00000000 r7:0000012e r6:c335a440 r5:c59a9d80
[11360.141269]  r4:bf351c88 r3:0000012e
[11360.141417] [<bf1fb184>] (__setplane_atomic [drm]) from [<bf1fb5d8>] (drm_mode_cursor_universal+0x174/0x294 [drm])
[11360.141422]  r10:c4321d64 r9:c3274000 r8:c3359c40 r7:c1205048 r6:c335a440 r5:c4321db8
[11360.141426]  r4:c59a9d80
[11360.141572] [<bf1fb464>] (drm_mode_cursor_universal [drm]) from [<bf1fb7f4>] (drm_mode_cursor_common+0xfc/0x250 [drm])
[11360.141579]  r10:c4321e64 r9:00000000 r8:c335a440 r7:c2f59100 r6:c335a454 r5:c335a474
[11360.141583]  r4:c4321db8
[11360.141725] [<bf1fb6f8>] (drm_mode_cursor_common [drm]) from [<bf1fbd08>] (drm_mode_cursor_ioctl+0x78/0x94 [drm])
[11360.141731]  r10:c4321e64 r9:bf1fbc90 r8:00000002 r7:c2f59100 r6:c3274000 r5:00000000
[11360.141735]  r4:c1205048
[11360.141879] [<bf1fbc90>] (drm_mode_cursor_ioctl [drm]) from [<bf1de548>] (drm_ioctl_kernel+0xb8/0xfc [drm])
[11360.141884]  r7:00000000 r6:c2f59100 r5:c3274000 r4:c1205048
[11360.142028] [<bf1de490>] (drm_ioctl_kernel [drm]) from [<bf1de778>] (drm_ioctl+0x1ec/0x3c8 [drm])
[11360.142034]  r10:0000001c r9:000000a3 r8:c2f59100 r7:c01c64a3 r6:bf1fbc90 r5:c1205048
[11360.142038]  r4:bf214aac
[11360.142121] [<bf1de58c>] (drm_ioctl [drm]) from [<c045621c>] (sys_ioctl+0x1d4/0x8ec)
[11360.142126]  r10:0000000c r9:c4320000 r8:00000000 r7:c33b2cc0 r6:c33b2cc1 r5:c1205048
[11360.142130]  r4:c01c64a3
[11360.142139] [<c0456048>] (sys_ioctl) from [<c0200040>] (ret_fast_syscall+0x0/0x28)
[11360.142144] Exception stack(0xc4321fa8 to 0xc4321ff0)
[11360.142150] 1fa0:                   b6fe7968 b0abf0a8 0000000c c01c64a3 b0abf0a8 000000e8
[11360.142156] 1fc0: b6fe7968 b0abf0a8 c01c64a3 00000036 00000001 000000ea 001fd000 00201894
[11360.142161] 1fe0: b6d9408c b0abf08c b6d7a88c b6a06d7c
[11360.142167]  r10:00000036 r9:c4320000 r8:c0200204 r7:00000036 r6:c01c64a3 r5:b0abf0a8
[11360.142171]  r4:b6fe7968
[11360.142176] ---[ end trace 892a15a964a2f9f1 ]---
[11360.142208] ------------[ cut here ]------------
[11360.142253] WARNING: CPU: 0 PID: 574 at drivers/gpu/drm/vc4/vc4_firmware_kms.c:403 vc4_plane_set_blank+0x15c/0x168 [vc4]
[11360.142260] vc4_plane_set_blank: firmware call failed. Please update your firmware
[11360.142267] Modules linked in: cmac rfcomm bnep hci_uart btbcm bluetooth ecdh_generic ecc fuse 8021q garp stp llc joydev brcmfmac brcmutil v3d hid_apple gpu_sched vc4 cfg80211 cec rfkill raspberrypi_hwmon drm_kms_helper bcm2835_v4l2(C) bcm2835_codec(C) bcm2835_isp(C) bcm2835_mmal_vchiq(C) drm vc_sm_cma(C) v4l2_mem2mem snd_bcm2835(C) videobuf2_vmalloc videobuf2_dma_contig videobuf2_memops drm_panel_orientation_quirks videobuf2_v4l2 videobuf2_common videodev snd_soc_core mc snd_compress snd_pcm_dmaengine snd_pcm rpivid_mem snd_timer snd syscopyarea sysfillrect sysimgblt fb_sys_fops backlight uio_pdrv_genirq uio nvmem_rmem i2c_dev ip_tables x_tables ipv6
[11360.142611] CPU: 0 PID: 574 Comm: InputThread Tainted: G        WC        5.10.103-v7l+ #1529
[11360.142615] Hardware name: BCM2711
[11360.142619] Backtrace:
[11360.142634] [<c0b875f0>] (dump_backtrace) from [<c0b87984>] (show_stack+0x20/0x24)
[11360.142639]  r7:ffffffff r6:00000000 r5:60000013 r4:c12e6fd8
[11360.142647] [<c0b87964>] (show_stack) from [<c0b8bd74>] (dump_stack+0xcc/0xf8)
[11360.142656] [<c0b8bca8>] (dump_stack) from [<c0220c8c>] (__warn+0xfc/0x114)
[11360.142662]  r10:c52df400 r9:00000009 r8:bf475a18 r7:00000193 r6:00000009 r5:bf475a18
[11360.142666]  r4:bf49c574 r3:c1205094
[11360.142673] [<c0220b90>] (__warn) from [<c0b88128>] (warn_slowpath_fmt+0xa4/0xd8)
[11360.142677]  r7:00000193 r6:bf49c574 r5:c1205048 r4:bf49c53c
[11360.142711] [<c0b88088>] (warn_slowpath_fmt) from [<bf475a18>] (vc4_plane_set_blank+0x15c/0x168 [vc4])
[11360.142717]  r9:00000000 r8:00000000 r7:c3274000 r6:c3359e20 r5:c1205048 r4:ffffff92
[11360.142774] [<bf4758bc>] (vc4_plane_set_blank [vc4]) from [<bf475bac>] (vc4_plane_atomic_update+0x34/0x38 [vc4])
[11360.142780]  r8:c424c000 r7:bf497b38 r6:c3359c40 r5:00000007 r4:c42c1540
[11360.142850] [<bf475b78>] (vc4_plane_atomic_update [vc4]) from [<bf351118>] (drm_atomic_helper_commit_planes+0xe8/0x28c [drm_kms_helper])
[11360.142916] [<bf351030>] (drm_atomic_helper_commit_planes [drm_kms_helper]) from [<bf47837c>] (vc4_atomic_complete_commit+0x1c8/0x714 [vc4])
[11360.142922]  r10:c59a9d80 r9:00000000 r8:c42c1600 r7:00000000 r6:00000001 r5:c3274000
[11360.142926]  r4:c42c1540
[11360.142983] [<bf4781b4>] (vc4_atomic_complete_commit [vc4]) from [<bf478a4c>] (vc4_atomic_commit+0x184/0x1d4 [vc4])
[11360.142989]  r10:c59a9d80 r9:00000000 r8:c32744f8 r7:00000000 r6:00000000 r5:c3274000
[11360.142993]  r4:c42c1540
[11360.143100] [<bf4788c8>] (vc4_atomic_commit [vc4]) from [<bf1f0a24>] (drm_atomic_commit+0x54/0x60 [drm])
[11360.143106]  r9:0000012e r8:c335a440 r7:00000000 r6:c3274000 r5:c42c1540 r4:00000000
[11360.143221] [<bf1f09d0>] (drm_atomic_commit [drm]) from [<bf351d84>] (drm_atomic_helper_update_plane+0xfc/0x134 [drm_kms_helper])
[11360.143226]  r7:00000000 r6:c3359c40 r5:c424c000 r4:c42c1540
[11360.143336] [<bf351c88>] (drm_atomic_helper_update_plane [drm_kms_helper]) from [<bf1fb288>] (__setplane_atomic+0x104/0x144 [drm])
[11360.143342]  r10:00400000 r9:00400000 r8:00000000 r7:0000012e r6:c335a440 r5:c59a9d80
[11360.143346]  r4:bf351c88 r3:0000012e
[11360.143491] [<bf1fb184>] (__setplane_atomic [drm]) from [<bf1fb5d8>] (drm_mode_cursor_universal+0x174/0x294 [drm])
[11360.143497]  r10:c4321d64 r9:c3274000 r8:c3359c40 r7:c1205048 r6:c335a440 r5:c4321db8
[11360.143502]  r4:c59a9d80
[11360.143647] [<bf1fb464>] (drm_mode_cursor_universal [drm]) from [<bf1fb7f4>] (drm_mode_cursor_common+0xfc/0x250 [drm])
[11360.143652]  r10:c4321e64 r9:00000000 r8:c335a440 r7:c2f59100 r6:c335a454 r5:c335a474
[11360.143657]  r4:c4321db8
[11360.143800] [<bf1fb6f8>] (drm_mode_cursor_common [drm]) from [<bf1fbd08>] (drm_mode_cursor_ioctl+0x78/0x94 [drm])
[11360.143806]  r10:c4321e64 r9:bf1fbc90 r8:00000002 r7:c2f59100 r6:c3274000 r5:00000000
[11360.143810]  r4:c1205048
[11360.143953] [<bf1fbc90>] (drm_mode_cursor_ioctl [drm]) from [<bf1de548>] (drm_ioctl_kernel+0xb8/0xfc [drm])
[11360.143958]  r7:00000000 r6:c2f59100 r5:c3274000 r4:c1205048
[11360.144101] [<bf1de490>] (drm_ioctl_kernel [drm]) from [<bf1de778>] (drm_ioctl+0x1ec/0x3c8 [drm])
[11360.144107]  r10:0000001c r9:000000a3 r8:c2f59100 r7:c01c64a3 r6:bf1fbc90 r5:c1205048
[11360.144111]  r4:bf214aac
[11360.144191] [<bf1de58c>] (drm_ioctl [drm]) from [<c045621c>] (sys_ioctl+0x1d4/0x8ec)
[11360.144197]  r10:0000000c r9:c4320000 r8:00000000 r7:c33b2cc0 r6:c33b2cc1 r5:c1205048
[11360.144200]  r4:c01c64a3
[11360.144209] [<c0456048>] (sys_ioctl) from [<c0200040>] (ret_fast_syscall+0x0/0x28)
[11360.144214] Exception stack(0xc4321fa8 to 0xc4321ff0)
[11360.144219] 1fa0:                   b6fe7968 b0abf0a8 0000000c c01c64a3 b0abf0a8 000000e8
[11360.144225] 1fc0: b6fe7968 b0abf0a8 c01c64a3 00000036 00000001 000000ea 001fd000 00201894
[11360.144230] 1fe0: b6d9408c b0abf08c b6d7a88c b6a06d7c
[11360.144236]  r10:00000036 r9:c4320000 r8:c0200204 r7:00000036 r6:c01c64a3 r5:b0abf0a8
[11360.144240]  r4:b6fe7968
[11360.144245] ---[ end trace 892a15a964a2f9f2 ]---
[11362.220127] raspberrypi-clk soc:firmware:clocks: Failed to change fw-clk-v3d frequency: -110
[11363.260148] hwmon hwmon1: Failed to get throttled (-110)

[adafruit_support_carter]

It looks like a potentially complex issue / edge case situation. So it could take some time to sort through it. But based on that thread, it seems so far the general sense is that it is software related. Please continue to contribute to that thread and we'll monitor it to see what the RPF engineers are saying.

[davefollett]

Crashed again running 64 bit OS with 32 bit chromuim but this time with a slightly different message.

Code: Select all

[132714.283591] bcm2835-codec bcm2835-codec: bcm2835_codec_buf_prepare data will not fit into plane (1536 < 92160)
[132714.283617] bcm2835-codec bcm2835-codec: bcm2835_codec_buf_prepare data will not fit into plane (1536 < 92160)
[132714.283701] bcm2835-codec bcm2835-codec: bcm2835_codec_buf_prepare data will not fit into plane (1536 < 92160)
[132714.283744] bcm2835-codec bcm2835-codec: bcm2835_codec_buf_prepare data will not fit into plane (1536 < 92160)
[132714.283806] bcm2835-codec bcm2835-codec: bcm2835_codec_buf_prepare data will not fit into plane (1536 < 92160)
[132714.285439] bcm2835-codec bcm2835-codec: bcm2835_codec_buf_prepare data will not fit into plane (1536 < 92160)
[132714.286206] bcm2835-codec bcm2835-codec: bcm2835_codec_buf_prepare data will not fit into plane (1536 < 92160)
[132715.359440] ------------[ cut here ]------------
[132715.359457] Firmware transaction timeout
[132715.359493] WARNING: CPU: 2 PID: 19150 at drivers/firmware/raspberrypi.c:67 rpi_firmware_property_list+0x1dc/0x238
[132715.359518] Modules linked in: rfcomm cmac algif_hash aes_arm64 aes_generic algif_skcipher af_alg bnep hci_uart btbcm bluetooth ecdh_generic ecc libaes 8021q garp stp llc joydev hid_apple snd_soc_hdmi_codec brcmfmac brcmutil cfg80211 rpivid_hevc(C) bcm2835_codec(C) bcm2835_isp(C) bcm2835_v4l2(C) v4l2_mem2mem v3d bcm2835_mmal_vchiq(C) vc4 videobuf2_vmalloc videobuf2_dma_contig gpu_sched rfkill cec videobuf2_memops drm_kms_helper raspberrypi_hwmon videobuf2_v4l2 videobuf2_common snd_soc_core videodev i2c_brcmstb snd_bcm2835(C) snd_compress snd_pcm_dmaengine snd_pcm snd_timer vc_sm_cma(C) snd mc syscopyarea sysfillrect uio_pdrv_genirq sysimgblt fb_sys_fops nvmem_rmem uio drm i2c_dev fuse drm_panel_orientation_quirks backlight ip_tables x_tables ipv6
[132715.359649] CPU: 2 PID: 19150 Comm: kworker/u8:0 Tainted: G         C        5.15.61-v8+ #1579
[132715.359655] Hardware name: Raspberry Pi 4 Model B Rev 1.5 (DT)
[132715.359659] Workqueue: events_unbound commit_work [drm_kms_helper]
[132715.359731] pstate: 80000005 (Nzcv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[132715.359736] pc : rpi_firmware_property_list+0x1dc/0x238
[132715.359742] lr : rpi_firmware_property_list+0x1dc/0x238
[132715.359747] sp : ffffffc00f72baf0
[132715.359749] x29: ffffffc00f72baf0 x28: ffffffdb4c4b06c8 x27: 00000000ffffff92
[132715.359757] x26: ffffffc00847f008 x25: ffffff81b3770100 x24: 0000000000001000
[132715.359764] x23: 0000000000000018 x22: ffffffdb4be9a128 x21: ffffff81009fc300
[132715.359771] x20: ffffffc00847f000 x19: ffffffdb4c4b05e8 x18: 0000000000000000
[132715.359778] x17: 0000000000000000 x16: 0000000000000000 x15: 00000000f289d5e0
[132715.359785] x14: 0000000000000000 x13: 74756f656d697420 x12: ffffffdb4c3c6638
[132715.359791] x11: 0000000000000003 x10: ffffffdb4c3ae5f8 x9 : ffffffdb4b0ee8f4
[132715.359798] x8 : 0000000000017fe8 x7 : c0000000ffffefff x6 : 0000000000000001
[132715.359805] x5 : ffffffa6b2f5d000 x4 : 0000000000000000 x3 : 0000000000000001
[132715.359812] x2 : 0000000000000000 x1 : 48f20d84ac57eb00 x0 : 0000000000000000
[132715.359818] Call trace:
[132715.359821]  rpi_firmware_property_list+0x1dc/0x238
[132715.359826]  rpi_firmware_property+0x78/0x110
[132715.359831]  raspberrypi_fw_get_rate+0x54/0x88
[132715.359838]  clk_recalc+0x40/0xb0
[132715.359844]  __clk_recalc_rates+0x40/0xa8
[132715.359848]  clk_core_get_rate_recalc+0x68/0x78
[132715.359853]  clk_set_rate_range_nolock+0x230/0x2a8
[132715.359858]  clk_set_min_rate+0x48/0x100
[132715.359863]  vc4_atomic_commit_tail+0x5c8/0x7b0 [vc4]
[132715.359900]  commit_tail+0xac/0x1a8 [drm_kms_helper]
[132715.359940]  commit_work+0x1c/0x28 [drm_kms_helper]
[132715.359975]  process_one_work+0x1f8/0x4a0
[132715.359981]  worker_thread+0x50/0x480
[132715.359985]  kthread+0x140/0x158
[132715.359989]  ret_from_fork+0x10/0x20
[132715.359995] ---[ end trace ddee9979d8cc2c28 ]---
[132716.383442] raspberrypi-clk soc:firmware:clocks: Failed to change fw-clk-core frequency: -110
[132717.407467] hwmon hwmon1: Failed to get throttled (-110)
[132721.503544] raspberrypi-clk soc:firmware:clocks: Failed to change fw-clk-v3d frequency: -110
[132739.617337] vc_sm_cma_import_dmabuf: imported vc_sm_cma_get_buffer failed -512
[132739.617359] bcm2835_mmal_vchiq: vchiq_mmal_submit_buffer: vc_sm_import_dmabuf_fd failed, ret -512
[132739.617364] bcm2835-codec bcm2835-codec: device_run: Failed submitting ip buffer
[132918.915688] INFO: task Xorg:615 blocked for more than 120 seconds.
[132918.915712]       Tainted: G        WC        5.15.61-v8+ #1579
[132918.915717] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[132918.915722] task:Xorg            state:D stack:    0 pid:  615 ppid:   583 flags:0x00000001
[132918.915734] Call trace:
[132918.915737]  __switch_to+0x114/0x1c8
[132918.915752]  __schedule+0x2e4/0x888
[132918.915762]  schedule+0x68/0x128
[132918.915767]  schedule_preempt_disabled+0x20/0x38
[132918.915773]  __mutex_lock.isra.15+0x2a4/0x5b0
[132918.915780]  __mutex_lock_slowpath+0x1c/0x28
[132918.915786]  mutex_lock+0x40/0x58
[132918.915791]  v3d_clock_up_get+0x28/0x98 [v3d]
[132918.915814]  v3d_job_init+0xc4/0xe0 [v3d]
[132918.915827]  v3d_submit_cl_ioctl+0xb4/0x670 [v3d]
[132918.915838]  drm_ioctl_kernel+0xc8/0x118 [drm]
[132918.915945]  drm_ioctl+0x21c/0x450 [drm]
[132918.916013]  __arm64_sys_ioctl+0xb0/0xf0
[132918.916021]  invoke_syscall+0x4c/0x110
[132918.916028]  el0_svc_common.constprop.3+0xfc/0x120
[132918.916034]  do_el0_svc+0x2c/0x90
[132918.916040]  el0_svc+0x24/0x60
[132918.916045]  el0t_64_sync_handler+0x90/0xb8
[132918.916050]  el0t_64_sync+0x1a0/0x1a4
[132918.916078] INFO: task chromium-browse:1205 blocked for more than 120 seconds.
[132918.916083]       Tainted: G        WC        5.15.61-v8+ #1579
[132918.916087] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[132918.916092] task:chromium-browse state:D stack:    0 pid: 1205 ppid:  1183 flags:0x00400801
[132918.916100] Call trace:
[132918.916103]  __switch_to+0x114/0x1c8
[132918.916110]  __schedule+0x2e4/0x888
[132918.916116]  schedule+0x68/0x128
[132918.916121]  schedule_timeout+0x2b4/0x340
[132918.916127]  wait_for_completion+0x90/0x120
[132918.916133]  __flush_work.isra.49+0x12c/0x260
[132918.916140]  __cancel_work_timer+0x148/0x1c0
[132918.916145]  cancel_delayed_work_sync+0x1c/0x28
[132918.916152]  v3d_clock_up_get+0x58/0x98 [v3d]
[132918.916166]  v3d_job_init+0xc4/0xe0 [v3d]
[132918.916177]  v3d_submit_cl_ioctl+0xb4/0x670 [v3d]
[132918.916188]  drm_ioctl_kernel+0xc8/0x118 [drm]
[132918.916261]  drm_ioctl+0x21c/0x450 [drm]
[132918.916329]  drm_compat_ioctl+0xe4/0xf8 [drm]
[132918.916397]  __arm64_compat_sys_ioctl+0x168/0x180
[132918.916403]  invoke_syscall+0x4c/0x110
[132918.916410]  el0_svc_common.constprop.3+0x98/0x120
[132918.916416]  do_el0_svc_compat+0x24/0x58
[132918.916422]  el0_svc_compat+0x24/0x60
[132918.916426]  el0t_32_sync_handler+0xe4/0x100
[132918.916431]  el0t_32_sync+0x1a4/0x1a8
[132918.916457] INFO: task kworker/0:1:18692 blocked for more than 120 seconds.
[132918.916462]       Tainted: G        WC        5.15.61-v8+ #1579
[132918.916466] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[132918.916470] task:kworker/0:1     state:D stack:    0 pid:18692 ppid:     2 flags:0x00000008
[132918.916480] Workqueue: events get_values_poll [raspberrypi_hwmon]
[132918.916492] Call trace:
[132918.916495]  __switch_to+0x114/0x1c8
[132918.916501]  __schedule+0x2e4/0x888
[132918.916507]  schedule+0x68/0x128
[132918.916512]  schedule_preempt_disabled+0x20/0x38
[132918.916517]  __mutex_lock.isra.15+0x2a4/0x5b0
[132918.916523]  __mutex_lock_slowpath+0x1c/0x28
[132918.916529]  mutex_lock+0x40/0x58
[132918.916535]  rpi_firmware_property_list+0xe0/0x238
[132918.916543]  rpi_firmware_property+0x78/0x110
[132918.916549]  get_values_poll+0x50/0x120 [raspberrypi_hwmon]
[132918.916555]  process_one_work+0x1f8/0x4a0
[132918.916561]  worker_thread+0x50/0x480
[132918.916567]  kthread+0x140/0x158
[132918.916572]  ret_from_fork+0x10/0x20
[132918.916578] INFO: task kworker/3:1:19125 blocked for more than 120 seconds.
[132918.916583]       Tainted: G        WC        5.15.61-v8+ #1579
[132918.916587] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[132918.916590] task:kworker/3:1     state:D stack:    0 pid:19125 ppid:     2 flags:0x00000008
[132918.916599] Workqueue: events dbs_work_handler
[132918.916608] Call trace:
[132918.916611]  __switch_to+0x114/0x1c8
[132918.916618]  __schedule+0x2e4/0x888
[132918.916623]  schedule+0x68/0x128
[132918.916628]  schedule_preempt_disabled+0x20/0x38
[132918.916633]  __mutex_lock.isra.15+0x2a4/0x5b0
[132918.916639]  __mutex_lock_slowpath+0x1c/0x28
[132918.916644]  mutex_lock+0x40/0x58
[132918.916650]  clk_prepare_lock+0x4c/0xa8
[132918.916657]  clk_round_rate+0x44/0xf0
[132918.916664]  dev_pm_opp_set_rate+0xf0/0x190
[132918.916671]  set_target+0x38/0x48
[132918.916677]  __cpufreq_driver_target+0x174/0x2c0
[132918.916682]  od_dbs_update+0xc4/0x1a8
[132918.916687]  dbs_work_handler+0x48/0x80
[132918.916693]  process_one_work+0x1f8/0x4a0
[132918.916698]  worker_thread+0x50/0x480
[132918.916703]  kthread+0x140/0x158
[132918.916708]  ret_from_fork+0x10/0x20
[132918.916714] INFO: task kworker/u8:0:19150 blocked for more than 120 seconds.
[132918.916718]       Tainted: G        WC        5.15.61-v8+ #1579
[132918.916721] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[132918.916725] task:kworker/u8:0    state:D stack:    0 pid:19150 ppid:     2 flags:0x00000008
[132918.916733] Workqueue: events_unbound commit_work [drm_kms_helper]
[132918.916797] Call trace:
[132918.916800]  __switch_to+0x114/0x1c8
[132918.916807]  __schedule+0x2e4/0x888
[132918.916812]  schedule+0x68/0x128
[132918.916817]  schedule_preempt_disabled+0x20/0x38
[132918.916823]  __mutex_lock.isra.15+0x2a4/0x5b0
[132918.916828]  __mutex_lock_slowpath+0x1c/0x28
[132918.916834]  mutex_lock+0x40/0x58
[132918.916839]  clk_prepare_lock+0x4c/0xa8
[132918.916845]  clk_set_min_rate+0x38/0x100
[132918.916853]  vc4_atomic_commit_tail+0x558/0x7b0 [vc4]
[132918.916883]  commit_tail+0xac/0x1a8 [drm_kms_helper]
[132918.916921]  commit_work+0x1c/0x28 [drm_kms_helper]
[132918.916958]  process_one_work+0x1f8/0x4a0
[132918.916964]  worker_thread+0x50/0x480
[132918.916969]  kthread+0x140/0x158
[132918.916974]  ret_from_fork+0x10/0x20
[132918.916980] INFO: task kworker/1:2:19163 blocked for more than 120 seconds.
[132918.916985]       Tainted: G        WC        5.15.61-v8+ #1579
[132918.916988] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[132918.916992] task:kworker/1:2     state:D stack:    0 pid:19163 ppid:     2 flags:0x00000008
[132918.917000] Workqueue: events v3d_clock_down_work [v3d]
[132918.917017] Call trace:
[132918.917019]  __switch_to+0x114/0x1c8
[132918.917026]  __schedule+0x2e4/0x888
[132918.917031]  schedule+0x68/0x128
[132918.917036]  schedule_timeout+0x190/0x340
[132918.917043]  wait_for_completion_timeout+0x90/0x110
[132918.917048]  mbox_send_message+0xa8/0x130
[132918.917054]  rpi_firmware_property_list+0xf0/0x238
[132918.917061]  rpi_firmware_property+0x78/0x110
[132918.917066]  raspberrypi_fw_get_rate+0x54/0x88
[132918.917074]  clk_recalc+0x40/0xb0
[132918.917080]  clk_change_rate+0xf0/0x4a8
[132918.917086]  clk_core_set_rate_nolock+0x184/0x1c0
[132918.917093]  clk_set_rate_range_nolock+0x108/0x2a8
[132918.917099]  clk_set_min_rate+0x48/0x100
[132918.917106]  v3d_clock_down_work+0x28/0x48 [v3d]
[132918.917117]  process_one_work+0x1f8/0x4a0
[132918.917123]  worker_thread+0x50/0x480
[132918.917128]  kthread+0x140/0x158
[132918.917133]  ret_from_fork+0x10/0x20
[133039.750238] INFO: task Xorg:615 blocked for more than 241 seconds.
[133039.750261]       Tainted: G        WC        5.15.61-v8+ #1579
[133039.750266] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[133039.750271] task:Xorg            state:D stack:    0 pid:  615 ppid:   583 flags:0x00000001
[133039.750284] Call trace:
[133039.750287]  __switch_to+0x114/0x1c8
[133039.750302]  __schedule+0x2e4/0x888
[133039.750312]  schedule+0x68/0x128
[133039.750317]  schedule_preempt_disabled+0x20/0x38
[133039.750323]  __mutex_lock.isra.15+0x2a4/0x5b0
[133039.750330]  __mutex_lock_slowpath+0x1c/0x28
[133039.750335]  mutex_lock+0x40/0x58
[133039.750340]  v3d_clock_up_get+0x28/0x98 [v3d]
[133039.750365]  v3d_job_init+0xc4/0xe0 [v3d]
[133039.750377]  v3d_submit_cl_ioctl+0xb4/0x670 [v3d]
[133039.750389]  drm_ioctl_kernel+0xc8/0x118 [drm]
[133039.750492]  drm_ioctl+0x21c/0x450 [drm]
[133039.750559]  __arm64_sys_ioctl+0xb0/0xf0
[133039.750567]  invoke_syscall+0x4c/0x110
[133039.750575]  el0_svc_common.constprop.3+0xfc/0x120
[133039.750581]  do_el0_svc+0x2c/0x90
[133039.750586]  el0_svc+0x24/0x60
[133039.750592]  el0t_64_sync_handler+0x90/0xb8
[133039.750597]  el0t_64_sync+0x1a0/0x1a4
[133039.750624] INFO: task chromium-browse:1205 blocked for more than 241 seconds.
[133039.750629]       Tainted: G        WC        5.15.61-v8+ #1579
[133039.750634] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[133039.750637] task:chromium-browse state:D stack:    0 pid: 1205 ppid:  1183 flags:0x00400801
[133039.750646] Call trace:
[133039.750650]  __switch_to+0x114/0x1c8
[133039.750656]  __schedule+0x2e4/0x888
[133039.750661]  schedule+0x68/0x128
[133039.750667]  schedule_timeout+0x2b4/0x340
[133039.750673]  wait_for_completion+0x90/0x120
[133039.750678]  __flush_work.isra.49+0x12c/0x260
[133039.750685]  __cancel_work_timer+0x148/0x1c0
[133039.750691]  cancel_delayed_work_sync+0x1c/0x28
[133039.750696]  v3d_clock_up_get+0x58/0x98 [v3d]
[133039.750711]  v3d_job_init+0xc4/0xe0 [v3d]
[133039.750723]  v3d_submit_cl_ioctl+0xb4/0x670 [v3d]
[133039.750735]  drm_ioctl_kernel+0xc8/0x118 [drm]
[133039.750806]  drm_ioctl+0x21c/0x450 [drm]
[133039.750874]  drm_compat_ioctl+0xe4/0xf8 [drm]
[133039.750942]  __arm64_compat_sys_ioctl+0x168/0x180
[133039.750949]  invoke_syscall+0x4c/0x110
[133039.750956]  el0_svc_common.constprop.3+0x98/0x120
[133039.750961]  do_el0_svc_compat+0x24/0x58
[133039.750967]  el0_svc_compat+0x24/0x60
[133039.750972]  el0t_32_sync_handler+0xe4/0x100
[133039.750977]  el0t_32_sync+0x1a4/0x1a8
[133039.751006] INFO: task kworker/0:1:18692 blocked for more than 241 seconds.
[133039.751010]       Tainted: G        WC        5.15.61-v8+ #1579
[133039.751014] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[133039.751017] task:kworker/0:1     state:D stack:    0 pid:18692 ppid:     2 flags:0x00000008
[133039.751028] Workqueue: events get_values_poll [raspberrypi_hwmon]
[133039.751039] Call trace:
[133039.751043]  __switch_to+0x114/0x1c8
[133039.751049]  __schedule+0x2e4/0x888
[133039.751054]  schedule+0x68/0x128
[133039.751059]  schedule_preempt_disabled+0x20/0x38
[133039.751065]  __mutex_lock.isra.15+0x2a4/0x5b0
[133039.751070]  __mutex_lock_slowpath+0x1c/0x28
[133039.751076]  mutex_lock+0x40/0x58
[133039.751081]  rpi_firmware_property_list+0xe0/0x238
[133039.751091]  rpi_firmware_property+0x78/0x110
[133039.751097]  get_values_poll+0x50/0x120 [raspberrypi_hwmon]
[133039.751103]  process_one_work+0x1f8/0x4a0
[133039.751109]  worker_thread+0x50/0x480
[133039.751114]  kthread+0x140/0x158
[133039.751119]  ret_from_fork+0x10/0x20
[133039.751126] INFO: task kworker/3:1:19125 blocked for more than 241 seconds.
[133039.751130]       Tainted: G        WC        5.15.61-v8+ #1579
[133039.751134] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[133039.751137] task:kworker/3:1     state:D stack:    0 pid:19125 ppid:     2 flags:0x00000008
[133039.751147] Workqueue: events dbs_work_handler
[133039.751156] Call trace:
[133039.751160]  __switch_to+0x114/0x1c8
[133039.751166]  __schedule+0x2e4/0x888
[133039.751171]  schedule+0x68/0x128
[133039.751177]  schedule_preempt_disabled+0x20/0x38
[133039.751182]  __mutex_lock.isra.15+0x2a4/0x5b0
[133039.751188]  __mutex_lock_slowpath+0x1c/0x28
[133039.751193]  mutex_lock+0x40/0x58
[133039.751198]  clk_prepare_lock+0x4c/0xa8
[133039.751205]  clk_round_rate+0x44/0xf0
[133039.751212]  dev_pm_opp_set_rate+0xf0/0x190
[133039.751219]  set_target+0x38/0x48
[133039.751225]  __cpufreq_driver_target+0x174/0x2c0
[133039.751230]  od_dbs_update+0xc4/0x1a8
[133039.751235]  dbs_work_handler+0x48/0x80
[133039.751241]  process_one_work+0x1f8/0x4a0
[133039.751246]  worker_thread+0x50/0x480
[133039.751251]  kthread+0x140/0x158
[133039.751256]  ret_from_fork+0x10/0x20
[136355.526920] raspberrypi-firmware soc:firmware: mbox_send_message returned -62
[140025.617259] raspberrypi-firmware soc:firmware: mbox_send_message returned -62
[143695.709010] raspberrypi-firmware soc:firmware: mbox_send_message returned -62
[147365.797308] raspberrypi-firmware soc:firmware: mbox_send_message returned -62
[151035.889108] raspberrypi-firmware soc:firmware: mbox_send_message returned -62
[151035.889144] raspberrypi-clk soc:firmware:clocks: Failed to change fw-clk-core frequency: -62