RUTX50 - RAM unexpectedly high useage and hangs

PRODUCT CODE: RUTX5000XXXX
HARDWARE REVISION: 0202
BATCH NUMBER: 0009
FIRMWARE VERSION: RUTX_R_00.07.15

Upon upgrading to 07.15, I had remarked that I’d seen a sizeable increase in RAM useage, over the following days, I’d seen it creep up to 98.3%. We have never seen this level of utilisation previously. This device does nothing fancy and no additional packages are loaded and we are not performing any addditional logging, such as traffic logging.

We have just had an extended period where we could ping the device but the UI and Internet were not accessible. The device recovered itself and the RAM has has gone back to 83.3%.

Event, Troubleshoot, System and Kernel logs have been captured.

Within, the logs I can see that there is some ‘out of memory’ related actions and process kills …

12720 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.159720] swanctl invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=0
12721 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.159812] CPU: 0 PID: 14841 Comm: swanctl Tainted: G O 6.6.87 #0
12722 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.169363] Hardware name: Generic DT based system
12723 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.176825] unwind_backtrace from show_stack+0x10/0x14
12724 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.181682] show_stack from dump_stack_lvl+0x40/0x4c
12725 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.187237] dump_stack_lvl from dump_header+0x48/0x1bc
12726 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.192184] dump_header from oom_kill_process+0x234/0x238
12727 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.197652] oom_kill_process from out_of_memory+0xec/0x340
12728 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.202948] out_of_memory from __alloc_pages+0x704/0xd90
12729 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.208852] __alloc_pages from __filemap_get_folio+0xf0/0x4a0
12730 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.214146] __filemap_get_folio from filemap_fault+0x6d0/0xb80
12731 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.219963] filemap_fault from __do_fault+0x38/0x15c
12732 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.226211] __do_fault from handle_mm_fault+0x94c/0xdcc
12733 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.231160] handle_mm_fault from do_page_fault+0x140/0x26c
12734 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.236628] do_page_fault from do_PrefetchAbort+0x3c/0x98
12735 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.242357] do_PrefetchAbort from ret_from_exception+0x0/0x20
12736 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.247652] Exception stack(0xc691dfb0 to 0xc691dff8)
12737 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.253561] dfa0: 00000001 beff9c4c b6f5bcb0 beff9c5c
12738 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.258773] dfc0: b6e79114 b6ec5854 beff9cd8 00000000 b6a42040 00000000 b6ec9530 b6f5f7e0
12739 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.267016] dfe0: b6ec5934 beff9c38 b6e76a04 b6e76a04 a0000010 ffffffff
12740 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.275804] Mem-Info:
12741 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.282250] active_anon:14396 inactive_anon:11246 isolated_anon:0
12742 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.282250] active_file:44 inactive_file:215 isolated_file:0
12743 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.282250] unevictable:0 dirty:0 writeback:0
12744 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.282250] slab_reclaimable:941 slab_unreclaimable:5050
12745 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.282250] mapped:7 shmem:305 pagetables:410
12746 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.282250] sec_pagetables:0 bounce:0
12747 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.282250] kernel_misc_reclaimable:0
12748 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.282250] free:4990 free_pcp:85 free_cma:0
12749 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.300589] Node 0 active_anon:57584kB inactive_anon:44984kB active_file:176kB inactive_file:860kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:28kB dirty:0kB writeback:0kB shmem:1220kB writeback_tmp:0kB kernel_stack:1344kB pagetables:1640kB sec_pagetables:0kB all_unreclaimable? yes
12750 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.327476] Normal free:19960kB boost:0kB min:16384kB low:20480kB high:24576kB reserved_highatomic:0KB active_anon:57584kB inactive_anon:44984kB active_file:124kB inactive_file:560kB unevictable:0kB writepending:0kB present:262144kB managed:246108kB mlocked:0kB bounce:0kB free_pcp:388kB local_pcp:80kB free_cma:0kB
12751 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.355360] lowmem_reserve: 0 0 0
12752 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.377525] Normal: 9204kB (UM) 3088kB (UM) 24616kB (UM) 17032kB (UM) 5064kB (UM) 8128kB (UM) 0256kB 0512kB 01024kB 02048kB 04096kB 08192kB = 19744kB
12753 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.380973] 584 total pagecache pages
12754 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.395338] 0 pages in swap cache
12755 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.399072] Free swap = 0kB
12756 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.402492] Total swap = 0kB
12757 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.405373] 65536 pages RAM
12758 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.408323] 0 pages HighMem/MovableOnly
12759 Sat Jun 14 10:33:37 2025 kern.warn kernel: [438362.411315] 4009 pages reserved
12760 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.415212] Tasks state (memory values in pages):
12761 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.418418] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
12762 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.423071] [ 385] 81 385 344 105 8192 0 0 ubusd
12763 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.431788] [ 435] 0 435 187 32 10240 0 0 askfirst
12764 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.439943] [ 578] 0 578 220 0 10240 0 0 urngd
12765 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.448653] [ 2063] 514 2063 591 74 10240 0 0 logd
12766 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.456837] [ 2064] 0 2064 614 32 12288 0 0 logread
12767 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.465076] [ 2359] 0 2359 434 64 8192 0 0 netifd
12768 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.473542] [ 4215] 567 4215 345 0 8192 0 0 dnsmasq
12769 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.481563] [ 4239] 567 4239 323 32 8192 0 0 dnsmasq
12770 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.490216] [ 4267] 101 4267 1716 64 18432 0 0 wpa_supplicant
12771 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.498648] [ 4320] 509 4320 489 64 10240 0 0 gsmd
12772 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.507417] [ 4372] 562 4372 398 32 10240 0 0 modem_trackd
12773 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.515761] [ 4436] 509 4436 1898 180 16384 0 0 mobifd
12774 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.524726] [ 4508] 542 4508 1227 264 10240 0 0 rpcd
12775 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.532955] [ 4672] 536 4672 475 64 12288 0 0 urcd
12776 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.541120] [ 4746] 0 4746 300 32 8192 0 0 dropbear
12777 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.549305] [ 4799] 0 4799 482 72 10240 0 0 event_server
12778 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.557756] [ 4855] 581 4855 744 130 12288 0 0 ip_blockd
12779 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.566767] [ 5063] 535 5063 394 64 10240 0 0 port_eventsd
12780 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.575182] [ 5221] 568 5221 336 27 8192 0 0 odhcpd
12781 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.584086] [ 5915] 560 5915 391 32 10240 0 0 iomand
12782 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.592278] [ 6371] 0 6371 1899 96 16384 0 0 gpsd
12783 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.600585] [ 6585] 573 6585 840 127 12288 0 0 mdcollectd
12784 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.608950] [ 6764] 0 6764 465 32 10240 0 0 crond
12785 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.617398] [ 6804] 0 6804 475 32 10240 0 0 ledman
12786 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.625839] [ 7252] 565 7252 274 0 8192 0 0 connchecker
12787 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.634260] [ 12985] 0 12985 9953 9405 49152 0 0 subscribe.lua
12788 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.643021] [ 15013] 0 15013 9947 9402 47104 0 0 subscribe.lua
12789 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.651801] [ 15474] 0 15474 2299 641 20480 0 0 uhttpd
12790 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.660753] [ 15503] 101 15503 1872 223 16384 0 0 hostapd
12791 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.669350] [ 11747] 0 11747 1516 192 14336 0 0 rms_mqtt
12792 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.677660] [ 5669] 529 5669 392 0 10240 0 0 ntpclient
12793 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.686063] [ 9573] 567 9573 345 33 8192 0 0 dnsmasq
12794 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.694577] [ 9574] 567 9574 345 33 8192 0 0 dnsmasq
12795 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.703217] [ 9576] 567 9576 345 33 8192 0 0 dnsmasq
12796 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.711575] [ 9577] 567 9577 345 97 8192 0 0 dnsmasq
12797 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.719976] [ 9578] 567 9578 345 65 8192 0 0 dnsmasq
12798 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.728504] [ 9579] 567 9579 345 97 8192 0 0 dnsmasq
12799 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.737035] [ 9580] 567 9580 345 65 8192 0 0 dnsmasq
12800 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.745338] [ 9581] 567 9581 345 97 8192 0 0 dnsmasq
12801 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.753700] [ 9582] 567 9582 345 65 8192 0 0 dnsmasq
12802 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.762126] [ 9583] 567 9583 345 97 8192 0 0 dnsmasq
12803 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.770600] [ 9584] 567 9584 345 65 8192 0 0 dnsmasq
12804 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.778941] [ 9585] 567 9585 345 65 8192 0 0 dnsmasq
12805 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.787350] [ 9586] 567 9586 345 97 8192 0 0 dnsmasq
12806 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.795770] [ 9587] 567 9587 345 97 8192 0 0 dnsmasq
12807 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.804188] [ 9588] 567 9588 345 97 8192 0 0 dnsmasq
12808 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.812617] [ 9589] 567 9589 345 97 8192 0 0 dnsmasq
12809 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.821129] [ 9590] 567 9590 345 97 8192 0 0 dnsmasq
12810 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.829491] [ 9591] 567 9591 345 65 8192 0 0 dnsmasq
12811 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.838062] [ 9592] 567 9592 345 97 8192 0 0 dnsmasq
12812 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.846368] [ 9593] 567 9593 345 97 8192 0 0 dnsmasq
12813 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.854720] [ 10985] 0 10985 2374 733 18432 0 0 uhttpd
12814 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.863129] [ 11298] 0 11298 518 91 10240 0 0 sh
12815 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.871306] [ 11726] 0 11726 2974 978 20480 0 0 uhttpd
12816 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.879180] [ 14781] 0 14781 518 111 8192 0 0 sh
12817 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.887603] [ 14783] 0 14783 547 64 8192 0 0 sh
12818 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.895582] [ 14841] 0 14841 1423 128 12288 0 0 swanctl
12819 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.903506] [ 15010] 0 15010 479 32 8192 0 0 sh
12820 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.912202] [ 15014] 0 15014 547 96 8192 0 0 sh
12821 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.919917] [ 15249] 0 15249 516 64 10240 0 0 sh
12822 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.927909] [ 15256] 0 15256 480 69 8192 0 0 sh
12823 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.935868] [ 15296] 0 15296 665 256 10240 0 0 fw3
12824 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.944067] [ 15306] 0 15306 224 0 10240 0 0 modprobe
12825 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.952242] [ 15312] 0 15312 461 32 12288 0 0 udhcpc
12826 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.960640] [ 15355] 0 15355 2329 661 20480 0 0 uhttpd
12827 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.968802] [ 15356] 0 15356 453 128 10240 0 0 subscribe.lua
12828 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.977419] [ 15357] 0 15357 453 96 8192 0 0 subscribe.lua
12829 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.986225] [ 15358] 0 15358 2329 694 20480 0 0 uhttpd
12830 Sat Jun 14 10:33:37 2025 kern.info kernel: [438362.995269] [ 15379] 567 15379 340 0 8192 0 0 dhcp-script.sh
12831 Sat Jun 14 10:33:37 2025 kern.info kernel: [438363.003356] [ 15380] 0 15380 516 76 8192 0 0 sh
12832 Sat Jun 14 10:33:37 2025 kern.info kernel: [438363.012386] [ 15381] 0 15381 305 0 8192 0 0 uqmi
12833 Sat Jun 14 10:33:37 2025 kern.info kernel: [438363.020395] [ 15382] 0 15382 359 0 8192 0 0 awk
12834 Sat Jun 14 10:33:37 2025 kern.info kernel: [438363.028685] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/,task=subscribe.lua,pid=12985,uid=0
12835 Sat Jun 14 10:33:37 2025 kern.err kernel: [438363.036848] Out of memory: Killed process 12985 (subscribe.lua) total-vm:39812kB, anon-rss:37620kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:48kB oom_score_adj:0
12836 Sat Jun 14 10:33:39 2025 kern.notice IPv4 connectivity restored
12837 Sat Jun 14 10:33:42 2025 kern.notice DNS resolution restored

Hello,

I have sent you a form to fill out. Once it’s completed, I will contact you privately regarding this issue. Please use ticket ID “14207” as a reference.

Best regards,

Hi Marija … form completed … Mike

Hi, this is a recurring phenomena, as we’ve just had another similar event … troubleshoot captured.

UI unresponsive, can ping device and loss of internet.

From tomorrow (wednesday), I will be at sea until Friday 20th, so without internet if further feedback is required.

Many thanks, Mike