Right-click on the Taskbar icon and further click on ‘Pin to Taskbar’ That’s all you have to do to permanently base your File Explorer icon on the Windows 11 Taskbar.

This tutorial shows you how to Pin a user folder or user files to Windows Taskbar. If you try to simply drag-and-drop the user folders you will find that it does not work.