When your taskbar does not go away, click on the search icon and without searching anything click back anywhere on the screen (except taskbar and Start menu). This is not a solution per se but a trick that works for many people. If this isn’t the case, continue with the next solution to resolve the Taskbar does not hide when on full screen mode issue on Windows 10.
The taskbar will be hidden now and you can access it by hovering down.