Local taskbar visible during remote desktop fullscreen

Try restarting explorer.exe process as mentioned in fixing remote desktop taskbar

I have figured it out today using a hint from this discussion.

"Thanks Tony, that means a program has raised the MustBeSeen system flag. Typically this is a program that needs your attention, like antivirus or backup program that has some message it's waiting to tell you. It is almost always a program icon near the clock in the notification area. Once you clear the MustBeSeen flag by addressing the program, the taskbar will hide again.

As a best practice suggestion, hit Ctrl+Shift+Escape and disable anything on the Startup tab you don't need autorunning. That limits how many things load there, and lessens how many programs can raise the MustBeSeen flag."

There must have been something in the Windows 10 Anniversary Update that's changed the way how the taskbar overlays work and so seems to be causing it.

So I have closed all my apps running in the background with notification icon and the problem went away.

Here is a link to the quoted answer.

I have Snagit on my home computer. If I open it (or it's a startup program), the taskbar of my home computer overlaps the taskbar of my remote computer. If I close Snagit on my home computer side, viola! Problem solved. Find the program running on the non-remote computer that is forcing its way into the foreground, then, "FINISH HIM!"

I had the same issue, and decided to try the remove the "I need to be seen" task. But I just right clicked on the icons and then clicked on "remove from taskbar" I kept the ones that I know have been there before the problem and removed the others. After I did that I could see my remote desktop taskbar!