Yes, no arguing that. If a thrown disc is moved from its at rest position, it is to be replaced to its approximate position. That's regardless of how the disc came to be moved from its original position...another player moving it, a passerby picking it up, a gust of wind, a chipmunk kicks it, whatever.
But that is entirely separate from the act of moving the disc in the first place. Moving the disc, regardless of the intent to put it right back, is by rule considered intentional interference. Simply picking up another player's disc, without the thrower's permission or knowledge, for the purpose of temporarily clearing it off a tee is subject to penalty.