No defensive position is more specialized in baseball than the catcher. The outfield positions are, more or less, the same. And while the infield positions demand different skills in different amounts (especially first base), you can move a fast enough player anywhere around the infield rather easily. Even the pitcher becomes just another infielder after they throw the ball. Furthermore, there are lots of players who spend time in both the infield and the outfield.
But to play catcher, well, to quote Liam Neeson from the 2008 hit action film Taken, that requires “a very particular set of skills.