Vanguard Group Inc. smells an opportunity. The world’s largest mutual-fund company is betting the passive-investment model it pioneered in the U.S. is about to seize more of a foothold in Europe, and it’s lining up for a piece of the action.