The Project Management plan does indeed contain the Cost Baseline -- in fact, all of your baselines (scope, schedule, etc) are considered part of the PM plan.
However, that does not mean that the Cost Baseline is part of the Cost Management Plan. The Cost Management Plan is all about how you are going to plan, estimate, control, and report costs. So logically the Cost Management is an input for developing the Cost Baseline.
Training for Project Management Professional (PMP)®, PMI Agile Certified Practitioner (PMI-ACP)®, and Certified Associate in Project Management (CAPM)®