You're quite simply misunderstanding how asymmetric cryptography works:
- Public keys are used to encrypt and to verify a signature (if these operations are provided by the algorithm used).
- Private keys are used to decipher and to sign.
The public key in the certificate will NOT let you decrypt anything, it's not what it's for.