Encrypt cloudformation S3 bucket

Is there a way to encrypt the cloudformation buckets that serverless creates? I need to ensure all s3 buckets are private and encrypted (including the cloudformation ones) to comply with security standards. Help is much appreciated!