Cruft left after a remove

I’m using Serverless Components and seeing a fair bit of cruft left after removes. There are API Gateway APIs, CloudFront Distributions, Route 53 record sets, and S3 buckets. I even have an S3 bucket that is obviously created by Serverless (ie. the bucket’s name is the seven random alphanumeric characters, a hyphen, and seven more random alphanums) that has a region of “Error” and can’t be deleted.

I’m mostly just working with the template examples, tweaking them very slightly.

Is there anything that one should do to help removes clean up all the cruft?