CloudFormation is waiting for NetworkInterfaces associated with the Lambda Function to be cleaned up

I have a CloudFormation stack with Lambda function inside a VPC,
When trying to delete the stack, the AWS CloudFormation gets stuck for 25-30 at least,
I get the following message in the events -

CloudFormation is waiting for NetworkInterfaces associated with the Lambda Function to be cleaned up.

It seems to be due to ENIs being attached to the Functions and the SecurityGroups.

From the Console it did not allow me to delete either the ENI forcibly nor the Security Group, to which the ENI is attached,
So do I just have to wait?

I found some questions and blogs which are even 2 years old,
No solution from AWS?
Automations are supposed to be quick, this is proving to be a huge blocker.
AWS Classes In Pune