But truth is that, its never permanently delete. You can easily recover those deleted files/ folder using any free / paid data recovery software.
So, how to permanently and completely delete a file / folder. You can use a great freebie application Prevent Restore to make deleted files / folder unrecoverable.
It just overwrites deleted files with random data, so that deleted files cannot be recovered.