How is it that using the Trash/Recycle Bin function does not fully remove the file, however you gain space?

I'm just wondering how, when deleting files the conventional way in Windows or Mac, the files you delete are still on your hard drive (just not able to be accessed by the computer) but you gain disc space as a result of the deletion?