Will the Tasks Created by a Project Member Be Deleted After the Member Leaves the Project?

No.

The member's all work items, code repositories, and tasks will retain in the project. The owner of these repositories will be changed to the project administrator.

If the member is also the project creator, the project manager automatically assumes this role.