Will the Tasks Created by a Project Member Be Deleted After the Member Leaves the Project?

No.

The member's all work items, code repositories, and tasks will retain in the project. The owner of these repositories will be changed to the project administrator.

If the member is also the project creator, the project manager automatically assumes this role. If there is no project manager in the project, the tenant administrator becomes the project creator.