System.IO.File.Delete("FilePath");

یا
System.IO.FileInfo fi = new FileInfo("FilePath");
fi.Delete();