To delete a MySite Widget, click on "Delete" next to the desired feed title in your MySite Home and click "Ok" when a confirmation dialogue box pops up. On successful deletion, you'll see the "Feed Successfully Deleted" message on top.