To delete a single object, place the mouse cursor over it and hit you keyboard's DELETE key. To delete several objects at once, hold down the left mouse button and drag a selection box around the objects to be removed and then press the DELETE key.
After you do that, I suggest reading this FAQ item as well.