The Merrimack River Coast Guard Station The Merrimack River Coast Guard Station at Plum Island Point, Newburyport, is the birthplace of the Coast Guard.