Glass-bottom boats are boats with transparent sections made from glass or other appropriate see through materials. The see through sections sit below the surface of the water so people can get a better view of fish or other interesting things that lurk beneath the surface.
The photo above and the youtube video below are from a tourism website for Green Island, Great Barrier Reef in Australia which you can look at here