yeah cacti grow on sand, reeds grow on dirt directly adjacent to water. Cactii can grow on snow maps too (although snow accumulating on top of a cactus will stop it from growing)
I have a cactus in my upstairs foyer that i harvest every day or so, although the placement limitation (and the fact that they hurt you if you touch them) make them kinda useless for building.