The Bay St. Louis Mardi Gras Museum can be found at the Visitor Center of the Historic Train Depot. The museum displays beautiful Mardi Gras costumes alongside other Mardi Gras memorabilia.