Make sure the spectrophotometer is an IR unit and do NOT dissolve the sample in water. None of the items in the beam are made of glass, but rather are made of huge, specially grown and polished NaBr or NaCl crystals. They are phenomenally expensive. Of course there are special cuvettes that are transparent to IR as well.
There are some new words for you!