Does temperature have infinite significant figures in chemistry?

Assuming you use temperature in your calculations, it does count for sig figs because it is a measurement. In general, anything you measure that does not have 100% accuracy counts for sig figs and any exact values, like conversion factors, do not count for sig figs.

that's what she said ✌️