What should be the range of open circuit voltage (OCV) when measuring a fresh R9VL or UP9VL 9V lithium battery?

The normal OCV range of the RAYOVAC® 9-volt lithium batteries is between 9.6 - 9.9 volts. It is typical for an unused battery's voltage to increase gradually over time, reach as much as 9.95 volts.

Note that OCV will fluctuate by several hundred millivolts due to the measurement method and equipment used, as well as the measurement temperature and the history of storage conditions to which the battery has been exposed before measurement.