I was wondering if a multi meter would be useful in this process
If the multimeter has a capacitance range it could be used. But you'll have to remove the capacitor from the PCB to get a useable measurement. But then again: Ig the capacitor gives a reasonable measurement it is probably o.k. and you can solder it back. But if the capacitor does not give a reasonable measurement (e..g because it is internally short circuited or one of the endcaps has gone open circuit, the measurement will tell you only that the capacitor is defect. You will need a schematic or a bill of materials to know which value to use for replacement.
Sometimes you may be able to read the nominal value off the capacitor. If you find an inscription in the form of a three-letter code like 102 this can be used to identify the capacitance. However, Automatic pick-and-place machines don't care about top or bottom of such an SMD component when placing it onto the PCB. Therefore the inscription may be on the bottom side of the capacitor (versus the PCB) so you would have to de-solder it to be able to read it.
Having two soldering irons or an SMD (de-) soldering tip will come in handy for this task. Otherwise you risk overheating the component, thereby destroying a possibly good component.
What makes you think this particular capacitor may be defect?