You must connect the battery negatives together to create a common reference potential. If you don't do this, your receiver's output (connected to the driver's input) will be floating, there will be no path for current from the receiver to flow into the driver and back to the receiver. This will lead to non-predictable, erratic behavior of the whole circuit.