Question

Where does an object gain or lose it's energy to during travel through a potential difference?

Answer 1

electric field

The energy that the object gains or loses when traveling through a potential difference is supplied  or absorbed  by the electric field --- there is nothing else there. Therefore, it follows that electric fields contain energy .