We introduce an algorithm for systematically improving the efficiency of parallel tempering Monte Carlo simulations by optimizing the simulated temperature set. Our approach is closely related to a recently introduced adaptive algorithm that optimizes the simulated statistical ensemble in generalized broad-histogram Monte Carlo simulations. Conventionally, a temperature set is chosen in such a way that the acceptance rates for replica swaps between adjacent temperatures are independent of the temperature and large enough to ensure frequent swaps. In this paper, we show that by choosing the temperatures with a modified version of the optimized ensemble feedback method we can minimize the round-trip times between the lowest and highest temperatures which effectively increases the efficiency of the parallel tempering algorithm. In particular, the density of temperatures in the optimized temperature set increases at the 'bottlenecks' of the simulation, such as phase transitions. In turn, the acceptance rates are now temperature dependent in the optimized temperature ensemble. We illustrate the feedback-optimized parallel tempering algorithm by studying the two-dimensional Ising ferromagnet and the two-dimensional fully frustrated Ising model, and briefly discuss possible feedback schemes for systems that require configurational averages, such as spin glasses.

We report a novel singularity in the hysteresis of spin glasses, the reversal-field memory effect, which creates a nonanalyticity in the magnetization curves at a particular point related to the history of the sample. The origin of the effect is due to the existence of a macroscopic number of "symmetric clusters" of spins associated with a local spin-reversal symmetry of the Hamiltonian. We use first order reversal curve (FORC) diagrams to characterize the effect and compare to experimental results on thin magnetic films. We contrast our results on spin glasses to random magnets and show that the FORC technique is an effective "magnetic fingerprinting" tool.