In this talk, we will consider the stochastic optimization of various sampled wavefunction forms for electronic structure, including various tensor factorizations and Krylov subspace projection. This will allow for low cost optimization of these accurate wavefunctions, while simultaneously allowing for access to thermal states and spectral functions.