Regretfully Deep