You're fine up until the gate, I think, but it definitely is a hairy off camber place to have to turn around.
From looking at maps the other day I believe there is a legitimate hiking route from that area (Hardscrabble) on the ridge line all the way to emigration canyon. I'd like to try it sometime, but it may be too late in the season for that.
For a visual representation of that "trail".
And trying to not roll down the mountain.