

I'm very new to driving anything on 2 wheels (often as a passenger as a kid, but not even that since my pre-teen years many moons ago), with only a little over 400 miles on my Buddy 125, and whatever in from MSF school to get my motorcycle endorsement.
I know I am new, so am trying to stay in situations that will allow me to act "new", but since I travel full-time, that's not always possible. Due to that, I've had enough accidents that I am now pretty much petrified of driving the scooter, but have no choice but to, or quit the coolest job I've ever had.

Since owning this scooter, I've had 1 minor (only resulted in a broken toe, and no damage to my mother's car [miscommunication between me and my dad; oops], but no big deal), and 2 bigger deal ones, both resulting in my being quite hurt (first one I tried to turn around in a place that was steeply uphill, but didn't know what else to do, and ended up under the scooter, landing sideways on my wrist, which I didn't break but I still can't bend or put pressure on it without pain; second, I was trying to make a right turn off of paved road on to a gravel road, the front tire slid out, and I ended up smashing my left knee and ankle into the ground and couldn't bend my knee for almost a week). I've learned from these, but I'm not really sure what. I know what I did wrong (except the gravel: I'm not quite sure what happened there, as I wasn't going fast at all), but not sure how to not end up hurt again.
Here's where maybe you guys can help. I'll describe my riding situation, and I would love both some advice on how to ride safely, and without angering too many other drivers, and/or some recommended reading.
I'm currently working until mid-October in one of the most scenic areas in the US, and have a ~6 mile commute, one way, at least once a day, at least 4-5 days a week. (If you figure out by my description where I'm at, please, do NOT post it publicly; if you'd like to discuss -that-, please PM me. Otherwise, I'd rather that not be discussed on this topic, for my own safety.)
On my drive now, I have a steep climb up the drive from the RV park where I'm staying, that is gravel, with a posted speed limit of 5mph (that I then have to come back down when I come home). Gravel isn't my favorite to drive on, and it is a really narrow road, with only short, wooden posts spaced about 5 feet apart, guarding the drop off.
The highway is at 45mph at that section, dropping quickly to 35, then to 25 through town (about a mile). I then have a sharp U-turn, to the gated entrance to the property. That's the easy part.
Next, it is a max of 35mph through winding roads, with only 2-3 guard rails the entire trip, over steep drop-offs that end in boulders and fast-moving water. That section is about 5 miles long. It also climbs over 1000 feet elevation. At the end, there are often a minimum of 5, but up to 25, bison wandering around. It is also often quite cold, and known to snow here at any time of the year.
The 5 mile section is where I'm particularly concerned, as I'm not comfortable going over 20mph. That's fine, when there's not cars behind me. There are pull-outs at strategic spots, but I still have to get to those. The road is only going to get busier as the season goes on.
The winding part of the road is very slanted (proper, I guess, but seems almost excessively steep, given the tightness of the turns and the low speed limit), and often have no guard rails over steep drops into boulders and a river. The road is kind of narrow, and has no shoulder.
At the end, the elevation rises about 1000 feet in tight, windy turns (same kind of drop-offs). I believe this section may have a 25mph speed limit going up, which is fine, as I usually stay at that speed, but it is still uncomfortable. Going down, however, it is a 7% grade, with a posted speed limit of 35mph. Not a bit of fun, especially as I seem to want to ride the brake to keep my speed at around 20mph, which is as fast as I feel comfortable with, as there are no guard rails on most (if not all) of this section. Going downhill, I'm not comfortable trying to find a pull off (but I don't think there are any in that section) until it levels out again.
There are going to be times I'm worried about ice or snow. It can snow at any time of the year. I might be able to find a ride in from someone in a car, but that is never a guarantee, and if I have to be at work, there's not much choice I'll have as to how to get to work. I will often have to be driving to work before the sun is even up, so it is cold and dark. Other times, I have to drive home after dark.
There will be times in my ride where I will encounter the local wildlife. The most common of this is right around my work location, where dozens of bison regularly congregate. The problem is that I'm not surrounded by metal like in a car, and have to drive near them, or sometimes through some on one side of the road and some on the other side. I often do not have a way around to get to my location. I may be on a vehicle capable of moving faster than them, but I do not want to provoke them in any way.
Biggest question: Do I just go really slow, taking longer to get from Point A to Point B, not worrying about slowing down cars (til I can find a safe pull-out)? A majority of the cars will be gone in ~3 days, but some may be other workers. If I go faster, I don't feel steady at all, especially as it feels like I'm riding against the slope of the road.
Second question: Any suggestions on handling wildlife? I already leave earlier than necessary to get there one time, but that doesn't mean I will avoid them, as they are almost always there.
I'll take any other suggestions/information anyone has on anything else I've written, as well. Honestly, I'm petrified of my drive to work or home, but love my job. I cannot afford to by a car. I cannot afford to be hurt (both financially, and physically, as my lifestyle depends on my being able to travel, and the chores associated with travel).
Again, please, no negative comments. I understand my option of just getting rid of the scooter, but I really don't want to, so I'm seeking help from people who understand this method of transportation the best.