Been prescribed Temazepam and I'm really not sure!?

I have been prescribed these tablets for a week, but im too scared to take them. I have suffered with insomnia and waking up 2-3 times nightly for the past 2-3 years. Recently, I have now noticed that i actually stop breathing in the seconds before I fall asleep and it rouses me with a panic attack. I went to doctors finally, mostly concerned with my breathing issue & when they found out i had been suffereing with bad sleep for this long, they said the first thing to do is to try and get me to sleep through the night, before they tackle my breathing problem. However, after getting my prescription & reading the leaflet, it says NOT to take them if you have sleep apneoa (when you stop breathing for short periods during the night). My condition i think is called Sleep disordered breathing (where you stop breathing AS you fall asleep), but now I am worried that the tablets will relax my respiritory muscles even more when falling asleep & then I REALLY won't be able to breathe!! Please help