If the defensive team clears the puck and it goes off of the referee's helmet and out of play, is it a penalty?

I know a puck shot directly out of play by the defensive team from their own zone is a penalty, but if it deflects off of a defensemen's stick, then it is not. I'm wondering if a referee or linesman is considered a part of play or just a pive part of the playing area.