If he's only spending an hour or so a day in the crate then he really needs to be spending a bit more time in there. It really is good for him as long as he is getting adequate exercise and playtime during the rest of the day. He should be napping in there, just like you would let an infant nap in the crib rather than sit and rock him for all his naps.
Every single time he steps foot in his crate, he gets a reallly yummy treat. Something high value like a tiny bit of hot dog. Every single time. Pick a word that you use when he enters, (I say "crate") so it becomes associated.
Feed him all his meals in his crate, try it with the door open, if he won't stay in and eat, then go ahead and close the door.
Invest in medium sized kongs and fill them with peanut butter or plain yogurt and pumpking and freeze them. Then when you need to crate him, he has a 'pacifier' to occupy him. I always crate my puppy during our family meal times so he doesn't learn to beg or pester us at the table. It took awhile, but with frozen kongs and consistency, he has learned to accept this routine.
Any time you cannot give him your full attention, he should be crated. This will keep him from chewing or having accidents in the house that you're not aware of. It will also give him more actual time in the crate, which is probably what he needs to become more accustomed to it.
Is the crate in the middle of the room? Most dogs will look for a safe place to "den" up. Something off to the side, in a corner etc. (Sort of like when you go to a restaurant you would prefer to have a booth on the edge rather than a table smack in the middle of the room) Try to establish a corner where he can observe the household but not be in the middle of everything. Having him sleep in his crate in your room is great advice. He just wants to be with his people. You can try covering with a towel or two to make it feel safer and more enclosed. Some people have good success with this.
Puppies are like children, consistency is the #1 most important trait for successful puppy training. Do not ever remove him or give attention when he is fussing, it simply rewards the behavior. Stick this out now, hard core, and you will be surprised how quickly this stage will pass. He may never LOVE his crate, but it doesn't have to be an issue.
You don't mention it, but if you haven't signed up for a puppy kindergarten class yet, please do that immediately. As in "right now". It is your best bet for living happily with this dog for his whole life. A good instructor has heard pretty much every scenario you can dream of and will have good suggestions on postive methods for handling problems. And, just as important, heading off future problems which will build on behavior you let slide now.
Golden puppies are generally so smart and eager to please, you will feel like a genius dog trainer if you will just go to class and work with him for about 10 or 15 minutes every day. Please keep us posted on how it is going. I promise you will get through it!