Handheld at night

OK its a bit shaky, but it was a half second exposure just handheld.
I rarely take a tripod with me when going out unless it is to take a certain shot that I know will need one. I prefer to use street signs and bollards etc.
Try using a lampost for verticals just push the camera up against it and hold it tight.
By using objects to rest the camera on I get some angles I might not have thought about.
The other thing about night photography is that your camera exposure meter will be wrong all of the time you will have to dial in some exposure comp, or use in manual and subtract a couple of stops.