I decided to ditch the randomized time of day. This is mainly due to the plugin I used not being optimized at all, which caused massive FPS drops. I will be keeping this lighting, which is basically a darker version of the lighting I had before.