Is it possible to reorganize the order songs in the queue are played? Say I just added a song to the queue and would like to play it after the current song - is this possible?

It is not directly possible. But you can copy the songs to another playlist, rearrange them, flush the queue and add them again.