For me, it was completely online. I did receive feedback from a supervisor on my performance. It was pretty much automated; I was given sample audio files to listen to, score them, and see what scores others had assigned. I had to fall within certain parameters regarding accuracy, consistency, etc. to be hired.